Jul 07 19:01:03.289634 ip-10-0-140-243 systemd[1]: Starting Kubernetes Kubelet... Jul 07 19:01:03.702115 ip-10-0-140-243 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 19:01:03.702115 ip-10-0-140-243 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 19:01:03.702115 ip-10-0-140-243 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 19:01:03.702115 ip-10-0-140-243 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 19:01:03.702115 ip-10-0-140-243 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 19:01:03.702962 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.702876 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 19:01:03.706487 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706461 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:01:03.706487 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706487 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706492 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706496 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706499 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706502 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706504 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706507 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706510 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706512 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706515 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706517 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706520 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706522 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706525 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706528 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706531 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706535 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706539 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706542 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:01:03.706557 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706545 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706548 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706550 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706553 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706555 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706558 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706561 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706564 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706567 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706570 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706574 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706576 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706579 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706581 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706584 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706586 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706588 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706591 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706594 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706596 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:01:03.706997 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706598 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706602 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706605 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706608 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706610 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706613 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706615 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706617 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706620 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706622 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706624 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706627 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706630 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706633 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706636 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706638 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706641 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706643 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706646 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706648 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:01:03.707489 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706651 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706653 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706655 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706659 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706661 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706664 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706666 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706668 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706671 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706673 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706676 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706684 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706687 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706690 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706692 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706695 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706697 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706700 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706703 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706705 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:01:03.707972 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706708 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706710 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706713 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706715 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706718 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706720 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706724 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706727 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706731 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706733 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706736 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706739 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706742 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706744 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706747 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706749 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706752 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706755 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.706757 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:01:03.708470 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707503 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707510 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707513 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707515 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707518 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707522 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707524 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707527 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707529 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707532 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707535 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707537 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707540 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707543 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707545 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707548 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707550 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707553 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707556 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707559 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:01:03.708955 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707561 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707564 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707566 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707569 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707571 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707573 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707576 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707578 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707581 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707583 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707585 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707588 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707592 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707594 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707597 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707600 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707602 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707605 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707607 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707610 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:01:03.709460 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707612 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707615 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707617 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707620 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707622 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707625 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707628 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707630 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707632 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707635 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707637 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707640 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707642 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707644 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707647 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707649 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707652 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707656 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707660 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707662 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:01:03.709951 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707665 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707668 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707670 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707674 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707676 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707679 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707681 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707685 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707689 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707692 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707695 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707699 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707702 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707705 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707708 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707710 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707713 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707716 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707719 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:01:03.710434 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707721 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707724 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707727 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707729 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707732 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707735 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707737 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707740 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707742 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707745 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707747 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707750 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707752 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707755 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707757 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707759 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707762 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707765 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707769 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:01:03.710900 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.707772 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708136 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708141 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708144 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708146 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708149 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708152 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708155 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708157 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708162 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708164 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708167 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708169 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708172 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708175 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708177 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708180 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708182 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708185 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:01:03.711420 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708187 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708190 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708192 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708195 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708197 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708200 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708202 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708205 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708207 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708209 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708212 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708214 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708217 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708219 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708221 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708224 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708226 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708229 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708231 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708234 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:01:03.711874 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708237 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708239 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708245 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708248 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708250 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708253 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708255 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708257 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708260 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708263 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708266 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708269 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708272 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708275 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708277 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708279 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708282 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708284 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708286 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708289 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:01:03.712368 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708291 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708294 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708299 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708302 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708305 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708308 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708311 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708313 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708316 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708335 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708338 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708341 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708344 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708346 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708350 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708353 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708355 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708358 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708361 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:01:03.712843 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708363 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708366 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708368 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708370 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708374 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708377 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708380 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708382 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708385 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708388 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708390 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708392 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708397 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708400 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708402 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708405 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708407 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708409 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708412 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708416 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:01:03.713343 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708420 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.708422 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708504 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708511 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708517 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708521 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708526 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708530 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708534 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708538 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708541 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708544 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708547 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708550 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708553 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708556 2576 flags.go:64] FLAG: --cgroup-root="" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708559 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708561 2576 flags.go:64] FLAG: --client-ca-file="" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708564 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708567 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708575 2576 flags.go:64] FLAG: --cluster-domain="" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708578 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708581 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708584 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 19:01:03.713925 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708588 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708597 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708600 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708603 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708606 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708609 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708612 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708614 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708617 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708620 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708624 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708627 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708629 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708632 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708635 2576 flags.go:64] FLAG: --enable-server="true" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708638 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708643 2576 flags.go:64] FLAG: --event-burst="100" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708646 2576 flags.go:64] FLAG: --event-qps="50" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708649 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708652 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708655 2576 flags.go:64] FLAG: --eviction-hard="" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708658 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708661 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708664 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708666 2576 flags.go:64] FLAG: --eviction-soft="" Jul 07 19:01:03.714539 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708669 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708672 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708675 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708678 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708681 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708684 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708686 2576 flags.go:64] FLAG: --feature-gates="" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708691 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708694 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708697 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708700 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708703 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708706 2576 flags.go:64] FLAG: --help="false" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708708 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-243.ec2.internal" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708711 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708714 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708717 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708720 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708723 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708726 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708729 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708731 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708734 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 19:01:03.715431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708738 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708741 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708744 2576 flags.go:64] FLAG: --kube-reserved="" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708747 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708749 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708752 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708755 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708757 2576 flags.go:64] FLAG: --lock-file="" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708760 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708762 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708765 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708770 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708773 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708775 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708778 2576 flags.go:64] FLAG: --logging-format="text" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708780 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708785 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708788 2576 flags.go:64] FLAG: --manifest-url="" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708791 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708795 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708798 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708802 2576 flags.go:64] FLAG: --max-pods="110" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708805 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708807 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708810 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 19:01:03.716439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708813 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708816 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708819 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708822 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708829 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708832 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708835 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708837 2576 flags.go:64] FLAG: --pod-cidr="" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708841 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708846 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708849 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708852 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708855 2576 flags.go:64] FLAG: --port="10250" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708858 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708860 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-057c0b8783f7d490f" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708863 2576 flags.go:64] FLAG: --qos-reserved="" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708866 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708869 2576 flags.go:64] FLAG: --register-node="true" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708871 2576 flags.go:64] FLAG: --register-with-taints="" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708874 2576 flags.go:64] FLAG: --registry-burst="10" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708877 2576 flags.go:64] FLAG: --registry-qps="5" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708879 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708882 2576 flags.go:64] FLAG: --reserved-memory="" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708888 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708891 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 19:01:03.717503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708893 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708896 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708899 2576 flags.go:64] FLAG: --runonce="false" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708902 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708904 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708907 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708909 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708912 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708915 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708918 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708921 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708923 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708926 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708928 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708932 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708935 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708938 2576 flags.go:64] FLAG: --system-cgroups="" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708941 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708946 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708948 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708951 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708980 2576 flags.go:64] FLAG: --tls-min-version="" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708983 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708985 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708988 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 19:01:03.718665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708991 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708994 2576 flags.go:64] FLAG: --v="2" Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.708997 2576 flags.go:64] FLAG: --version="false" Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.709001 2576 flags.go:64] FLAG: --vmodule="" Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.709005 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.709010 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709126 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709130 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709134 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709137 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709140 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709143 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709145 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709148 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709150 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709153 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709155 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709158 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709160 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709163 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709166 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:01:03.719544 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709170 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709172 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709175 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709178 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709180 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709183 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709185 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709188 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709190 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709193 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709195 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709198 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709200 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709203 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709205 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709208 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709211 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709214 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709216 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709218 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:01:03.720064 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709221 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709223 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709226 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709228 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709231 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709233 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709236 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709238 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709241 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709244 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709246 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709249 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709253 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709256 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709258 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709260 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709265 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709268 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709271 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:01:03.720574 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709274 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709277 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709279 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709282 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709285 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709287 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709290 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709292 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709294 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709298 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709300 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709303 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709305 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709308 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709310 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709313 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709315 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709333 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709335 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709338 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:01:03.721022 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709341 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709343 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709346 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709348 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709351 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709354 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709357 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709359 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709362 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709364 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709367 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709370 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709372 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709374 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709377 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709379 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709382 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709385 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709389 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:01:03.721511 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709392 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709395 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709398 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709400 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709403 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.709405 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.709897 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.717138 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.717158 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.717177 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.717186 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717313 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717345 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717351 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717356 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:01:03.721970 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717361 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717365 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717372 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717378 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717383 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717388 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717393 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717397 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717402 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717406 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717411 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717416 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717420 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717425 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717430 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717436 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717442 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717447 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717451 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:01:03.722446 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717455 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717460 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717464 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717469 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717473 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717479 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717486 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717490 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717495 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717499 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717502 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717506 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717510 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717514 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717519 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717523 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717527 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717533 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717540 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:01:03.722908 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717544 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717549 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717553 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717557 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717561 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717565 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717569 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717574 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717578 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717582 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717586 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717591 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717595 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717599 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717603 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717607 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717611 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717615 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717619 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717625 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:01:03.723382 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717630 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717634 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717639 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717643 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717647 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717651 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717655 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717660 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717663 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717667 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717672 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717676 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717680 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717684 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717688 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717692 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717696 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717700 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717704 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717708 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:01:03.723861 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717712 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717716 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717720 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717725 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717729 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717733 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717737 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717741 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717745 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717750 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717754 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717758 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717763 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717768 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717773 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717777 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:01:03.724350 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.717780 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.717789 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718800 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718872 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718881 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718886 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718892 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718897 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718902 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718907 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718912 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718917 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718922 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718927 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718940 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:01:03.724779 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718944 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718948 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718953 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718957 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718963 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718970 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718977 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718982 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718987 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718992 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.718997 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719006 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719010 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719014 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719018 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719023 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719028 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719032 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719036 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:01:03.725145 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719040 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719046 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719050 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719054 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719058 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719067 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719071 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719075 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719079 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719083 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719088 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719092 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719097 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719102 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719106 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719207 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719279 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719285 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719288 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719291 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:01:03.725617 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719294 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719298 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719301 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719304 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719307 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719310 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719312 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719315 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719341 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719344 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719347 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719350 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719353 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719355 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719358 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719360 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719363 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719366 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719369 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719399 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:01:03.726083 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719426 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719430 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719435 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719552 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719558 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719561 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719563 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719567 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719570 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719572 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719575 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719578 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719580 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719584 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719587 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719589 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719592 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719595 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719597 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719600 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:01:03.726605 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719603 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719606 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719609 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719613 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719616 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719619 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:03.719621 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.719627 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.719762 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.724014 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.725215 2576 server.go:1019] "Starting client certificate rotation" Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.725316 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 19:01:03.727070 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.725393 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 19:01:03.727832 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.727818 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 19:01:03.729167 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.729154 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 19:01:03.743954 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.743934 2576 log.go:25] "Validated CRI v1 runtime API" Jul 07 19:01:03.746262 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.746246 2576 log.go:25] "Validated CRI v1 image API" Jul 07 19:01:03.747765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.747749 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 19:01:03.751411 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.751390 2576 fs.go:135] Filesystem UUIDs: map[1ded019f-f4b9-4d5d-a13e-ef8d89f9d9f9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a71a7ef7-5bf3-412b-8e57-1923b4454018:/dev/nvme0n1p3] Jul 07 19:01:03.751501 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.751410 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 19:01:03.756019 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.755994 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 19:01:03.758736 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.757785 2576 manager.go:216] Machine: {Timestamp:2026-07-07 19:01:03.755582808 +0000 UTC m=+0.346349012 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108795 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2054b61a6481b1c5540fe045ea42a5 SystemUUID:ec2054b6-1a64-81b1-c554-0fe045ea42a5 BootID:421c8bbc-68de-47af-ada8-59bf7d61f145 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:27:84:4a:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:27:84:4a:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:87:4f:ea:a2:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 19:01:03.758736 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.758725 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 19:01:03.758952 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.758860 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 19:01:03.762770 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.762742 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 19:01:03.762905 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.762770 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 19:01:03.763507 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.763496 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 19:01:03.763550 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.763509 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 19:01:03.763550 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.763517 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 19:01:03.764106 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.764096 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 19:01:03.765408 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.765399 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 19:01:03.768032 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768020 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 19:01:03.768155 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768146 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 19:01:03.768195 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768176 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 07 19:01:03.768195 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768188 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 19:01:03.768259 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768206 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 19:01:03.768259 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768216 2576 kubelet.go:398] "Adding apiserver pod source" Jul 07 19:01:03.768259 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768224 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 19:01:03.768637 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768627 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 19:01:03.768669 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.768645 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 19:01:03.771578 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.771561 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 19:01:03.773226 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.773213 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 19:01:03.773275 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.773244 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 19:01:03.774991 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.774977 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 19:01:03.775030 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775003 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 19:01:03.775030 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775012 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 19:01:03.775030 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775020 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775034 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775042 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775051 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775056 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775063 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775068 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775076 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 19:01:03.775115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.775081 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 19:01:03.776419 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.776407 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 19:01:03.776419 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.776419 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 19:01:03.779740 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.779726 2576 server.go:1268] "Started kubelet" Jul 07 19:01:03.779833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.779797 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 19:01:03.779884 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.779844 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 19:01:03.779992 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.779966 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 19:01:03.780709 ip-10-0-140-243 systemd[1]: Started Kubernetes Kubelet. Jul 07 19:01:03.781356 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.781268 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 19:01:03.781455 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.781300 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 19:01:03.781455 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.781382 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 19:01:03.781560 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.781534 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 19:01:03.782353 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.782338 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 07 19:01:03.785179 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.785151 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 19:01:03.787223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.787209 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 19:01:03.787285 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.787266 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 19:01:03.787535 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.787340 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:03.788245 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788229 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 19:01:03.788245 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788241 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 19:01:03.788245 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788247 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 19:01:03.788458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788405 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 07 19:01:03.788458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788434 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 07 19:01:03.788683 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788668 2576 factory.go:55] Registering systemd factory Jul 07 19:01:03.788735 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788688 2576 factory.go:223] Registration of the systemd container factory successfully Jul 07 19:01:03.788898 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788885 2576 factory.go:153] Registering CRI-O factory Jul 07 19:01:03.788939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788900 2576 factory.go:223] Registration of the crio container factory successfully Jul 07 19:01:03.788968 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788941 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 19:01:03.788968 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788959 2576 factory.go:103] Registering Raw factory Jul 07 19:01:03.789035 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.788971 2576 manager.go:1196] Started watching for new ooms in manager Jul 07 19:01:03.789685 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.789656 2576 manager.go:349] Starting recovery of all containers Jul 07 19:01:03.791112 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.790025 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-243.ec2.internal.18c0171c89f3ce90 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-243.ec2.internal,UID:ip-10-0-140-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-243.ec2.internal,},FirstTimestamp:2026-07-07 19:01:03.779696272 +0000 UTC m=+0.370462476,LastTimestamp:2026-07-07 19:01:03.779696272 +0000 UTC m=+0.370462476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-243.ec2.internal,}" Jul 07 19:01:03.791960 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.791938 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 19:01:03.792097 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.792065 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 19:01:03.798579 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.798381 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 19:01:03.801846 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.801829 2576 manager.go:354] Recovery completed Jul 07 19:01:03.803900 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.803857 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 19:01:03.807708 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.807691 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:01:03.809754 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.809738 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:01:03.809840 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.809771 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:01:03.809840 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.809786 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:01:03.810368 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.810355 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 19:01:03.810434 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.810370 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 19:01:03.810434 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.810388 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 19:01:03.810434 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.810360 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:01:03.811215 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.811202 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:01:03.811264 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.811226 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:01:03.811264 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.811236 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:01:03.811545 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.811531 2576 policy_none.go:49] "None policy: Start" Jul 07 19:01:03.811615 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.811550 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 19:01:03.811615 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.811569 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 19:01:03.811738 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.811639 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-243.ec2.internal.18c0171c8bbe76a4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-243.ec2.internal,UID:ip-10-0-140-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-243.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-243.ec2.internal,},FirstTimestamp:2026-07-07 19:01:03.809754788 +0000 UTC m=+0.400520992,LastTimestamp:2026-07-07 19:01:03.809754788 +0000 UTC m=+0.400520992,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-243.ec2.internal,}" Jul 07 19:01:03.812084 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.812070 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b85vr" Jul 07 19:01:03.812527 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.812508 2576 policy_none.go:47] "Start" Jul 07 19:01:03.820429 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.820414 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b85vr" Jul 07 19:01:03.821927 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.821846 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-243.ec2.internal.18c0171c8bbed28d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-243.ec2.internal,UID:ip-10-0-140-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-243.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-243.ec2.internal,},FirstTimestamp:2026-07-07 19:01:03.809778317 +0000 UTC m=+0.400544521,LastTimestamp:2026-07-07 19:01:03.809778317 +0000 UTC m=+0.400544521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-243.ec2.internal,}" Jul 07 19:01:03.848929 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.848912 2576 manager.go:337] "Starting Device Plugin manager" Jul 07 19:01:03.849046 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.848953 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 19:01:03.849046 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.848962 2576 server.go:87] "Starting device plugin registration server" Jul 07 19:01:03.849226 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.849206 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 19:01:03.849267 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.849227 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 19:01:03.849337 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.849310 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 19:01:03.849451 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.849432 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 19:01:03.849451 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.849447 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 19:01:03.849953 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.849932 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 19:01:03.850017 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.849986 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:03.929213 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.929182 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 19:01:03.930436 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.929226 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 19:01:03.930436 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.929250 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 19:01:03.930436 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.929284 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 19:01:03.931820 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.931804 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:01:03.949858 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.949812 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:01:03.950796 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.950777 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:01:03.950884 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.950814 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:01:03.950884 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.950826 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:01:03.950884 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.950849 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-243.ec2.internal" Jul 07 19:01:03.960700 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:03.960652 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-243.ec2.internal" Jul 07 19:01:03.960700 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.960675 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-243.ec2.internal\": node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:03.990265 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:03.990239 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.030169 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.030111 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal"] Jul 07 19:01:04.030307 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.030207 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:01:04.033603 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.033585 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:01:04.033697 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.033619 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:01:04.033697 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.033636 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:01:04.035017 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.035003 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:01:04.035166 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.035153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.035199 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.035190 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:01:04.037618 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.037601 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:01:04.037700 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.037647 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:01:04.037700 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.037655 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:01:04.037700 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.037676 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:01:04.037700 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.037685 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:01:04.037830 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.037661 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:01:04.038905 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.038888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.038968 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.038920 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:01:04.039684 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.039669 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:01:04.039752 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.039703 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:01:04.039752 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.039720 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:01:04.062051 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.062030 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-243.ec2.internal\" not found" node="ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.066484 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.066462 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-243.ec2.internal\" not found" node="ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.090025 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.090001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e642e1cbd65e5f8a7222e5b0d1dca6bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal\" (UID: \"e642e1cbd65e5f8a7222e5b0d1dca6bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.090129 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.090031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e642e1cbd65e5f8a7222e5b0d1dca6bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal\" (UID: \"e642e1cbd65e5f8a7222e5b0d1dca6bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.090129 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.090054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/565d89ca2fa2c4a95da46d78283f2b5a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-243.ec2.internal\" (UID: \"565d89ca2fa2c4a95da46d78283f2b5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.091041 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.091029 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.191011 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.190971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e642e1cbd65e5f8a7222e5b0d1dca6bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal\" (UID: \"e642e1cbd65e5f8a7222e5b0d1dca6bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.191011 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.191009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/565d89ca2fa2c4a95da46d78283f2b5a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-243.ec2.internal\" (UID: \"565d89ca2fa2c4a95da46d78283f2b5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.191223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.191028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e642e1cbd65e5f8a7222e5b0d1dca6bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal\" (UID: \"e642e1cbd65e5f8a7222e5b0d1dca6bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.191223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.191070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/565d89ca2fa2c4a95da46d78283f2b5a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-243.ec2.internal\" (UID: \"565d89ca2fa2c4a95da46d78283f2b5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.191223 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.191071 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.191223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.191078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e642e1cbd65e5f8a7222e5b0d1dca6bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal\" (UID: \"e642e1cbd65e5f8a7222e5b0d1dca6bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.191223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.191102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e642e1cbd65e5f8a7222e5b0d1dca6bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal\" (UID: \"e642e1cbd65e5f8a7222e5b0d1dca6bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.291693 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.291598 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.364819 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.364779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.370007 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.369988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.392013 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.391989 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.492456 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.492421 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.592922 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.592851 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.693332 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:04.693294 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-243.ec2.internal\" not found" Jul 07 19:01:04.725182 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.725149 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 19:01:04.725690 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.725313 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 19:01:04.788724 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.788696 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:01:04.822806 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.822758 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:56:04 +0000 UTC" deadline="2028-02-26 16:35:08.913161404 +0000 UTC" Jul 07 19:01:04.822806 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.822795 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14373h34m4.090371938s" Jul 07 19:01:04.881678 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.881583 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:01:04.888006 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.887980 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.893802 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.893785 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:01:04.912344 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.912317 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 19:01:04.913488 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.913473 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" Jul 07 19:01:04.925088 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:04.925067 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 19:01:05.114035 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:05.114003 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565d89ca2fa2c4a95da46d78283f2b5a.slice/crio-92ab8780d573d780e09e2e245f55ccf9d8f7135dfc3f1db12efa8c5c56de6381 WatchSource:0}: Error finding container 92ab8780d573d780e09e2e245f55ccf9d8f7135dfc3f1db12efa8c5c56de6381: Status 404 returned error can't find the container with id 92ab8780d573d780e09e2e245f55ccf9d8f7135dfc3f1db12efa8c5c56de6381 Jul 07 19:01:05.114436 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:05.114405 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode642e1cbd65e5f8a7222e5b0d1dca6bc.slice/crio-7abf80ef40967953cf8ed405f2a87e709b85ba10184733eb4a6148af4559ad79 WatchSource:0}: Error finding container 7abf80ef40967953cf8ed405f2a87e709b85ba10184733eb4a6148af4559ad79: Status 404 returned error can't find the container with id 7abf80ef40967953cf8ed405f2a87e709b85ba10184733eb4a6148af4559ad79 Jul 07 19:01:05.120001 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.119979 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:01:05.771017 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.770982 2576 apiserver.go:52] "Watching apiserver" Jul 07 19:01:05.779890 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.779865 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 19:01:05.781192 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.781160 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-4dpqt","openshift-ovn-kubernetes/ovnkube-node-mtlt4","kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl","openshift-image-registry/node-ca-7r7rc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal","openshift-multus/multus-additional-cni-plugins-ps4mm","openshift-multus/multus-b466p","openshift-network-diagnostics/network-check-target-6crq2","openshift-network-operator/iptables-alerter-8k4c9","kube-system/global-pull-secret-syncer-kfrcd","kube-system/konnectivity-agent-cqddl","openshift-cluster-node-tuning-operator/tuned-rl7sk","openshift-dns/node-resolver-4gxnw"] Jul 07 19:01:05.782834 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.782811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.784124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.784101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.785304 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.785282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.786691 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.786664 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 19:01:05.786795 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.786707 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 19:01:05.786935 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.786918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.787012 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.786934 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 19:01:05.787012 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.786987 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 19:01:05.787123 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.787015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 19:01:05.787123 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.787044 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:01:05.787223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.787123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w5khf\"" Jul 07 19:01:05.787435 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.787412 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 19:01:05.787610 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.787593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6tc45\"" Jul 07 19:01:05.787674 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.787608 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 19:01:05.788434 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.788214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.788943 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.788920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 19:01:05.789453 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.789432 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 19:01:05.789795 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.789765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d9skn\"" Jul 07 19:01:05.790385 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.790365 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 19:01:05.791540 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.790901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 19:01:05.791540 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.790930 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 19:01:05.791540 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.791366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfwbb\"" Jul 07 19:01:05.791540 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.791524 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 19:01:05.792458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.792005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b466p" Jul 07 19:01:05.794569 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.794543 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 19:01:05.795444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.794783 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 19:01:05.795444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.795198 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:05.795444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.795213 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-52v5m\"" Jul 07 19:01:05.795444 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:05.795289 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:05.795444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.795349 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clw46\"" Jul 07 19:01:05.795750 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.795677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:05.795807 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:05.795742 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:05.796155 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.795903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 19:01:05.797090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.797068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.798417 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.798390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:05.799754 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.799723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:05.799862 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:05.799785 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:05.800149 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800130 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 19:01:05.800149 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800139 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 19:01:05.800296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 19:01:05.800296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 19:01:05.800431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 19:01:05.800574 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.800574 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slv8c\" (UniqueName: \"kubernetes.io/projected/d9d2fa19-63ea-4696-9bb1-8244db2320e3-kube-api-access-slv8c\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.800682 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-modprobe-d\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.800682 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-lib-modules\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.800682 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-host\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.800854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-run\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.800854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9664d9cc-a34b-477c-97ad-047b1dce7293-hosts-file\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.800854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-serviceca\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.800854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-system-cni-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.800854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4cddcb-a671-46a3-8f12-db355249401f-cni-binary-copy\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.800854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-conf-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.800854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysctl-conf\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-systemd\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-var-lib-kubelet\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-multus-certs\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-k8s-cni-cncf-io\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-netns\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw5jr\" (UniqueName: \"kubernetes.io/projected/5f4cddcb-a671-46a3-8f12-db355249401f-kube-api-access-qw5jr\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.800997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-sys-fs\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-cni-bin\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-kubelet\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysctl-d\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-host\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-tuned\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1870895f-6ad1-4d10-a6b2-979d70523e86-tmp\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6wqw\" (UniqueName: \"kubernetes.io/projected/1870895f-6ad1-4d10-a6b2-979d70523e86-kube-api-access-p6wqw\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-cni-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.801236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-os-release\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-socket-dir-parent\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-system-cni-dir\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9664d9cc-a34b-477c-97ad-047b1dce7293-tmp-dir\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvc29\" (UniqueName: \"kubernetes.io/projected/9664d9cc-a34b-477c-97ad-047b1dce7293-kube-api-access-cvc29\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-cnibin\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-hostroot\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f4cddcb-a671-46a3-8f12-db355249401f-multus-daemon-config\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-os-release\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysconfig\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-sys\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801664 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-socket-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-registration-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.802188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjt8t\" (UniqueName: \"kubernetes.io/projected/30513e46-e3ed-4b06-99ad-83b743505b3a-kube-api-access-hjt8t\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrslc\" (UniqueName: \"kubernetes.io/projected/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-kube-api-access-nrslc\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cnibin\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9kr9d\"" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-kubernetes\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-device-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-cni-multus\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.801995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-etc-kubernetes\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.802165 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.802277 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.802298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jkfsv\"" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.802313 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.802521 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 19:01:05.803143 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.802775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:05.805710 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.805682 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gsnct\"" Jul 07 19:01:05.805818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.805688 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 19:01:05.806005 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.805991 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 19:01:05.807065 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.807048 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:01:05.826192 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.826156 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vtl7f" Jul 07 19:01:05.833500 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.833479 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vtl7f" Jul 07 19:01:05.890573 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.890543 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 19:01:05.902173 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw5jr\" (UniqueName: \"kubernetes.io/projected/5f4cddcb-a671-46a3-8f12-db355249401f-kube-api-access-qw5jr\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-kubelet\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.902299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-cni-bin\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysctl-d\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.902299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-host\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.902299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-tuned\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.902299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1870895f-6ad1-4d10-a6b2-979d70523e86-tmp\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-cni-bin\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvc29\" (UniqueName: \"kubernetes.io/projected/9664d9cc-a34b-477c-97ad-047b1dce7293-kube-api-access-cvc29\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-host\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-cni-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysctl-d\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-os-release\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-cni-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-systemd-units\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovn-node-metrics-cert\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-cnibin\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-hostroot\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-os-release\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.902612 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-os-release\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-hostroot\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-cnibin\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-os-release\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f33b645d-59c6-4a38-a6a3-d181c594285c-agent-certs\") pod \"konnectivity-agent-cqddl\" (UID: \"f33b645d-59c6-4a38-a6a3-d181c594285c\") " pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-systemd\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902687 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-cni-bin\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovnkube-script-lib\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-socket-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-registration-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjt8t\" (UniqueName: \"kubernetes.io/projected/30513e46-e3ed-4b06-99ad-83b743505b3a-kube-api-access-hjt8t\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-socket-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-registration-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.902992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cnibin\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-kubernetes\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.903282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-etc-kubernetes\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cnibin\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-kubernetes\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-lib-modules\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-etc-kubernetes\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmlmp\" (UniqueName: \"kubernetes.io/projected/6a2240bc-8273-4344-ba35-68c3220ed1e5-kube-api-access-dmlmp\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-run-netns\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-lib-modules\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovnkube-config\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12e4cd8c-678c-4c7d-8d55-0354d18dea85-dbus\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-host\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9tg4\" (UniqueName: \"kubernetes.io/projected/0b123535-b37c-48d9-96a7-f9a841380740-kube-api-access-g9tg4\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:05.904130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-serviceca\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-host\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-system-cni-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4cddcb-a671-46a3-8f12-db355249401f-cni-binary-copy\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-conf-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-system-cni-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-systemd\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-log-socket\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-conf-dir\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-env-overrides\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-systemd\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-serviceca\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f33b645d-59c6-4a38-a6a3-d181c594285c-konnectivity-ca\") pod \"konnectivity-agent-cqddl\" (UID: \"f33b645d-59c6-4a38-a6a3-d181c594285c\") " pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-var-lib-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-ovn\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.904958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.903963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-node-log\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904019 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4cddcb-a671-46a3-8f12-db355249401f-cni-binary-copy\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b123535-b37c-48d9-96a7-f9a841380740-host-slash\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-sys-fs\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-kubelet\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-sys-fs\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6wqw\" (UniqueName: \"kubernetes.io/projected/1870895f-6ad1-4d10-a6b2-979d70523e86-kube-api-access-p6wqw\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-kubelet\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-socket-dir-parent\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-system-cni-dir\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9664d9cc-a34b-477c-97ad-047b1dce7293-tmp-dir\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-multus-socket-dir-parent\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9d2fa19-63ea-4696-9bb1-8244db2320e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-system-cni-dir\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b123535-b37c-48d9-96a7-f9a841380740-iptables-alerter-script\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:05.905583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12e4cd8c-678c-4c7d-8d55-0354d18dea85-kubelet-config\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f4cddcb-a671-46a3-8f12-db355249401f-multus-daemon-config\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysconfig\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-sys\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-cni-netd\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9664d9cc-a34b-477c-97ad-047b1dce7293-tmp-dir\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysconfig\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9d2fa19-63ea-4696-9bb1-8244db2320e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrslc\" (UniqueName: \"kubernetes.io/projected/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-kube-api-access-nrslc\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-sys\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-device-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-cni-multus\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30513e46-e3ed-4b06-99ad-83b743505b3a-device-dir\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.906147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slv8c\" (UniqueName: \"kubernetes.io/projected/d9d2fa19-63ea-4696-9bb1-8244db2320e3-kube-api-access-slv8c\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f4cddcb-a671-46a3-8f12-db355249401f-multus-daemon-config\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.904999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-modprobe-d\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-var-lib-cni-multus\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-slash\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-run\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9664d9cc-a34b-477c-97ad-047b1dce7293-hosts-file\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905092 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-modprobe-d\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-etc-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-run\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9664d9cc-a34b-477c-97ad-047b1dce7293-hosts-file\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysctl-conf\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-var-lib-kubelet\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r74g8\" (UniqueName: \"kubernetes.io/projected/8ba9fcda-92d0-4772-893a-2d8c17444d56-kube-api-access-r74g8\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-multus-certs\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.906833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-sysctl-conf\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-k8s-cni-cncf-io\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-k8s-cni-cncf-io\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1870895f-6ad1-4d10-a6b2-979d70523e86-var-lib-kubelet\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-multus-certs\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-netns\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.905380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f4cddcb-a671-46a3-8f12-db355249401f-host-run-netns\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.906243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1870895f-6ad1-4d10-a6b2-979d70523e86-etc-tuned\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.907333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.906305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1870895f-6ad1-4d10-a6b2-979d70523e86-tmp\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.915231 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.915127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvc29\" (UniqueName: \"kubernetes.io/projected/9664d9cc-a34b-477c-97ad-047b1dce7293-kube-api-access-cvc29\") pod \"node-resolver-4gxnw\" (UID: \"9664d9cc-a34b-477c-97ad-047b1dce7293\") " pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:05.915664 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.915643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw5jr\" (UniqueName: \"kubernetes.io/projected/5f4cddcb-a671-46a3-8f12-db355249401f-kube-api-access-qw5jr\") pod \"multus-b466p\" (UID: \"5f4cddcb-a671-46a3-8f12-db355249401f\") " pod="openshift-multus/multus-b466p" Jul 07 19:01:05.915756 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.915684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjt8t\" (UniqueName: \"kubernetes.io/projected/30513e46-e3ed-4b06-99ad-83b743505b3a-kube-api-access-hjt8t\") pod \"aws-ebs-csi-driver-node-p2dsl\" (UID: \"30513e46-e3ed-4b06-99ad-83b743505b3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:05.916722 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.916701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6wqw\" (UniqueName: \"kubernetes.io/projected/1870895f-6ad1-4d10-a6b2-979d70523e86-kube-api-access-p6wqw\") pod \"tuned-rl7sk\" (UID: \"1870895f-6ad1-4d10-a6b2-979d70523e86\") " pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:05.917521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.917500 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slv8c\" (UniqueName: \"kubernetes.io/projected/d9d2fa19-63ea-4696-9bb1-8244db2320e3-kube-api-access-slv8c\") pod \"multus-additional-cni-plugins-ps4mm\" (UID: \"d9d2fa19-63ea-4696-9bb1-8244db2320e3\") " pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:05.917582 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.917509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrslc\" (UniqueName: \"kubernetes.io/projected/78c4fb26-b80c-4c87-9fab-cefe20c5a71c-kube-api-access-nrslc\") pod \"node-ca-7r7rc\" (UID: \"78c4fb26-b80c-4c87-9fab-cefe20c5a71c\") " pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:05.933185 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.933137 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" event={"ID":"e642e1cbd65e5f8a7222e5b0d1dca6bc","Type":"ContainerStarted","Data":"7abf80ef40967953cf8ed405f2a87e709b85ba10184733eb4a6148af4559ad79"} Jul 07 19:01:05.934211 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:05.934188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" event={"ID":"565d89ca2fa2c4a95da46d78283f2b5a","Type":"ContainerStarted","Data":"92ab8780d573d780e09e2e245f55ccf9d8f7135dfc3f1db12efa8c5c56de6381"} Jul 07 19:01:06.006596 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12e4cd8c-678c-4c7d-8d55-0354d18dea85-kubelet-config\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-cni-netd\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-slash\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12e4cd8c-678c-4c7d-8d55-0354d18dea85-kubelet-config\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-etc-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-cni-netd\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-etc-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.006780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-slash\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r74g8\" (UniqueName: \"kubernetes.io/projected/8ba9fcda-92d0-4772-893a-2d8c17444d56-kube-api-access-r74g8\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-kubelet\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-systemd-units\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovn-node-metrics-cert\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f33b645d-59c6-4a38-a6a3-d181c594285c-agent-certs\") pod \"konnectivity-agent-cqddl\" (UID: \"f33b645d-59c6-4a38-a6a3-d181c594285c\") " pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.006991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-systemd\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-cni-bin\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovnkube-script-lib\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmlmp\" (UniqueName: \"kubernetes.io/projected/6a2240bc-8273-4344-ba35-68c3220ed1e5-kube-api-access-dmlmp\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-run-netns\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovnkube-config\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12e4cd8c-678c-4c7d-8d55-0354d18dea85-dbus\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:06.007200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9tg4\" (UniqueName: \"kubernetes.io/projected/0b123535-b37c-48d9-96a7-f9a841380740-kube-api-access-g9tg4\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-log-socket\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-env-overrides\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f33b645d-59c6-4a38-a6a3-d181c594285c-konnectivity-ca\") pod \"konnectivity-agent-cqddl\" (UID: \"f33b645d-59c6-4a38-a6a3-d181c594285c\") " pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-var-lib-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-run-netns\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-ovn\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-node-log\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b123535-b37c-48d9-96a7-f9a841380740-host-slash\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-log-socket\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-var-lib-openvswitch\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.007551 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-kubelet\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.007641 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs podName:6a2240bc-8273-4344-ba35-68c3220ed1e5 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:06.507598867 +0000 UTC m=+3.098365102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs") pod "network-metrics-daemon-4dpqt" (UID: "6a2240bc-8273-4344-ba35-68c3220ed1e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:06.007818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-systemd\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b123535-b37c-48d9-96a7-f9a841380740-iptables-alerter-script\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-host-cni-bin\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.007456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-run-ovn\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-env-overrides\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12e4cd8c-678c-4c7d-8d55-0354d18dea85-dbus\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovnkube-script-lib\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b123535-b37c-48d9-96a7-f9a841380740-iptables-alerter-script\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008302 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f33b645d-59c6-4a38-a6a3-d181c594285c-konnectivity-ca\") pod \"konnectivity-agent-cqddl\" (UID: \"f33b645d-59c6-4a38-a6a3-d181c594285c\") " pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-systemd-units\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ba9fcda-92d0-4772-893a-2d8c17444d56-node-log\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.008381 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.008460 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret podName:12e4cd8c-678c-4c7d-8d55-0354d18dea85 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:06.508445435 +0000 UTC m=+3.099211627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret") pod "global-pull-secret-syncer-kfrcd" (UID: "12e4cd8c-678c-4c7d-8d55-0354d18dea85") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:06.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b123535-b37c-48d9-96a7-f9a841380740-host-slash\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:06.009440 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.008870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovnkube-config\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.009950 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.009929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ba9fcda-92d0-4772-893a-2d8c17444d56-ovn-node-metrics-cert\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.012684 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.012662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f33b645d-59c6-4a38-a6a3-d181c594285c-agent-certs\") pod \"konnectivity-agent-cqddl\" (UID: \"f33b645d-59c6-4a38-a6a3-d181c594285c\") " pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:06.018808 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.018784 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:01:06.018990 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.018813 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:01:06.018990 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.018828 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pgvtk for pod openshift-network-diagnostics/network-check-target-6crq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:06.018990 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.018904 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk podName:44f5f16e-bbdf-491f-ba75-95333911c320 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:06.518885962 +0000 UTC m=+3.109652170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pgvtk" (UniqueName: "kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk") pod "network-check-target-6crq2" (UID: "44f5f16e-bbdf-491f-ba75-95333911c320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:06.021403 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.021339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r74g8\" (UniqueName: \"kubernetes.io/projected/8ba9fcda-92d0-4772-893a-2d8c17444d56-kube-api-access-r74g8\") pod \"ovnkube-node-mtlt4\" (UID: \"8ba9fcda-92d0-4772-893a-2d8c17444d56\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.021971 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.021947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9tg4\" (UniqueName: \"kubernetes.io/projected/0b123535-b37c-48d9-96a7-f9a841380740-kube-api-access-g9tg4\") pod \"iptables-alerter-8k4c9\" (UID: \"0b123535-b37c-48d9-96a7-f9a841380740\") " pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:06.022241 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.022214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmlmp\" (UniqueName: \"kubernetes.io/projected/6a2240bc-8273-4344-ba35-68c3220ed1e5-kube-api-access-dmlmp\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:06.098145 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.097781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" Jul 07 19:01:06.106065 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.106046 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" Jul 07 19:01:06.108313 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.108292 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d2fa19_63ea_4696_9bb1_8244db2320e3.slice/crio-0f4f27abdd3149ec87d1a73e47c13d0631d18e187a31e553a12f03a58f7e9dcf WatchSource:0}: Error finding container 0f4f27abdd3149ec87d1a73e47c13d0631d18e187a31e553a12f03a58f7e9dcf: Status 404 returned error can't find the container with id 0f4f27abdd3149ec87d1a73e47c13d0631d18e187a31e553a12f03a58f7e9dcf Jul 07 19:01:06.113303 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.113283 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1870895f_6ad1_4d10_a6b2_979d70523e86.slice/crio-be191bd638f1f22b0620104b23f81f52f41fa58c2470e60f840acfcea8c99708 WatchSource:0}: Error finding container be191bd638f1f22b0620104b23f81f52f41fa58c2470e60f840acfcea8c99708: Status 404 returned error can't find the container with id be191bd638f1f22b0620104b23f81f52f41fa58c2470e60f840acfcea8c99708 Jul 07 19:01:06.116179 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.115820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gxnw" Jul 07 19:01:06.121321 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.121303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" Jul 07 19:01:06.123679 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.123640 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9664d9cc_a34b_477c_97ad_047b1dce7293.slice/crio-f5ff11be7f70692c43c1cf3c61d3ad00fd738deca4a16f438b05b6d9d0466682 WatchSource:0}: Error finding container f5ff11be7f70692c43c1cf3c61d3ad00fd738deca4a16f438b05b6d9d0466682: Status 404 returned error can't find the container with id f5ff11be7f70692c43c1cf3c61d3ad00fd738deca4a16f438b05b6d9d0466682 Jul 07 19:01:06.128597 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.128579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7r7rc" Jul 07 19:01:06.128852 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.128835 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30513e46_e3ed_4b06_99ad_83b743505b3a.slice/crio-df865207bf9a9939973155aa6790c10984fa746b256de358aee5f6dadfecc1e8 WatchSource:0}: Error finding container df865207bf9a9939973155aa6790c10984fa746b256de358aee5f6dadfecc1e8: Status 404 returned error can't find the container with id df865207bf9a9939973155aa6790c10984fa746b256de358aee5f6dadfecc1e8 Jul 07 19:01:06.136737 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.136716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b466p" Jul 07 19:01:06.136923 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.136902 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c4fb26_b80c_4c87_9fab_cefe20c5a71c.slice/crio-43fd8f3629a531115858d27a89c4435434daa37e963097005cca5f1e65b1bf94 WatchSource:0}: Error finding container 43fd8f3629a531115858d27a89c4435434daa37e963097005cca5f1e65b1bf94: Status 404 returned error can't find the container with id 43fd8f3629a531115858d27a89c4435434daa37e963097005cca5f1e65b1bf94 Jul 07 19:01:06.145552 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.145536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:06.152455 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.152431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8k4c9" Jul 07 19:01:06.152669 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.152646 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba9fcda_92d0_4772_893a_2d8c17444d56.slice/crio-3b91783c1c7cf017e2e49e91cc5e3f73fce548f5aea19b5b3b3200f440ca7985 WatchSource:0}: Error finding container 3b91783c1c7cf017e2e49e91cc5e3f73fce548f5aea19b5b3b3200f440ca7985: Status 404 returned error can't find the container with id 3b91783c1c7cf017e2e49e91cc5e3f73fce548f5aea19b5b3b3200f440ca7985 Jul 07 19:01:06.158879 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.158860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:06.160459 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.160423 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b123535_b37c_48d9_96a7_f9a841380740.slice/crio-a18f1561c22cc5ca87b19ee8bbab9337fcef0ab75582123cb30582e722fe7baa WatchSource:0}: Error finding container a18f1561c22cc5ca87b19ee8bbab9337fcef0ab75582123cb30582e722fe7baa: Status 404 returned error can't find the container with id a18f1561c22cc5ca87b19ee8bbab9337fcef0ab75582123cb30582e722fe7baa Jul 07 19:01:06.168471 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:06.168446 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33b645d_59c6_4a38_a6a3_d181c594285c.slice/crio-1dbf9f96ad4dad1c39e4699bb6b84967f7f5c21a1f3ca63411537c74f3ea9919 WatchSource:0}: Error finding container 1dbf9f96ad4dad1c39e4699bb6b84967f7f5c21a1f3ca63411537c74f3ea9919: Status 404 returned error can't find the container with id 1dbf9f96ad4dad1c39e4699bb6b84967f7f5c21a1f3ca63411537c74f3ea9919 Jul 07 19:01:06.511797 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.511712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:06.511797 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.511757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:06.512028 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.511872 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:06.512028 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.511888 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:06.512028 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.511932 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret podName:12e4cd8c-678c-4c7d-8d55-0354d18dea85 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:07.511916439 +0000 UTC m=+4.102682631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret") pod "global-pull-secret-syncer-kfrcd" (UID: "12e4cd8c-678c-4c7d-8d55-0354d18dea85") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:06.512028 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.511959 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs podName:6a2240bc-8273-4344-ba35-68c3220ed1e5 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:07.51193924 +0000 UTC m=+4.102705450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs") pod "network-metrics-daemon-4dpqt" (UID: "6a2240bc-8273-4344-ba35-68c3220ed1e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:06.612939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.612897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:06.613155 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.613136 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:01:06.613206 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.613165 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:01:06.613206 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.613179 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pgvtk for pod openshift-network-diagnostics/network-check-target-6crq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:06.613275 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.613246 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk podName:44f5f16e-bbdf-491f-ba75-95333911c320 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:07.61322341 +0000 UTC m=+4.203989607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgvtk" (UniqueName: "kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk") pod "network-check-target-6crq2" (UID: "44f5f16e-bbdf-491f-ba75-95333911c320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:06.835528 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.835408 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:56:06 +0000 UTC" deadline="2028-01-16 03:31:59.492694128 +0000 UTC" Jul 07 19:01:06.835528 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.835474 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13376h30m52.657224994s" Jul 07 19:01:06.929776 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.929741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:06.929957 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.929892 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:06.930378 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.930357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:06.930521 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:06.930498 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:06.942487 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.942447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cqddl" event={"ID":"f33b645d-59c6-4a38-a6a3-d181c594285c","Type":"ContainerStarted","Data":"1dbf9f96ad4dad1c39e4699bb6b84967f7f5c21a1f3ca63411537c74f3ea9919"} Jul 07 19:01:06.945558 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.945522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"3b91783c1c7cf017e2e49e91cc5e3f73fce548f5aea19b5b3b3200f440ca7985"} Jul 07 19:01:06.947108 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.947044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b466p" event={"ID":"5f4cddcb-a671-46a3-8f12-db355249401f","Type":"ContainerStarted","Data":"9e8901720e36184f5934e4ef0a1ddc73e52c64e3d8f5015a3814bccae0985cbb"} Jul 07 19:01:06.949670 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.949640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" event={"ID":"30513e46-e3ed-4b06-99ad-83b743505b3a","Type":"ContainerStarted","Data":"df865207bf9a9939973155aa6790c10984fa746b256de358aee5f6dadfecc1e8"} Jul 07 19:01:06.952716 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.952689 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerStarted","Data":"0f4f27abdd3149ec87d1a73e47c13d0631d18e187a31e553a12f03a58f7e9dcf"} Jul 07 19:01:06.954690 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.954661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8k4c9" event={"ID":"0b123535-b37c-48d9-96a7-f9a841380740","Type":"ContainerStarted","Data":"a18f1561c22cc5ca87b19ee8bbab9337fcef0ab75582123cb30582e722fe7baa"} Jul 07 19:01:06.956116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.956091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7r7rc" event={"ID":"78c4fb26-b80c-4c87-9fab-cefe20c5a71c","Type":"ContainerStarted","Data":"43fd8f3629a531115858d27a89c4435434daa37e963097005cca5f1e65b1bf94"} Jul 07 19:01:06.958699 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.958673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gxnw" event={"ID":"9664d9cc-a34b-477c-97ad-047b1dce7293","Type":"ContainerStarted","Data":"f5ff11be7f70692c43c1cf3c61d3ad00fd738deca4a16f438b05b6d9d0466682"} Jul 07 19:01:06.961210 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:06.961138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" event={"ID":"1870895f-6ad1-4d10-a6b2-979d70523e86","Type":"ContainerStarted","Data":"be191bd638f1f22b0620104b23f81f52f41fa58c2470e60f840acfcea8c99708"} Jul 07 19:01:07.520112 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:07.519841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:07.520302 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:07.520153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:07.520373 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.520351 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:07.520503 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.520442 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret podName:12e4cd8c-678c-4c7d-8d55-0354d18dea85 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:09.52042023 +0000 UTC m=+6.111186437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret") pod "global-pull-secret-syncer-kfrcd" (UID: "12e4cd8c-678c-4c7d-8d55-0354d18dea85") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:07.520573 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.520541 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:07.520626 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.520612 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs podName:6a2240bc-8273-4344-ba35-68c3220ed1e5 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:09.520591828 +0000 UTC m=+6.111358047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs") pod "network-metrics-daemon-4dpqt" (UID: "6a2240bc-8273-4344-ba35-68c3220ed1e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:07.623221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:07.620876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:07.623221 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.621017 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:01:07.623221 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.621037 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:01:07.623221 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.621047 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pgvtk for pod openshift-network-diagnostics/network-check-target-6crq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:07.623221 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.621095 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk podName:44f5f16e-bbdf-491f-ba75-95333911c320 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:09.621080841 +0000 UTC m=+6.211847033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgvtk" (UniqueName: "kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk") pod "network-check-target-6crq2" (UID: "44f5f16e-bbdf-491f-ba75-95333911c320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:07.836507 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:07.836409 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:56:06 +0000 UTC" deadline="2027-12-10 11:30:06.599285756 +0000 UTC" Jul 07 19:01:07.836507 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:07.836453 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12496h28m58.762837378s" Jul 07 19:01:07.934405 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:07.933867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:07.934405 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:07.934008 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:08.929721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:08.929677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:08.930114 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:08.929837 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:08.930293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:08.930268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:08.930438 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:08.930414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:08.986309 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:08.985542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" event={"ID":"e642e1cbd65e5f8a7222e5b0d1dca6bc","Type":"ContainerStarted","Data":"3f23076946d244f4117f0099b61bff92aa1d0e8d3f7adc0309bdb5d1e095ab71"} Jul 07 19:01:09.546133 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:09.545384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:09.546133 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:09.545518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:09.546133 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.545656 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:09.546133 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.545711 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs podName:6a2240bc-8273-4344-ba35-68c3220ed1e5 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:13.545696752 +0000 UTC m=+10.136462944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs") pod "network-metrics-daemon-4dpqt" (UID: "6a2240bc-8273-4344-ba35-68c3220ed1e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:09.546133 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.546053 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:09.546133 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.546089 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret podName:12e4cd8c-678c-4c7d-8d55-0354d18dea85 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:13.546077888 +0000 UTC m=+10.136844081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret") pod "global-pull-secret-syncer-kfrcd" (UID: "12e4cd8c-678c-4c7d-8d55-0354d18dea85") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:09.646824 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:09.646781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:09.647034 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.646978 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:01:09.647034 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.646999 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:01:09.647034 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.647012 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pgvtk for pod openshift-network-diagnostics/network-check-target-6crq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:09.647216 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.647076 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk podName:44f5f16e-bbdf-491f-ba75-95333911c320 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:13.647056154 +0000 UTC m=+10.237822375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgvtk" (UniqueName: "kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk") pod "network-check-target-6crq2" (UID: "44f5f16e-bbdf-491f-ba75-95333911c320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:09.932401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:09.932312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:09.932882 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:09.932476 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:10.930420 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:10.930372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:10.930623 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:10.930513 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:10.930903 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:10.930883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:10.931017 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:10.930998 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:11.930758 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:11.930207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:11.930758 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:11.930374 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:12.930576 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:12.929884 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:12.930576 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:12.930024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:12.930576 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:12.930109 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:12.930576 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:12.930193 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:12.998583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:12.998548 2576 generic.go:356] "Generic (PLEG): container finished" podID="e642e1cbd65e5f8a7222e5b0d1dca6bc" containerID="3f23076946d244f4117f0099b61bff92aa1d0e8d3f7adc0309bdb5d1e095ab71" exitCode=0 Jul 07 19:01:12.998739 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:12.998595 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" event={"ID":"e642e1cbd65e5f8a7222e5b0d1dca6bc","Type":"ContainerDied","Data":"3f23076946d244f4117f0099b61bff92aa1d0e8d3f7adc0309bdb5d1e095ab71"} Jul 07 19:01:13.578856 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:13.578819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:13.579046 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:13.578878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:13.579046 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.579002 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:13.579161 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.579079 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs podName:6a2240bc-8273-4344-ba35-68c3220ed1e5 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:21.579056583 +0000 UTC m=+18.169822781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs") pod "network-metrics-daemon-4dpqt" (UID: "6a2240bc-8273-4344-ba35-68c3220ed1e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:13.579161 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.579009 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:13.579161 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.579146 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret podName:12e4cd8c-678c-4c7d-8d55-0354d18dea85 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:21.579128092 +0000 UTC m=+18.169894300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret") pod "global-pull-secret-syncer-kfrcd" (UID: "12e4cd8c-678c-4c7d-8d55-0354d18dea85") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:13.680163 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:13.680126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:13.680367 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.680272 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:01:13.680367 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.680291 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:01:13.680367 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.680303 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pgvtk for pod openshift-network-diagnostics/network-check-target-6crq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:13.680511 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.680375 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk podName:44f5f16e-bbdf-491f-ba75-95333911c320 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:21.680353326 +0000 UTC m=+18.271119536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgvtk" (UniqueName: "kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk") pod "network-check-target-6crq2" (UID: "44f5f16e-bbdf-491f-ba75-95333911c320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:13.930583 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:13.930502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:13.930744 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:13.930594 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:14.930113 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:14.930073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:14.930609 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:14.930207 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:14.930609 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:14.930268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:14.930609 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:14.930432 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:15.932425 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:15.932392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:15.932904 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:15.932533 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:16.930711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:16.930207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:16.930711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:16.930225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:16.930711 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:16.930367 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:16.930711 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:16.930506 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:17.930057 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:17.930020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:17.930699 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:17.930158 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:18.929620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:18.929579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:18.929620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:18.929620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:18.929876 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:18.929724 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:18.929936 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:18.929889 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:19.930306 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:19.930268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:19.930779 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:19.930398 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:20.929821 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:20.929787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:20.930068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:20.929787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:20.930068 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:20.929927 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:20.930068 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:20.930004 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:21.643017 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:21.642978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:21.643454 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:21.643060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:21.643454 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.643146 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:21.643454 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.643154 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:21.643454 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.643206 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs podName:6a2240bc-8273-4344-ba35-68c3220ed1e5 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:37.643191891 +0000 UTC m=+34.233958096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs") pod "network-metrics-daemon-4dpqt" (UID: "6a2240bc-8273-4344-ba35-68c3220ed1e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:21.643454 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.643220 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret podName:12e4cd8c-678c-4c7d-8d55-0354d18dea85 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:37.643213914 +0000 UTC m=+34.233980105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret") pod "global-pull-secret-syncer-kfrcd" (UID: "12e4cd8c-678c-4c7d-8d55-0354d18dea85") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:21.744411 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:21.744369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:21.744591 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.744571 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:01:21.744646 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.744595 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:01:21.744646 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.744609 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pgvtk for pod openshift-network-diagnostics/network-check-target-6crq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:21.744727 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.744683 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk podName:44f5f16e-bbdf-491f-ba75-95333911c320 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:37.744662539 +0000 UTC m=+34.335428755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgvtk" (UniqueName: "kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk") pod "network-check-target-6crq2" (UID: "44f5f16e-bbdf-491f-ba75-95333911c320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:21.930279 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:21.930185 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:21.930462 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:21.930341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:22.930491 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:22.930455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:22.930902 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:22.930464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:22.930902 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:22.930604 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:22.930902 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:22.930651 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:23.930182 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:23.930147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:23.930382 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:23.930282 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:24.930519 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:24.930479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:24.930951 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:24.930492 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:24.930951 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:24.930627 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:24.930951 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:24.930695 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:25.930101 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:25.930058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:25.930403 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:25.930188 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:26.930477 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:26.930162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:26.931037 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:26.930162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:26.931037 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:26.930571 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:26.931037 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:26.930617 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:27.025128 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.025098 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9d2fa19-63ea-4696-9bb1-8244db2320e3" containerID="baa6f490157d3a09876940657b81fcfc1982a3f2cc8c747d450e38a012e887be" exitCode=0 Jul 07 19:01:27.025269 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.025184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerDied","Data":"baa6f490157d3a09876940657b81fcfc1982a3f2cc8c747d450e38a012e887be"} Jul 07 19:01:27.027022 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.026994 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" event={"ID":"e642e1cbd65e5f8a7222e5b0d1dca6bc","Type":"ContainerStarted","Data":"54172e5401fb6812b5a69f7232a51060dda152b3ea31100ff56f00d725e9a769"} Jul 07 19:01:27.028389 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.028363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7r7rc" event={"ID":"78c4fb26-b80c-4c87-9fab-cefe20c5a71c","Type":"ContainerStarted","Data":"fb9cc0e5aba123161b7308a926e9359473834aabb4db5d51290d4d08e88878c3"} Jul 07 19:01:27.029729 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.029711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gxnw" event={"ID":"9664d9cc-a34b-477c-97ad-047b1dce7293","Type":"ContainerStarted","Data":"c22db4a7844219f3debdefda97521717708fc489e32ebbb6a37c6c91de335d31"} Jul 07 19:01:27.031169 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.031145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" event={"ID":"1870895f-6ad1-4d10-a6b2-979d70523e86","Type":"ContainerStarted","Data":"0947ecf231120832f4f09ecd3e60df0ee10c4b685b83e8dd09759c36823fd8f0"} Jul 07 19:01:27.032513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.032495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" event={"ID":"565d89ca2fa2c4a95da46d78283f2b5a","Type":"ContainerStarted","Data":"da1f1ebdae8677422ba728fa868f8780a8a37be457c667e709962da5fa2e3b4f"} Jul 07 19:01:27.033845 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.033812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cqddl" event={"ID":"f33b645d-59c6-4a38-a6a3-d181c594285c","Type":"ContainerStarted","Data":"f095e084a6f27f16304a0a690f8a6ffefbcb04ab6ec00315e9ad3b00a4119d83"} Jul 07 19:01:27.036002 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.035982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"9180242d2509867f1188c47de83b9ce2ba2a18be6cfd23c010a61ffef3170aa9"} Jul 07 19:01:27.036092 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.036045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"9d9f80835241cf87e9a4abda3727d69c33560420445d44613dfdb2b7673dd104"} Jul 07 19:01:27.036092 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.036077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"0127cd695321b3981235ebe323c206f3c256b874aea98fedae6c7d37188a4aad"} Jul 07 19:01:27.036201 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.036114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"c833996bb5c8d539164487c823aa6300f9e07c27d55c009bd672794ff9c6e8ce"} Jul 07 19:01:27.037231 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.037214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b466p" event={"ID":"5f4cddcb-a671-46a3-8f12-db355249401f","Type":"ContainerStarted","Data":"e38ddc704b1c31773c8a2c79447163be6304defcbe8613c43472d9b3652a9cd4"} Jul 07 19:01:27.038512 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.038493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" event={"ID":"30513e46-e3ed-4b06-99ad-83b743505b3a","Type":"ContainerStarted","Data":"8599a68a199301271fe1c5b106191b853c1a030cf4a1a56678bf66f0ada0be2c"} Jul 07 19:01:27.066384 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.066339 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7r7rc" podStartSLOduration=2.913848283 podStartE2EDuration="23.066305751s" totalImagesPullingTime="20.152457468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:27.066074163 +0000 UTC m=+23.656840377" watchObservedRunningTime="2026-07-07 19:01:27.066305751 +0000 UTC m=+23.657071963" Jul 07 19:01:27.081769 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.081729 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-243.ec2.internal" podStartSLOduration=22.081716257 podStartE2EDuration="22.081716257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:27.081471908 +0000 UTC m=+23.672238122" watchObservedRunningTime="2026-07-07 19:01:27.081716257 +0000 UTC m=+23.672482469" Jul 07 19:01:27.123465 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.123419 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b466p" podStartSLOduration=2.896814533 podStartE2EDuration="23.12340288s" totalImagesPullingTime="20.226588347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:27.123091792 +0000 UTC m=+23.713858005" watchObservedRunningTime="2026-07-07 19:01:27.12340288 +0000 UTC m=+23.714169093" Jul 07 19:01:27.123636 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.123619 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rl7sk" podStartSLOduration=2.948378015 podStartE2EDuration="23.123613457s" totalImagesPullingTime="20.175235442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:27.102960866 +0000 UTC m=+23.693727168" watchObservedRunningTime="2026-07-07 19:01:27.123613457 +0000 UTC m=+23.714379670" Jul 07 19:01:27.151592 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.151365 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cqddl" podStartSLOduration=3.030829338 podStartE2EDuration="23.151347767s" totalImagesPullingTime="20.120518429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:27.150752918 +0000 UTC m=+23.741519134" watchObservedRunningTime="2026-07-07 19:01:27.151347767 +0000 UTC m=+23.742113978" Jul 07 19:01:27.191767 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.191725 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-243.ec2.internal" podStartSLOduration=22.191710932 podStartE2EDuration="22.191710932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:27.171896522 +0000 UTC m=+23.762662735" watchObservedRunningTime="2026-07-07 19:01:27.191710932 +0000 UTC m=+23.782477146" Jul 07 19:01:27.929890 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:27.929862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:27.930245 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:27.929957 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:28.043513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.043475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"b5e252009fe9d19b2121dc1745b53c4b122024648027d423240dcaa9e24c93f1"} Jul 07 19:01:28.044035 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.043547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"f19195eded5a6374328414ff258cec1444e97104d3b569c9c7062df6018c53f5"} Jul 07 19:01:28.044714 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.044688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8k4c9" event={"ID":"0b123535-b37c-48d9-96a7-f9a841380740","Type":"ContainerStarted","Data":"de3ac4e781cc348ffc1984717620c755d1a83b03a2196713a331f566ab4f5078"} Jul 07 19:01:28.069732 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.069689 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8k4c9" podStartSLOduration=3.944597709 podStartE2EDuration="24.069674804s" totalImagesPullingTime="20.125077095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:28.069513442 +0000 UTC m=+24.660279655" watchObservedRunningTime="2026-07-07 19:01:28.069674804 +0000 UTC m=+24.660441017" Jul 07 19:01:28.069868 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.069856 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4gxnw" podStartSLOduration=3.8833667160000003 podStartE2EDuration="24.069851002s" totalImagesPullingTime="20.186484286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:27.191599393 +0000 UTC m=+23.782365608" watchObservedRunningTime="2026-07-07 19:01:28.069851002 +0000 UTC m=+24.660617264" Jul 07 19:01:28.253785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.253744 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 19:01:28.866413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.866281 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T19:01:28.253766219Z","UUID":"2a35e37d-ab83-4fe1-8238-3360ce1e0aa4","Handler":null,"Name":"","Endpoint":""} Jul 07 19:01:28.868023 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.867995 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 19:01:28.868149 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.868040 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 19:01:28.929703 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.929677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:28.929848 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:28.929775 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:28.929848 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:28.929830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:28.929936 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:28.929919 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:29.049939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:29.049901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" event={"ID":"30513e46-e3ed-4b06-99ad-83b743505b3a","Type":"ContainerStarted","Data":"9d64ac6b40699329687e149365ab17ef4c0d01204bc712dfe2f338c5a8ca3f21"} Jul 07 19:01:29.098340 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:29.098284 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:29.098922 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:29.098902 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:29.930097 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:29.929848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:29.930274 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:29.930116 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:30.056227 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:30.056186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"d60bf8138c960f8b6eaf5d9a88b937d27a98a0aabf2d2c8289050528324d68da"} Jul 07 19:01:30.058227 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:30.058199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" event={"ID":"30513e46-e3ed-4b06-99ad-83b743505b3a","Type":"ContainerStarted","Data":"f2a0c5938d7c12c9600de293a1bce9c10e80c23e6a4c5d53d508922174a814a0"} Jul 07 19:01:30.058401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:30.058383 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:30.058924 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:30.058908 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cqddl" Jul 07 19:01:30.151594 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:30.151535 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dsl" podStartSLOduration=3.060093154 podStartE2EDuration="26.15151274s" totalImagesPullingTime="23.091419586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:30.117486359 +0000 UTC m=+26.708252571" watchObservedRunningTime="2026-07-07 19:01:30.15151274 +0000 UTC m=+26.742278954" Jul 07 19:01:30.929839 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:30.929806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:30.930006 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:30.929847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:30.930006 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:30.929927 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:30.930095 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:30.930046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:31.929804 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:31.929592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:31.930600 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:31.929897 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:32.068125 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.068091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" event={"ID":"8ba9fcda-92d0-4772-893a-2d8c17444d56","Type":"ContainerStarted","Data":"5babe8a8e0515aeab0eefeecbba3bfb72e506bdbe0556ba5a023b743c5e2a42e"} Jul 07 19:01:32.068362 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.068342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:32.068495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.068414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:32.068495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.068460 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:32.085594 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.085564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:32.085749 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.085721 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:01:32.102565 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.102518 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" podStartSLOduration=7.865460002 podStartE2EDuration="28.102503778s" totalImagesPullingTime="20.237043776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:32.102467163 +0000 UTC m=+28.693233394" watchObservedRunningTime="2026-07-07 19:01:32.102503778 +0000 UTC m=+28.693269988" Jul 07 19:01:32.929605 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.929575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:32.929796 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:32.929695 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:32.929796 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:32.929764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:32.930126 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:32.929897 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:33.581386 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:33.581355 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6crq2"] Jul 07 19:01:33.581547 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:33.581484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:33.581606 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:33.581583 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:33.584080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:33.584049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfrcd"] Jul 07 19:01:33.584224 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:33.584144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:33.584284 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:33.584231 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:33.584765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:33.584697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4dpqt"] Jul 07 19:01:33.584888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:33.584809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:33.584960 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:33.584909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:34.930194 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:34.930153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:34.930576 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:34.930267 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:34.930576 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:34.930336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:34.930576 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:34.930432 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:35.076260 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:35.076221 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9d2fa19-63ea-4696-9bb1-8244db2320e3" containerID="c80ea49ddd1fdad379cca81ddc322c8df65af228a5d0dc65a3d94c9c587ea974" exitCode=0 Jul 07 19:01:35.076447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:35.076267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerDied","Data":"c80ea49ddd1fdad379cca81ddc322c8df65af228a5d0dc65a3d94c9c587ea974"} Jul 07 19:01:35.930079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:35.930052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:35.930186 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:35.930159 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:36.080701 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:36.080672 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9d2fa19-63ea-4696-9bb1-8244db2320e3" containerID="55b656b12fa96928b0d0aada26219534eee4bc15e1305b0b18fd0644c547c695" exitCode=0 Jul 07 19:01:36.081082 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:36.080725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerDied","Data":"55b656b12fa96928b0d0aada26219534eee4bc15e1305b0b18fd0644c547c695"} Jul 07 19:01:36.929727 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:36.929483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:36.929871 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:36.929483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:36.929871 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:36.929784 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:36.929968 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:36.929894 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:37.663849 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:37.663816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:37.663849 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:37.663857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:37.664351 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.663950 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:37.664351 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.663959 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:37.664351 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.664002 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret podName:12e4cd8c-678c-4c7d-8d55-0354d18dea85 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:09.66398835 +0000 UTC m=+66.254754542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret") pod "global-pull-secret-syncer-kfrcd" (UID: "12e4cd8c-678c-4c7d-8d55-0354d18dea85") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:01:37.664351 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.664016 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs podName:6a2240bc-8273-4344-ba35-68c3220ed1e5 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:09.664009482 +0000 UTC m=+66.254775673 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs") pod "network-metrics-daemon-4dpqt" (UID: "6a2240bc-8273-4344-ba35-68c3220ed1e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:01:37.764793 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:37.764758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:37.764959 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.764915 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:01:37.764959 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.764936 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:01:37.764959 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.764945 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pgvtk for pod openshift-network-diagnostics/network-check-target-6crq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:37.765050 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.765004 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk podName:44f5f16e-bbdf-491f-ba75-95333911c320 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:09.764986014 +0000 UTC m=+66.355752207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgvtk" (UniqueName: "kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk") pod "network-check-target-6crq2" (UID: "44f5f16e-bbdf-491f-ba75-95333911c320") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:01:37.930302 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:37.930212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:37.930458 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:37.930342 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:38.087710 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:38.087679 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9d2fa19-63ea-4696-9bb1-8244db2320e3" containerID="7567ef44dfa949b20121e70994272d01485f5bedecdd8d2224318e98f46e3e09" exitCode=0 Jul 07 19:01:38.087864 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:38.087735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerDied","Data":"7567ef44dfa949b20121e70994272d01485f5bedecdd8d2224318e98f46e3e09"} Jul 07 19:01:38.929859 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:38.929824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:38.930374 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:38.929943 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfrcd" podUID="12e4cd8c-678c-4c7d-8d55-0354d18dea85" Jul 07 19:01:38.930374 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:38.929976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:38.930374 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:38.930050 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dpqt" podUID="6a2240bc-8273-4344-ba35-68c3220ed1e5" Jul 07 19:01:39.932917 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:39.932870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:39.933839 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:39.932991 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6crq2" podUID="44f5f16e-bbdf-491f-ba75-95333911c320" Jul 07 19:01:40.222626 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.222550 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-243.ec2.internal" event="NodeReady" Jul 07 19:01:40.222777 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.222705 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 19:01:40.290485 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.290457 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xhjj4"] Jul 07 19:01:40.341951 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.341921 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm"] Jul 07 19:01:40.342097 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.342053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.349910 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.349882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.350098 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.349980 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 19:01:40.350998 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.350395 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 19:01:40.350998 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.350433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vkp49\"" Jul 07 19:01:40.350998 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.350474 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.356941 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.356919 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9"] Jul 07 19:01:40.357047 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.357032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" Jul 07 19:01:40.362781 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.362760 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bd6bs\"" Jul 07 19:01:40.367697 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.367677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.368437 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.367901 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.371653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.371632 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 19:01:40.377353 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.377191 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d97965b6d-mtjx2"] Jul 07 19:01:40.377602 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.377375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.385903 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.385878 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.386213 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.386195 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.391004 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.390981 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 19:01:40.392620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.392603 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4g6vf\"" Jul 07 19:01:40.392824 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.392810 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 19:01:40.395026 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.395003 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77"] Jul 07 19:01:40.396882 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.396854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.402774 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.402756 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 19:01:40.402887 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.402837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 19:01:40.403255 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.403234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 19:01:40.403441 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.403338 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wn7mq\"" Jul 07 19:01:40.409106 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.409088 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-548dbc9c89-jx4rq"] Jul 07 19:01:40.409227 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.409210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.419658 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.418309 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 19:01:40.419658 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.418540 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.419658 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.418671 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 19:01:40.419658 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.418790 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mjngb\"" Jul 07 19:01:40.419658 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.419088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.420307 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.420287 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 19:01:40.431297 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.431264 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv"] Jul 07 19:01:40.431827 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.431809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.436037 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.436020 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 19:01:40.436037 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.436032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 19:01:40.436199 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.436152 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 19:01:40.436254 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.436199 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 19:01:40.436519 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.436504 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.436627 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.436520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vzn9z\"" Jul 07 19:01:40.436627 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.436564 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.451293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.451277 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7wdsf"] Jul 07 19:01:40.451450 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.451430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.459101 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.459073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w6zmd\"" Jul 07 19:01:40.459336 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.459297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 19:01:40.459446 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.459424 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.459509 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.459427 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.459509 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.459479 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 19:01:40.469414 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.469390 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58"] Jul 07 19:01:40.469525 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.469510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.472997 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.472947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.473082 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.472995 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.473150 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.473136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 19:01:40.473229 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.473208 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 19:01:40.473418 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.473402 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9wq7l\"" Jul 07 19:01:40.481941 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.481923 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 19:01:40.483404 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483385 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm"] Jul 07 19:01:40.483495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9"] Jul 07 19:01:40.483495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58"] Jul 07 19:01:40.483495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483461 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xhjj4"] Jul 07 19:01:40.483495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483479 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d97965b6d-mtjx2"] Jul 07 19:01:40.483495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483496 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7wdsf"] Jul 07 19:01:40.483736 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:40.483736 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv"] Jul 07 19:01:40.483736 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.483630 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2j5c6"] Jul 07 19:01:40.484745 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a9b20b3-1e8f-460c-b497-4e32040140de-trusted-ca\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.484828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50456258-b056-424a-a6af-a9d2f6e8078d-config\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.484828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrhbl\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-kube-api-access-lrhbl\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.484939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-bound-sa-token\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.484939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a9b20b3-1e8f-460c-b497-4e32040140de-serving-cert\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.484939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b6794-7c42-4da6-ab04-a314ae318bed-ca-trust-extracted\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.484939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-trusted-ca\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.485080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9fl6\" (UniqueName: \"kubernetes.io/projected/ccb7fdf2-25fc-4996-b5d2-c532576b4627-kube-api-access-n9fl6\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.485080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.484973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a9b20b3-1e8f-460c-b497-4e32040140de-config\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.485080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-image-registry-private-configuration\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.485080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.485080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndnp8\" (UniqueName: \"kubernetes.io/projected/50456258-b056-424a-a6af-a9d2f6e8078d-kube-api-access-ndnp8\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.485293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ccb7fdf2-25fc-4996-b5d2-c532576b4627-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.485293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.485293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-installation-pull-secrets\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.485293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-registry-certificates\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.485293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fszc\" (UniqueName: \"kubernetes.io/projected/7a9b20b3-1e8f-460c-b497-4e32040140de-kube-api-access-9fszc\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.485502 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmr7\" (UniqueName: \"kubernetes.io/projected/115370df-63e1-4e7a-ba41-60b67a3e8e51-kube-api-access-slmr7\") pod \"volume-data-source-validator-5d456fdbcd-h8xxm\" (UID: \"115370df-63e1-4e7a-ba41-60b67a3e8e51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" Jul 07 19:01:40.485502 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.485349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50456258-b056-424a-a6af-a9d2f6e8078d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.488606 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.488555 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 19:01:40.488606 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.488561 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.488606 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.488562 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.488837 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.488825 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8xdn8\"" Jul 07 19:01:40.505602 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.505580 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l"] Jul 07 19:01:40.505869 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.505850 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.510375 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.510359 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 19:01:40.510464 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.510448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 19:01:40.510549 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.510534 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hlmk\"" Jul 07 19:01:40.515754 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.515736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77"] Jul 07 19:01:40.515855 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.515771 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n699n"] Jul 07 19:01:40.515855 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.515849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" Jul 07 19:01:40.519644 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.519625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.519773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.519758 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rmqbs\"" Jul 07 19:01:40.520438 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.520418 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.536846 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.536824 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-548dbc9c89-jx4rq"] Jul 07 19:01:40.536972 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.536858 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l"] Jul 07 19:01:40.536972 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.536882 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n699n"] Jul 07 19:01:40.536972 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.536898 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2j5c6"] Jul 07 19:01:40.537124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.536979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.539494 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.539475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 19:01:40.543021 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.542988 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bv84w\"" Jul 07 19:01:40.543233 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.543210 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 19:01:40.543403 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.543381 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 19:01:40.586524 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fszc\" (UniqueName: \"kubernetes.io/projected/7a9b20b3-1e8f-460c-b497-4e32040140de-kube-api-access-9fszc\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.586659 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ccb7fdf2-25fc-4996-b5d2-c532576b4627-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.586726 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a173c70-0bda-4d73-99e6-06dc7e1cf302-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.586790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ad0e5b-0a7f-4355-890b-288d9781ff3a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.586790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:40.586953 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-config-volume\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.586953 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a9b20b3-1e8f-460c-b497-4e32040140de-trusted-ca\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.587028 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.586973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ad0e5b-0a7f-4355-890b-288d9781ff3a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.587028 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4crp\" (UniqueName: \"kubernetes.io/projected/62ad0e5b-0a7f-4355-890b-288d9781ff3a-kube-api-access-f4crp\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.587109 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a173c70-0bda-4d73-99e6-06dc7e1cf302-snapshots\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.587109 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.587109 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50456258-b056-424a-a6af-a9d2f6e8078d-config\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.587221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-bound-sa-token\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.587221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b6794-7c42-4da6-ab04-a314ae318bed-ca-trust-extracted\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.587221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a9b20b3-1e8f-460c-b497-4e32040140de-config\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.587221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a173c70-0bda-4d73-99e6-06dc7e1cf302-serving-cert\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.587395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-image-registry-private-configuration\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.587395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwzq7\" (UniqueName: \"kubernetes.io/projected/54cc496d-944f-4ce2-ae3c-612a273a6751-kube-api-access-nwzq7\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:40.587395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf8tf\" (UniqueName: \"kubernetes.io/projected/6a173c70-0bda-4d73-99e6-06dc7e1cf302-kube-api-access-gf8tf\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.587395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.587395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k2rv\" (UniqueName: \"kubernetes.io/projected/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-kube-api-access-4k2rv\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.587395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-installation-pull-secrets\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.587395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ccb7fdf2-25fc-4996-b5d2-c532576b4627-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmr7\" (UniqueName: \"kubernetes.io/projected/115370df-63e1-4e7a-ba41-60b67a3e8e51-kube-api-access-slmr7\") pod \"volume-data-source-validator-5d456fdbcd-h8xxm\" (UID: \"115370df-63e1-4e7a-ba41-60b67a3e8e51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-registry-certificates\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50456258-b056-424a-a6af-a9d2f6e8078d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a173c70-0bda-4d73-99e6-06dc7e1cf302-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.587552 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-tmp-dir\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.587640 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d72wf\" (UniqueName: \"kubernetes.io/projected/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-kube-api-access-d72wf\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.587930 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.587640 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls podName:ccb7fdf2-25fc-4996-b5d2-c532576b4627 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:41.087592144 +0000 UTC m=+37.678358337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gvrw9" (UID: "ccb7fdf2-25fc-4996-b5d2-c532576b4627") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:40.588004 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587983 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a9b20b3-1e8f-460c-b497-4e32040140de-trusted-ca\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.588004 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.587988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a9b20b3-1e8f-460c-b497-4e32040140de-config\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.588604 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzx2c\" (UniqueName: \"kubernetes.io/projected/fe203b88-75b9-4d3a-bb72-313801f3331e-kube-api-access-rzx2c\") pod \"network-check-source-989f8b8dc-vzc9l\" (UID: \"fe203b88-75b9-4d3a-bb72-313801f3331e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" Jul 07 19:01:40.588786 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrhbl\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-kube-api-access-lrhbl\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.588786 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-registry-certificates\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.588786 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-default-certificate\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.588786 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b6794-7c42-4da6-ab04-a314ae318bed-ca-trust-extracted\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50456258-b056-424a-a6af-a9d2f6e8078d-config\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a9b20b3-1e8f-460c-b497-4e32040140de-serving-cert\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-trusted-ca\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fl6\" (UniqueName: \"kubernetes.io/projected/ccb7fdf2-25fc-4996-b5d2-c532576b4627-kube-api-access-n9fl6\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a173c70-0bda-4d73-99e6-06dc7e1cf302-tmp\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.588983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.589007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndnp8\" (UniqueName: \"kubernetes.io/projected/50456258-b056-424a-a6af-a9d2f6e8078d-kube-api-access-ndnp8\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.589079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.589031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-stats-auth\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.589564 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.589391 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:01:40.589564 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.589407 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d97965b6d-mtjx2: secret "image-registry-tls" not found Jul 07 19:01:40.589564 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.589461 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls podName:326b6794-7c42-4da6-ab04-a314ae318bed nodeName:}" failed. No retries permitted until 2026-07-07 19:01:41.089443827 +0000 UTC m=+37.680210017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls") pod "image-registry-d97965b6d-mtjx2" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed") : secret "image-registry-tls" not found Jul 07 19:01:40.590035 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.590012 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-trusted-ca\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.592743 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.592723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50456258-b056-424a-a6af-a9d2f6e8078d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.592949 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.592893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a9b20b3-1e8f-460c-b497-4e32040140de-serving-cert\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.593069 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.592965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-installation-pull-secrets\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.593069 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.592978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-image-registry-private-configuration\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.601755 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.601711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmr7\" (UniqueName: \"kubernetes.io/projected/115370df-63e1-4e7a-ba41-60b67a3e8e51-kube-api-access-slmr7\") pod \"volume-data-source-validator-5d456fdbcd-h8xxm\" (UID: \"115370df-63e1-4e7a-ba41-60b67a3e8e51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" Jul 07 19:01:40.606302 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.606272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-bound-sa-token\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.606829 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.606809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fszc\" (UniqueName: \"kubernetes.io/projected/7a9b20b3-1e8f-460c-b497-4e32040140de-kube-api-access-9fszc\") pod \"console-operator-68b757fb67-xhjj4\" (UID: \"7a9b20b3-1e8f-460c-b497-4e32040140de\") " pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.608050 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.608026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndnp8\" (UniqueName: \"kubernetes.io/projected/50456258-b056-424a-a6af-a9d2f6e8078d-kube-api-access-ndnp8\") pod \"service-ca-operator-5d46d9ffd4-9gf77\" (UID: \"50456258-b056-424a-a6af-a9d2f6e8078d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.609079 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.609059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrhbl\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-kube-api-access-lrhbl\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:40.610478 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.610455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9fl6\" (UniqueName: \"kubernetes.io/projected/ccb7fdf2-25fc-4996-b5d2-c532576b4627-kube-api-access-n9fl6\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:40.654022 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.654002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:01:40.666999 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.666980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" Jul 07 19:01:40.690001 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.689979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-default-certificate\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.690075 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.690075 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a173c70-0bda-4d73-99e6-06dc7e1cf302-tmp\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.690156 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-stats-auth\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.690156 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdxwp\" (UniqueName: \"kubernetes.io/projected/9e540e5a-bdce-4be1-bf26-d7bddd7c1629-kube-api-access-vdxwp\") pod \"ingress-canary-n699n\" (UID: \"9e540e5a-bdce-4be1-bf26-d7bddd7c1629\") " pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.690156 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a173c70-0bda-4d73-99e6-06dc7e1cf302-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.690295 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ad0e5b-0a7f-4355-890b-288d9781ff3a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.690295 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:40.690295 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-config-volume\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.690295 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.690220 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:01:40.690295 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ad0e5b-0a7f-4355-890b-288d9781ff3a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.690295 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4crp\" (UniqueName: \"kubernetes.io/projected/62ad0e5b-0a7f-4355-890b-288d9781ff3a-kube-api-access-f4crp\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.690295 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.690296 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls podName:de064a0b-8524-42b3-ad42-5e2c6dbe4dc1 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:41.190274134 +0000 UTC m=+37.781040327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls") pod "dns-default-2j5c6" (UID: "de064a0b-8524-42b3-ad42-5e2c6dbe4dc1") : secret "dns-default-metrics-tls" not found Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a173c70-0bda-4d73-99e6-06dc7e1cf302-snapshots\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e540e5a-bdce-4be1-bf26-d7bddd7c1629-cert\") pod \"ingress-canary-n699n\" (UID: \"9e540e5a-bdce-4be1-bf26-d7bddd7c1629\") " pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a173c70-0bda-4d73-99e6-06dc7e1cf302-tmp\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a173c70-0bda-4d73-99e6-06dc7e1cf302-serving-cert\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwzq7\" (UniqueName: \"kubernetes.io/projected/54cc496d-944f-4ce2-ae3c-612a273a6751-kube-api-access-nwzq7\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf8tf\" (UniqueName: \"kubernetes.io/projected/6a173c70-0bda-4d73-99e6-06dc7e1cf302-kube-api-access-gf8tf\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k2rv\" (UniqueName: \"kubernetes.io/projected/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-kube-api-access-4k2rv\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.690653 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.690606 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:41.19058794 +0000 UTC m=+37.781354155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : configmap references non-existent config key: service-ca.crt Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a173c70-0bda-4d73-99e6-06dc7e1cf302-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-tmp-dir\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690738 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a173c70-0bda-4d73-99e6-06dc7e1cf302-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.690755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d72wf\" (UniqueName: \"kubernetes.io/projected/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-kube-api-access-d72wf\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.690828 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.690890 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:41.190874573 +0000 UTC m=+37.781640768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : secret "router-metrics-certs-default" not found Jul 07 19:01:40.691068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.691052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-tmp-dir\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.691657 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.691415 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:01:40.691657 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:40.691464 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls podName:54cc496d-944f-4ce2-ae3c-612a273a6751 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:41.191448731 +0000 UTC m=+37.782214945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqz58" (UID: "54cc496d-944f-4ce2-ae3c-612a273a6751") : secret "samples-operator-tls" not found Jul 07 19:01:40.691779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.691721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a173c70-0bda-4d73-99e6-06dc7e1cf302-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.691779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.691742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-config-volume\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.692007 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.691984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ad0e5b-0a7f-4355-890b-288d9781ff3a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.692092 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.692071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzx2c\" (UniqueName: \"kubernetes.io/projected/fe203b88-75b9-4d3a-bb72-313801f3331e-kube-api-access-rzx2c\") pod \"network-check-source-989f8b8dc-vzc9l\" (UID: \"fe203b88-75b9-4d3a-bb72-313801f3331e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" Jul 07 19:01:40.692469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.692444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a173c70-0bda-4d73-99e6-06dc7e1cf302-snapshots\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.693050 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.693020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ad0e5b-0a7f-4355-890b-288d9781ff3a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.693198 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.693182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a173c70-0bda-4d73-99e6-06dc7e1cf302-serving-cert\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.693338 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.693300 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-default-certificate\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.694500 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.694478 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-stats-auth\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.703504 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.703483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwzq7\" (UniqueName: \"kubernetes.io/projected/54cc496d-944f-4ce2-ae3c-612a273a6751-kube-api-access-nwzq7\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:40.709058 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.709034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k2rv\" (UniqueName: \"kubernetes.io/projected/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-kube-api-access-4k2rv\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:40.709533 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.709508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4crp\" (UniqueName: \"kubernetes.io/projected/62ad0e5b-0a7f-4355-890b-288d9781ff3a-kube-api-access-f4crp\") pod \"kube-storage-version-migrator-operator-846bf668f7-7ffvv\" (UID: \"62ad0e5b-0a7f-4355-890b-288d9781ff3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.709876 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.709856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d72wf\" (UniqueName: \"kubernetes.io/projected/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-kube-api-access-d72wf\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:40.709962 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.709948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzx2c\" (UniqueName: \"kubernetes.io/projected/fe203b88-75b9-4d3a-bb72-313801f3331e-kube-api-access-rzx2c\") pod \"network-check-source-989f8b8dc-vzc9l\" (UID: \"fe203b88-75b9-4d3a-bb72-313801f3331e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" Jul 07 19:01:40.710645 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.710624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf8tf\" (UniqueName: \"kubernetes.io/projected/6a173c70-0bda-4d73-99e6-06dc7e1cf302-kube-api-access-gf8tf\") pod \"insights-operator-5c847dcfc4-7wdsf\" (UID: \"6a173c70-0bda-4d73-99e6-06dc7e1cf302\") " pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.722371 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.722349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" Jul 07 19:01:40.763102 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.762439 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" Jul 07 19:01:40.778965 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.778937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" Jul 07 19:01:40.795284 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.795066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdxwp\" (UniqueName: \"kubernetes.io/projected/9e540e5a-bdce-4be1-bf26-d7bddd7c1629-kube-api-access-vdxwp\") pod \"ingress-canary-n699n\" (UID: \"9e540e5a-bdce-4be1-bf26-d7bddd7c1629\") " pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.795531 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.795373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e540e5a-bdce-4be1-bf26-d7bddd7c1629-cert\") pod \"ingress-canary-n699n\" (UID: \"9e540e5a-bdce-4be1-bf26-d7bddd7c1629\") " pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.800598 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.800511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e540e5a-bdce-4be1-bf26-d7bddd7c1629-cert\") pod \"ingress-canary-n699n\" (UID: \"9e540e5a-bdce-4be1-bf26-d7bddd7c1629\") " pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.816959 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.816931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdxwp\" (UniqueName: \"kubernetes.io/projected/9e540e5a-bdce-4be1-bf26-d7bddd7c1629-kube-api-access-vdxwp\") pod \"ingress-canary-n699n\" (UID: \"9e540e5a-bdce-4be1-bf26-d7bddd7c1629\") " pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.825724 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.825703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" Jul 07 19:01:40.850444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.847478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n699n" Jul 07 19:01:40.912638 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.910982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xhjj4"] Jul 07 19:01:40.913410 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.912976 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm"] Jul 07 19:01:40.932790 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:40.927641 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9b20b3_1e8f_460c_b497_4e32040140de.slice/crio-e9f1716e8362fcb6e6a938cc1b9e17e19b01a9bfb7c47f4857e9fe8efebe4bdf WatchSource:0}: Error finding container e9f1716e8362fcb6e6a938cc1b9e17e19b01a9bfb7c47f4857e9fe8efebe4bdf: Status 404 returned error can't find the container with id e9f1716e8362fcb6e6a938cc1b9e17e19b01a9bfb7c47f4857e9fe8efebe4bdf Jul 07 19:01:40.932790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.931061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:01:40.932790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.931497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:01:40.948059 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.937051 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 19:01:40.948059 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.937794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 19:01:40.948059 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.946803 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g87lc\"" Jul 07 19:01:40.954696 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:40.954636 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77"] Jul 07 19:01:40.958700 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:01:40.957026 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50456258_b056_424a_a6af_a9d2f6e8078d.slice/crio-009667b27e2aaf133964d895cc560a90176ad9781b0a0bdc6e93faa13f4f1b44 WatchSource:0}: Error finding container 009667b27e2aaf133964d895cc560a90176ad9781b0a0bdc6e93faa13f4f1b44: Status 404 returned error can't find the container with id 009667b27e2aaf133964d895cc560a90176ad9781b0a0bdc6e93faa13f4f1b44 Jul 07 19:01:41.047830 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.047802 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv"] Jul 07 19:01:41.054507 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.054139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7wdsf"] Jul 07 19:01:41.072894 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.072798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l"] Jul 07 19:01:41.079782 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.079753 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n699n"] Jul 07 19:01:41.097314 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.097281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" event={"ID":"50456258-b056-424a-a6af-a9d2f6e8078d","Type":"ContainerStarted","Data":"009667b27e2aaf133964d895cc560a90176ad9781b0a0bdc6e93faa13f4f1b44"} Jul 07 19:01:41.098572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.098544 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" event={"ID":"6a173c70-0bda-4d73-99e6-06dc7e1cf302","Type":"ContainerStarted","Data":"949ede9267b3d19416370cb3e08dab973c712e1a8a91267635fca795e90e164a"} Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.099773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" event={"ID":"115370df-63e1-4e7a-ba41-60b67a3e8e51","Type":"ContainerStarted","Data":"1eb47e2aea3179da1e355b5ac0167d43f59ad9c530df276035ea36ec3a6d4dd8"} Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.099968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.100058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.100099 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.100113 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d97965b6d-mtjx2: secret "image-registry-tls" not found Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.100155 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls podName:326b6794-7c42-4da6-ab04-a314ae318bed nodeName:}" failed. No retries permitted until 2026-07-07 19:01:42.100139802 +0000 UTC m=+38.690906016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls") pod "image-registry-d97965b6d-mtjx2" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed") : secret "image-registry-tls" not found Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.100189 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:41.100268 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.100246 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls podName:ccb7fdf2-25fc-4996-b5d2-c532576b4627 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:42.100229917 +0000 UTC m=+38.690996136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gvrw9" (UID: "ccb7fdf2-25fc-4996-b5d2-c532576b4627") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:41.100976 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.100957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n699n" event={"ID":"9e540e5a-bdce-4be1-bf26-d7bddd7c1629","Type":"ContainerStarted","Data":"eecc0be0ecef825210c062ffb9bdea9f8b3b3bdd4f438c1971437941dc3ece3f"} Jul 07 19:01:41.102121 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.102088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" event={"ID":"fe203b88-75b9-4d3a-bb72-313801f3331e","Type":"ContainerStarted","Data":"060530896fb777ea1372bd0d82914bd9f06e3cb099474754828a82a773d78b6d"} Jul 07 19:01:41.103412 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.103392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" event={"ID":"62ad0e5b-0a7f-4355-890b-288d9781ff3a","Type":"ContainerStarted","Data":"cff4f550c959e67743828bbe283db4a2c579503650d032a6c615cb39ea47b0b1"} Jul 07 19:01:41.104491 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.104467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" event={"ID":"7a9b20b3-1e8f-460c-b497-4e32040140de","Type":"ContainerStarted","Data":"e9f1716e8362fcb6e6a938cc1b9e17e19b01a9bfb7c47f4857e9fe8efebe4bdf"} Jul 07 19:01:41.200753 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.200713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:41.200922 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.200782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:41.200922 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.200835 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:01:41.200922 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.200902 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:01:41.200922 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.200904 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:01:41.201109 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.200908 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:42.200888278 +0000 UTC m=+38.791654472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : secret "router-metrics-certs-default" not found Jul 07 19:01:41.201109 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.200839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:41.201109 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.200964 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls podName:54cc496d-944f-4ce2-ae3c-612a273a6751 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:42.200946852 +0000 UTC m=+38.791713057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqz58" (UID: "54cc496d-944f-4ce2-ae3c-612a273a6751") : secret "samples-operator-tls" not found Jul 07 19:01:41.201109 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.200985 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls podName:de064a0b-8524-42b3-ad42-5e2c6dbe4dc1 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:42.200974814 +0000 UTC m=+38.791741007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls") pod "dns-default-2j5c6" (UID: "de064a0b-8524-42b3-ad42-5e2c6dbe4dc1") : secret "dns-default-metrics-tls" not found Jul 07 19:01:41.201109 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.201019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:41.201346 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:41.201113 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:42.2011062 +0000 UTC m=+38.791872392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : configmap references non-existent config key: service-ca.crt Jul 07 19:01:41.933106 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.932457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:01:41.936561 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:41.936504 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-546ff\"" Jul 07 19:01:42.109824 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:42.108954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:42.109824 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:42.109094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:42.109824 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.109245 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:01:42.109824 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.109259 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d97965b6d-mtjx2: secret "image-registry-tls" not found Jul 07 19:01:42.109824 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.109317 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls podName:326b6794-7c42-4da6-ab04-a314ae318bed nodeName:}" failed. No retries permitted until 2026-07-07 19:01:44.109295265 +0000 UTC m=+40.700061475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls") pod "image-registry-d97965b6d-mtjx2" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed") : secret "image-registry-tls" not found Jul 07 19:01:42.109824 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.109743 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:42.109824 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.109797 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls podName:ccb7fdf2-25fc-4996-b5d2-c532576b4627 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:44.109778725 +0000 UTC m=+40.700544921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gvrw9" (UID: "ccb7fdf2-25fc-4996-b5d2-c532576b4627") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:42.209706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:42.209801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:42.209871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:42.209914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.210087 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:44.210066654 +0000 UTC m=+40.800832849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : configmap references non-existent config key: service-ca.crt Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.210200 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.210241 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:44.210226117 +0000 UTC m=+40.800992311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : secret "router-metrics-certs-default" not found Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.210305 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.210375 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls podName:de064a0b-8524-42b3-ad42-5e2c6dbe4dc1 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:44.210362646 +0000 UTC m=+40.801128837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls") pod "dns-default-2j5c6" (UID: "de064a0b-8524-42b3-ad42-5e2c6dbe4dc1") : secret "dns-default-metrics-tls" not found Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.210441 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:01:42.211723 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:42.210476 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls podName:54cc496d-944f-4ce2-ae3c-612a273a6751 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:44.210465221 +0000 UTC m=+40.801231413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqz58" (UID: "54cc496d-944f-4ce2-ae3c-612a273a6751") : secret "samples-operator-tls" not found Jul 07 19:01:44.136013 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:44.135746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:44.136493 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:44.136159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:44.139388 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.139348 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:44.139528 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.139442 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:01:44.139528 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.139465 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d97965b6d-mtjx2: secret "image-registry-tls" not found Jul 07 19:01:44.139528 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.139481 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls podName:ccb7fdf2-25fc-4996-b5d2-c532576b4627 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:48.13945781 +0000 UTC m=+44.730224014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gvrw9" (UID: "ccb7fdf2-25fc-4996-b5d2-c532576b4627") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:44.139657 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.139530 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls podName:326b6794-7c42-4da6-ab04-a314ae318bed nodeName:}" failed. No retries permitted until 2026-07-07 19:01:48.139503079 +0000 UTC m=+44.730269274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls") pod "image-registry-d97965b6d-mtjx2" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed") : secret "image-registry-tls" not found Jul 07 19:01:44.240274 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:44.240240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:44.240476 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:44.240346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:44.240476 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:44.240415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:44.240589 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:44.240477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:44.240645 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.240598 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:01:44.240699 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.240648 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls podName:54cc496d-944f-4ce2-ae3c-612a273a6751 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:48.240635172 +0000 UTC m=+44.831401376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqz58" (UID: "54cc496d-944f-4ce2-ae3c-612a273a6751") : secret "samples-operator-tls" not found Jul 07 19:01:44.241014 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.240988 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:48.240976072 +0000 UTC m=+44.831742277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : configmap references non-existent config key: service-ca.crt Jul 07 19:01:44.241131 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.241052 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:01:44.241131 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.241082 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:48.241074117 +0000 UTC m=+44.831840322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : secret "router-metrics-certs-default" not found Jul 07 19:01:44.241131 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.241117 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:01:44.241131 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:44.241135 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls podName:de064a0b-8524-42b3-ad42-5e2c6dbe4dc1 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:48.241129486 +0000 UTC m=+44.831895677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls") pod "dns-default-2j5c6" (UID: "de064a0b-8524-42b3-ad42-5e2c6dbe4dc1") : secret "dns-default-metrics-tls" not found Jul 07 19:01:45.156411 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:45.156373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:45.238144 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:45.238108 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:46.009011 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:46.008918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:46.126749 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:46.126715 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:46.540653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:46.540623 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:48.172701 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:48.172665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:48.173135 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.172799 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:48.173135 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:48.172803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:48.173135 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.172867 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls podName:ccb7fdf2-25fc-4996-b5d2-c532576b4627 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.172846978 +0000 UTC m=+52.763613177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gvrw9" (UID: "ccb7fdf2-25fc-4996-b5d2-c532576b4627") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:48.173135 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.172889 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:01:48.173135 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.172904 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d97965b6d-mtjx2: secret "image-registry-tls" not found Jul 07 19:01:48.173135 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.172957 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls podName:326b6794-7c42-4da6-ab04-a314ae318bed nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.172938875 +0000 UTC m=+52.763705077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls") pod "image-registry-d97965b6d-mtjx2" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed") : secret "image-registry-tls" not found Jul 07 19:01:48.273401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:48.273366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:48.273604 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:48.273444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:48.273604 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:48.273484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:48.273604 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.273547 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:01:48.273604 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:48.273573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:48.273604 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.273581 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:01:48.273862 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.273623 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls podName:de064a0b-8524-42b3-ad42-5e2c6dbe4dc1 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.27360086 +0000 UTC m=+52.864367076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls") pod "dns-default-2j5c6" (UID: "de064a0b-8524-42b3-ad42-5e2c6dbe4dc1") : secret "dns-default-metrics-tls" not found Jul 07 19:01:48.273862 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.273642 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls podName:54cc496d-944f-4ce2-ae3c-612a273a6751 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.273634061 +0000 UTC m=+52.864400253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqz58" (UID: "54cc496d-944f-4ce2-ae3c-612a273a6751") : secret "samples-operator-tls" not found Jul 07 19:01:48.273862 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.273703 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:01:48.273862 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.273724 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.273706455 +0000 UTC m=+52.864472645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : configmap references non-existent config key: service-ca.crt Jul 07 19:01:48.273862 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:48.273748 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.273735159 +0000 UTC m=+52.864501356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : secret "router-metrics-certs-default" not found Jul 07 19:01:51.138051 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.136932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" event={"ID":"fe203b88-75b9-4d3a-bb72-313801f3331e","Type":"ContainerStarted","Data":"0dede223113527b40ff50e29caa9dd524add0db4a950e2b02a26f8e63127a6fb"} Jul 07 19:01:51.141819 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.140413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" event={"ID":"62ad0e5b-0a7f-4355-890b-288d9781ff3a","Type":"ContainerStarted","Data":"57589ff703e650a975a66e3c18c4ba6b7d252e85d9e973584884b0e78d83233d"} Jul 07 19:01:51.144174 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.144146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/0.log" Jul 07 19:01:51.144303 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.144191 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a9b20b3-1e8f-460c-b497-4e32040140de" containerID="519e45f9364025168104ead2e4686fbdecabc6da89f4b1e8e1af8ee69538603a" exitCode=255 Jul 07 19:01:51.144475 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.144444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" event={"ID":"7a9b20b3-1e8f-460c-b497-4e32040140de","Type":"ContainerDied","Data":"519e45f9364025168104ead2e4686fbdecabc6da89f4b1e8e1af8ee69538603a"} Jul 07 19:01:51.144564 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.144550 2576 scope.go:117] "RemoveContainer" containerID="519e45f9364025168104ead2e4686fbdecabc6da89f4b1e8e1af8ee69538603a" Jul 07 19:01:51.148011 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.147020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" event={"ID":"50456258-b056-424a-a6af-a9d2f6e8078d","Type":"ContainerStarted","Data":"aee7fc86e48ba6acab8af13a20e7f94aacb5eb3317b7f06b0bacd5d8dcdfe6bd"} Jul 07 19:01:51.150995 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.150971 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerStarted","Data":"e2da4449a6b178786f0e73be3b17f4a931edf4f12eed0120ddf86f6624b57137"} Jul 07 19:01:51.153504 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.153101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" event={"ID":"6a173c70-0bda-4d73-99e6-06dc7e1cf302","Type":"ContainerStarted","Data":"a986cc5d9759fdf8a5778b2779c3bf566d65cafc4f889de57c6ff418f282b89d"} Jul 07 19:01:51.154907 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.154878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" event={"ID":"115370df-63e1-4e7a-ba41-60b67a3e8e51","Type":"ContainerStarted","Data":"d49b5cb9776a42321ea0e5a1d4945641bea6246626620d162249521fd9d81ed6"} Jul 07 19:01:51.156182 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.156136 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vzc9l" podStartSLOduration=7.490914915 podStartE2EDuration="17.156119063s" totalImagesPullingTime="9.665204148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:51.154342738 +0000 UTC m=+47.745108951" watchObservedRunningTime="2026-07-07 19:01:51.156119063 +0000 UTC m=+47.746885277" Jul 07 19:01:51.157288 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.157249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n699n" event={"ID":"9e540e5a-bdce-4be1-bf26-d7bddd7c1629","Type":"ContainerStarted","Data":"35c5071d8197c6067a2e50a275096706f21b809bd859d1a7009a29c900e7b5aa"} Jul 07 19:01:51.172167 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.172046 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" podStartSLOduration=8.392616519 podStartE2EDuration="18.172028983s" totalImagesPullingTime="9.779412464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:51.17166026 +0000 UTC m=+47.762426475" watchObservedRunningTime="2026-07-07 19:01:51.172028983 +0000 UTC m=+47.762795194" Jul 07 19:01:51.192483 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.192436 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" podStartSLOduration=8.508827134 podStartE2EDuration="18.19241561s" totalImagesPullingTime="9.683588476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:51.191955741 +0000 UTC m=+47.782721958" watchObservedRunningTime="2026-07-07 19:01:51.19241561 +0000 UTC m=+47.783181826" Jul 07 19:01:51.271165 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.271112 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" podStartSLOduration=8.587108191 podStartE2EDuration="18.271094823s" totalImagesPullingTime="9.683986632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:51.270834421 +0000 UTC m=+47.861600629" watchObservedRunningTime="2026-07-07 19:01:51.271094823 +0000 UTC m=+47.861861035" Jul 07 19:01:51.292709 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.292400 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n699n" podStartSLOduration=1.637418497 podStartE2EDuration="11.2923778s" totalImagesPullingTime="9.654959303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:51.290592961 +0000 UTC m=+47.881359175" watchObservedRunningTime="2026-07-07 19:01:51.2923778 +0000 UTC m=+47.883144016" Jul 07 19:01:51.307574 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.307465 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h8xxm" podStartSLOduration=8.527420465 podStartE2EDuration="18.307444854s" totalImagesPullingTime="9.780024389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:51.305476891 +0000 UTC m=+47.896243105" watchObservedRunningTime="2026-07-07 19:01:51.307444854 +0000 UTC m=+47.898211062" Jul 07 19:01:51.395031 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:51.394061 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:52.165547 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.165509 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9d2fa19-63ea-4696-9bb1-8244db2320e3" containerID="e2da4449a6b178786f0e73be3b17f4a931edf4f12eed0120ddf86f6624b57137" exitCode=0 Jul 07 19:01:52.166005 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.165593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerDied","Data":"e2da4449a6b178786f0e73be3b17f4a931edf4f12eed0120ddf86f6624b57137"} Jul 07 19:01:52.167400 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.167378 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:01:52.167852 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.167835 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/0.log" Jul 07 19:01:52.167930 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.167874 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a9b20b3-1e8f-460c-b497-4e32040140de" containerID="4914f7870cadac6e831243320ddce01d1cb5b2fe826b02ad319811920e72c003" exitCode=255 Jul 07 19:01:52.167986 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.167955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" event={"ID":"7a9b20b3-1e8f-460c-b497-4e32040140de","Type":"ContainerDied","Data":"4914f7870cadac6e831243320ddce01d1cb5b2fe826b02ad319811920e72c003"} Jul 07 19:01:52.168039 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.167998 2576 scope.go:117] "RemoveContainer" containerID="519e45f9364025168104ead2e4686fbdecabc6da89f4b1e8e1af8ee69538603a" Jul 07 19:01:52.169090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.168374 2576 scope.go:117] "RemoveContainer" containerID="4914f7870cadac6e831243320ddce01d1cb5b2fe826b02ad319811920e72c003" Jul 07 19:01:52.169090 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:52.168533 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xhjj4_openshift-console-operator(7a9b20b3-1e8f-460c-b497-4e32040140de)\"" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" podUID="7a9b20b3-1e8f-460c-b497-4e32040140de" Jul 07 19:01:52.508455 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.508360 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:52.642521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.642440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:52.742174 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.742127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:52.878446 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.878415 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2wp2c"] Jul 07 19:01:52.893439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.893404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:52.894648 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.894609 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wp2c"] Jul 07 19:01:52.896111 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.896087 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 19:01:52.896604 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.896581 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 19:01:52.896808 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.896789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f7xpr\"" Jul 07 19:01:52.925964 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.925934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m84bg\" (UniqueName: \"kubernetes.io/projected/b3f9eed5-4256-4e43-846d-d84a76085137-kube-api-access-m84bg\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:52.926144 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.926003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3f9eed5-4256-4e43-846d-d84a76085137-data-volume\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:52.926144 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.926040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:52.926263 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.926146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:52.926263 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.926211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3f9eed5-4256-4e43-846d-d84a76085137-crio-socket\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:52.929634 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:52.929608 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:53.008204 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.008176 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:53.027399 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.027373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.027554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.027422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3f9eed5-4256-4e43-846d-d84a76085137-crio-socket\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.027554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.027484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m84bg\" (UniqueName: \"kubernetes.io/projected/b3f9eed5-4256-4e43-846d-d84a76085137-kube-api-access-m84bg\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.027554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.027503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3f9eed5-4256-4e43-846d-d84a76085137-data-volume\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.027554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.027521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.027742 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.027599 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:01:53.027742 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.027617 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:01:53.027742 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.027681 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:53.527663199 +0000 UTC m=+50.118429406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : configmap "kube-rbac-proxy" not found Jul 07 19:01:53.027742 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.027694 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:53.527687822 +0000 UTC m=+50.118454013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : secret "insights-runtime-extractor-tls" not found Jul 07 19:01:53.027742 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.027705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3f9eed5-4256-4e43-846d-d84a76085137-crio-socket\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.027937 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.027850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3f9eed5-4256-4e43-846d-d84a76085137-data-volume\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.038066 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.038039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m84bg\" (UniqueName: \"kubernetes.io/projected/b3f9eed5-4256-4e43-846d-d84a76085137-kube-api-access-m84bg\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.178993 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.178901 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9d2fa19-63ea-4696-9bb1-8244db2320e3" containerID="88176502fae8d25e6958031cb4af31f7abed4b3b6892291b445611e655b86af0" exitCode=0 Jul 07 19:01:53.179461 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.178985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerDied","Data":"88176502fae8d25e6958031cb4af31f7abed4b3b6892291b445611e655b86af0"} Jul 07 19:01:53.180582 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.180561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:01:53.180839 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.180826 2576 scope.go:117] "RemoveContainer" containerID="4914f7870cadac6e831243320ddce01d1cb5b2fe826b02ad319811920e72c003" Jul 07 19:01:53.180965 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.180950 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xhjj4_openshift-console-operator(7a9b20b3-1e8f-460c-b497-4e32040140de)\"" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" podUID="7a9b20b3-1e8f-460c-b497-4e32040140de" Jul 07 19:01:53.532352 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.532238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.532497 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.532380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:53.532497 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.532408 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:01:53.532497 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.532475 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:54.53245991 +0000 UTC m=+51.123226101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : secret "insights-runtime-extractor-tls" not found Jul 07 19:01:53.532497 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.532485 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:01:53.532631 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:53.532533 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:54.532516913 +0000 UTC m=+51.123283107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : configmap "kube-rbac-proxy" not found Jul 07 19:01:53.600404 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.600358 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:53.678605 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:53.678571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:54.188499 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.188468 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" event={"ID":"d9d2fa19-63ea-4696-9bb1-8244db2320e3","Type":"ContainerStarted","Data":"22fc5fcdad5f827ed5ca926b0c1aff859a59fc0736a6489f694a93ff2126bd17"} Jul 07 19:01:54.216175 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.216126 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ps4mm" podStartSLOduration=8.580593689 podStartE2EDuration="50.216111478s" totalImagesPullingTime="41.635517789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:54.215639293 +0000 UTC m=+50.806405508" watchObservedRunningTime="2026-07-07 19:01:54.216111478 +0000 UTC m=+50.806877690" Jul 07 19:01:54.343076 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.343038 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:54.410003 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.409969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:54.510084 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.510005 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:54.542262 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.542229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:54.542372 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.542336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:54.542372 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:54.542359 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:01:54.542454 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:54.542425 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.542406758 +0000 UTC m=+53.133172954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : configmap "kube-rbac-proxy" not found Jul 07 19:01:54.542492 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:54.542451 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:01:54.542526 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:54.542496 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.542483681 +0000 UTC m=+53.133249873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : secret "insights-runtime-extractor-tls" not found Jul 07 19:01:54.604199 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.604169 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:54.961742 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:54.961702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:55.042984 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:55.042947 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:55.246685 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:55.246592 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:55.482452 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:55.482425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gxnw_9664d9cc-a34b-477c-97ad-047b1dce7293/dns-node-resolver/0.log" Jul 07 19:01:55.789526 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:55.789496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:55.885083 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:55.885046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:55.986059 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:55.986025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:56.086095 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.086058 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:56.187547 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.187516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:56.257929 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.257889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:01:56.258395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.258005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:01:56.258395 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.258034 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:01:56.258395 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.258050 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d97965b6d-mtjx2: secret "image-registry-tls" not found Jul 07 19:01:56.258395 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.258115 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls podName:326b6794-7c42-4da6-ab04-a314ae318bed nodeName:}" failed. No retries permitted until 2026-07-07 19:02:12.258098273 +0000 UTC m=+68.848864488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls") pod "image-registry-d97965b6d-mtjx2" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed") : secret "image-registry-tls" not found Jul 07 19:01:56.258395 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.258147 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:56.258395 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.258212 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls podName:ccb7fdf2-25fc-4996-b5d2-c532576b4627 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:12.258199111 +0000 UTC m=+68.848965302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gvrw9" (UID: "ccb7fdf2-25fc-4996-b5d2-c532576b4627") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:01:56.359566 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.359472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:01:56.359566 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.359521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:56.359765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.359592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:01:56.359765 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.359622 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:01:56.359765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.359658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:01:56.359765 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.359686 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls podName:54cc496d-944f-4ce2-ae3c-612a273a6751 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:12.359670758 +0000 UTC m=+68.950436948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gqz58" (UID: "54cc496d-944f-4ce2-ae3c-612a273a6751") : secret "samples-operator-tls" not found Jul 07 19:01:56.359765 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.359732 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:01:56.359765 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.359734 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:12.359716862 +0000 UTC m=+68.950483052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : configmap references non-existent config key: service-ca.crt Jul 07 19:01:56.359765 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.359763 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:01:56.360148 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.359766 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls podName:de064a0b-8524-42b3-ad42-5e2c6dbe4dc1 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:12.359756806 +0000 UTC m=+68.950522996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls") pod "dns-default-2j5c6" (UID: "de064a0b-8524-42b3-ad42-5e2c6dbe4dc1") : secret "dns-default-metrics-tls" not found Jul 07 19:01:56.360148 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.359820 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs podName:b089f97c-3e75-43dd-931a-4ce7c5cb2f11 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:12.359808437 +0000 UTC m=+68.950574627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs") pod "router-default-548dbc9c89-jx4rq" (UID: "b089f97c-3e75-43dd-931a-4ce7c5cb2f11") : secret "router-metrics-certs-default" not found Jul 07 19:01:56.561518 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.561476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:56.561742 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.561560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:56.561742 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.561701 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:01:56.561864 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:01:56.561773 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:00.561755319 +0000 UTC m=+57.152521510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : secret "insights-runtime-extractor-tls" not found Jul 07 19:01:56.562103 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.562079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3f9eed5-4256-4e43-846d-d84a76085137-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:01:56.680563 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.680481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7r7rc_78c4fb26-b80c-4c87-9fab-cefe20c5a71c/node-ca/0.log" Jul 07 19:01:56.713501 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:56.713473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:57.480470 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:57.480444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n699n_9e540e5a-bdce-4be1-bf26-d7bddd7c1629/serve-healthcheck-canary/0.log" Jul 07 19:01:58.281381 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:58.281353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7ffvv_62ad0e5b-0a7f-4355-890b-288d9781ff3a/kube-storage-version-migrator-operator/0.log" Jul 07 19:01:59.629601 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:01:59.629568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:00.239311 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.239282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:00.339956 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.339923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:00.440408 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.440366 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:00.539643 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.539563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:00.601805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.601764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:02:00.601978 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:02:00.601925 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:02:00.602057 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:02:00.602037 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls podName:b3f9eed5-4256-4e43-846d-d84a76085137 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:08.602015666 +0000 UTC m=+65.192781859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wp2c" (UID: "b3f9eed5-4256-4e43-846d-d84a76085137") : secret "insights-runtime-extractor-tls" not found Jul 07 19:02:00.602570 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.602549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:00.654787 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.654756 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:02:00.655148 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.654847 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:02:00.655217 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:00.655204 2576 scope.go:117] "RemoveContainer" containerID="4914f7870cadac6e831243320ddce01d1cb5b2fe826b02ad319811920e72c003" Jul 07 19:02:00.655395 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:02:00.655376 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xhjj4_openshift-console-operator(7a9b20b3-1e8f-460c-b497-4e32040140de)\"" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" podUID="7a9b20b3-1e8f-460c-b497-4e32040140de" Jul 07 19:02:01.068305 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:01.068261 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:01.158783 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:01.158744 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:01.339026 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:01.338926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:01.550715 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:01.550679 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:02.146911 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:02.146880 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:02.538166 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:02.538078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:02.967239 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:02.967193 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:03.342511 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:03.342480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:03.749687 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:03.749605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:03.939538 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:03.939507 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:04.000828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:04.000747 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:04.084171 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:04.084145 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtlt4" Jul 07 19:02:04.262986 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:04.262895 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:04.541313 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:04.541225 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:04.737172 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:04.737140 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:04.823431 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:04.823397 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:05.350679 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:05.350647 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:05.941248 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:05.941215 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:06.040705 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:06.040674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:06.140562 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:06.140532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:06.241606 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:06.241521 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:06.341246 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:06.341214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:06.454728 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:06.454681 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:06.556763 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:06.556733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:07.554959 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:07.554926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:07.944679 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:07.944597 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:08.141595 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.141516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:08.336377 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.336345 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:08.412864 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.412832 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:08.675160 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.675067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:02:08.677492 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.677471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3f9eed5-4256-4e43-846d-d84a76085137-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wp2c\" (UID: \"b3f9eed5-4256-4e43-846d-d84a76085137\") " pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:02:08.742618 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.742557 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:08.808473 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.808441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f7xpr\"" Jul 07 19:02:08.814982 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.814963 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wp2c" Jul 07 19:02:08.942641 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:08.942571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wp2c"] Jul 07 19:02:08.945630 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:08.945606 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f9eed5_4256_4e43_846d_d84a76085137.slice/crio-4f31d0f0e17b5065ed97bb18ca3deb9a17c6aa066cc812f6fa54539050515b04 WatchSource:0}: Error finding container 4f31d0f0e17b5065ed97bb18ca3deb9a17c6aa066cc812f6fa54539050515b04: Status 404 returned error can't find the container with id 4f31d0f0e17b5065ed97bb18ca3deb9a17c6aa066cc812f6fa54539050515b04 Jul 07 19:02:09.236534 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.236442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wp2c" event={"ID":"b3f9eed5-4256-4e43-846d-d84a76085137","Type":"ContainerStarted","Data":"4f31d0f0e17b5065ed97bb18ca3deb9a17c6aa066cc812f6fa54539050515b04"} Jul 07 19:02:09.339800 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.339758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:09.685480 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.685445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:02:09.685938 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.685504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:02:09.688842 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.688812 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 19:02:09.688977 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.688818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 19:02:09.699009 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.698975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a2240bc-8273-4344-ba35-68c3220ed1e5-metrics-certs\") pod \"network-metrics-daemon-4dpqt\" (UID: \"6a2240bc-8273-4344-ba35-68c3220ed1e5\") " pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:02:09.699380 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.699358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12e4cd8c-678c-4c7d-8d55-0354d18dea85-original-pull-secret\") pod \"global-pull-secret-syncer-kfrcd\" (UID: \"12e4cd8c-678c-4c7d-8d55-0354d18dea85\") " pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:02:09.737099 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.737066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:09.763973 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.763943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g87lc\"" Jul 07 19:02:09.771400 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.771373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dpqt" Jul 07 19:02:09.777092 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.777053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfrcd" Jul 07 19:02:09.786522 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.786488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:02:09.794995 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.794957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgvtk\" (UniqueName: \"kubernetes.io/projected/44f5f16e-bbdf-491f-ba75-95333911c320-kube-api-access-pgvtk\") pod \"network-check-target-6crq2\" (UID: \"44f5f16e-bbdf-491f-ba75-95333911c320\") " pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:02:09.849382 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.849119 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-546ff\"" Jul 07 19:02:09.857212 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.856925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:02:09.940770 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.940653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:09.954310 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.953947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4dpqt"] Jul 07 19:02:09.960514 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:09.960481 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2240bc_8273_4344_ba35_68c3220ed1e5.slice/crio-6a36df420ecf79e0f8e5721384b46886eecdc14c9e2490aa74ce60bd871abbc0 WatchSource:0}: Error finding container 6a36df420ecf79e0f8e5721384b46886eecdc14c9e2490aa74ce60bd871abbc0: Status 404 returned error can't find the container with id 6a36df420ecf79e0f8e5721384b46886eecdc14c9e2490aa74ce60bd871abbc0 Jul 07 19:02:09.987158 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:09.987086 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfrcd"] Jul 07 19:02:09.992591 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:09.992564 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e4cd8c_678c_4c7d_8d55_0354d18dea85.slice/crio-cdd9328af23a81bd940627e69ff82ab7fae5daf8be74c6ad0e44e4e72bee9f2f WatchSource:0}: Error finding container cdd9328af23a81bd940627e69ff82ab7fae5daf8be74c6ad0e44e4e72bee9f2f: Status 404 returned error can't find the container with id cdd9328af23a81bd940627e69ff82ab7fae5daf8be74c6ad0e44e4e72bee9f2f Jul 07 19:02:10.056712 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.056679 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6crq2"] Jul 07 19:02:10.059563 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:10.059528 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f5f16e_bbdf_491f_ba75_95333911c320.slice/crio-ff0cb020fa74d04896347049133638b9657dd63bf75c7d6bfc96064977ab5638 WatchSource:0}: Error finding container ff0cb020fa74d04896347049133638b9657dd63bf75c7d6bfc96064977ab5638: Status 404 returned error can't find the container with id ff0cb020fa74d04896347049133638b9657dd63bf75c7d6bfc96064977ab5638 Jul 07 19:02:10.241983 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.241900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6crq2" event={"ID":"44f5f16e-bbdf-491f-ba75-95333911c320","Type":"ContainerStarted","Data":"86186b254890d4b568a093ac5f8900591b48f9f67701a25e4d60214f151d26ee"} Jul 07 19:02:10.241983 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.241953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6crq2" event={"ID":"44f5f16e-bbdf-491f-ba75-95333911c320","Type":"ContainerStarted","Data":"ff0cb020fa74d04896347049133638b9657dd63bf75c7d6bfc96064977ab5638"} Jul 07 19:02:10.242195 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.242034 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:02:10.243521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.243487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfrcd" event={"ID":"12e4cd8c-678c-4c7d-8d55-0354d18dea85","Type":"ContainerStarted","Data":"cdd9328af23a81bd940627e69ff82ab7fae5daf8be74c6ad0e44e4e72bee9f2f"} Jul 07 19:02:10.244770 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.244746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4dpqt" event={"ID":"6a2240bc-8273-4344-ba35-68c3220ed1e5","Type":"ContainerStarted","Data":"6a36df420ecf79e0f8e5721384b46886eecdc14c9e2490aa74ce60bd871abbc0"} Jul 07 19:02:10.536875 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.536792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:10.736776 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.736696 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:10.933435 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:10.933402 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:12.315361 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.315300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:02:12.315846 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.315417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:02:12.318831 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.318780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccb7fdf2-25fc-4996-b5d2-c532576b4627-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gvrw9\" (UID: \"ccb7fdf2-25fc-4996-b5d2-c532576b4627\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:02:12.323016 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.322963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"image-registry-d97965b6d-mtjx2\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:02:12.416298 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.416256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:02:12.416525 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.416355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:02:12.416525 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.416392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:12.416525 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.416440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:12.417520 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.417461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-service-ca-bundle\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:12.419734 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.419678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/54cc496d-944f-4ce2-ae3c-612a273a6751-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gqz58\" (UID: \"54cc496d-944f-4ce2-ae3c-612a273a6751\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:02:12.419877 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.419770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de064a0b-8524-42b3-ad42-5e2c6dbe4dc1-metrics-tls\") pod \"dns-default-2j5c6\" (UID: \"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1\") " pod="openshift-dns/dns-default-2j5c6" Jul 07 19:02:12.430105 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.430073 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b089f97c-3e75-43dd-931a-4ce7c5cb2f11-metrics-certs\") pod \"router-default-548dbc9c89-jx4rq\" (UID: \"b089f97c-3e75-43dd-931a-4ce7c5cb2f11\") " pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:12.490036 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.490004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4g6vf\"" Jul 07 19:02:12.497650 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.497615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" Jul 07 19:02:12.511095 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.511072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wn7mq\"" Jul 07 19:02:12.518100 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.518071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:02:12.547591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.547561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vzn9z\"" Jul 07 19:02:12.555215 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.555184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:12.594617 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.594541 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8xdn8\"" Jul 07 19:02:12.602104 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.602072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" Jul 07 19:02:12.616748 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.616725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hlmk\"" Jul 07 19:02:12.624219 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:12.624190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2j5c6" Jul 07 19:02:13.931578 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:13.931546 2576 scope.go:117] "RemoveContainer" containerID="4914f7870cadac6e831243320ddce01d1cb5b2fe826b02ad319811920e72c003" Jul 07 19:02:14.988145 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:14.988091 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6crq2" podStartSLOduration=70.988066648 podStartE2EDuration="1m10.988066648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:10.258850961 +0000 UTC m=+66.849617174" watchObservedRunningTime="2026-07-07 19:02:14.988066648 +0000 UTC m=+71.578832862" Jul 07 19:02:14.988734 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:14.988663 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9"] Jul 07 19:02:15.012173 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.010694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d97965b6d-mtjx2"] Jul 07 19:02:15.012173 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.011699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2j5c6"] Jul 07 19:02:15.053508 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.053243 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58"] Jul 07 19:02:15.077075 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.077008 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-548dbc9c89-jx4rq"] Jul 07 19:02:15.085856 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:15.085830 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb089f97c_3e75_43dd_931a_4ce7c5cb2f11.slice/crio-59e616c31b960e62d970e00d2de28794c7d91e6bab79fa0c450f565615d556eb WatchSource:0}: Error finding container 59e616c31b960e62d970e00d2de28794c7d91e6bab79fa0c450f565615d556eb: Status 404 returned error can't find the container with id 59e616c31b960e62d970e00d2de28794c7d91e6bab79fa0c450f565615d556eb Jul 07 19:02:15.271400 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.271315 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:02:15.271532 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.271412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" event={"ID":"7a9b20b3-1e8f-460c-b497-4e32040140de","Type":"ContainerStarted","Data":"cd8920b6e9c3052c1d48074ac336b9a6cf75545ff2a2c08492f4572fd5e7561e"} Jul 07 19:02:15.271903 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.271880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:02:15.273648 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.273617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4dpqt" event={"ID":"6a2240bc-8273-4344-ba35-68c3220ed1e5","Type":"ContainerStarted","Data":"4c1f67d19937b85d911e86687e8d39a3cb27fdcb07da465eb3eed490c2412b43"} Jul 07 19:02:15.273760 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.273672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4dpqt" event={"ID":"6a2240bc-8273-4344-ba35-68c3220ed1e5","Type":"ContainerStarted","Data":"9b254bf2f261166589f0aa708d6b47848adddd2dab55278c5209084fc3095ad0"} Jul 07 19:02:15.275444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.275417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" event={"ID":"b089f97c-3e75-43dd-931a-4ce7c5cb2f11","Type":"ContainerStarted","Data":"2976818f33186aab9c95ecc234e718e607d3da6eb055857e35549576f13d0fd3"} Jul 07 19:02:15.275634 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.275461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" event={"ID":"b089f97c-3e75-43dd-931a-4ce7c5cb2f11","Type":"ContainerStarted","Data":"59e616c31b960e62d970e00d2de28794c7d91e6bab79fa0c450f565615d556eb"} Jul 07 19:02:15.277186 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.277167 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2j5c6" event={"ID":"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1","Type":"ContainerStarted","Data":"f4ddfa8f0df8f18556f25c4e568035fd13e527f9ec93c7ef18bd80938ca32adf"} Jul 07 19:02:15.278804 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.278780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" event={"ID":"326b6794-7c42-4da6-ab04-a314ae318bed","Type":"ContainerStarted","Data":"866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7"} Jul 07 19:02:15.278906 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.278823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" event={"ID":"326b6794-7c42-4da6-ab04-a314ae318bed","Type":"ContainerStarted","Data":"196a27f261b21b2332c41ff2b38c1838634995ad906cae50da45968552e71bef"} Jul 07 19:02:15.278906 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.278844 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:02:15.279997 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.279962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" event={"ID":"ccb7fdf2-25fc-4996-b5d2-c532576b4627","Type":"ContainerStarted","Data":"2d1186f10d6459b105dc4edede965310806f3b47bf5d5701432583d70f4e8a2d"} Jul 07 19:02:15.281484 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.281465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wp2c" event={"ID":"b3f9eed5-4256-4e43-846d-d84a76085137","Type":"ContainerStarted","Data":"e8924eb8040a4f522cd8340ff2b5c8bbbc6bb2f51c861ecad5cf8d075ed9fb79"} Jul 07 19:02:15.282827 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.282802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfrcd" event={"ID":"12e4cd8c-678c-4c7d-8d55-0354d18dea85","Type":"ContainerStarted","Data":"f4eef207e6a7f165213aa22a9425241e650c88d4f6e95790bff745ef27c9815d"} Jul 07 19:02:15.287461 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.287438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" event={"ID":"54cc496d-944f-4ce2-ae3c-612a273a6751","Type":"ContainerStarted","Data":"b2d7ae3f593f591b7f2d02390d7cb22cec66469fd7801525146da0ab2390cb91"} Jul 07 19:02:15.294884 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.294847 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" podStartSLOduration=32.483653005 podStartE2EDuration="42.294832654s" totalImagesPullingTime="9.811179649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:15.293483416 +0000 UTC m=+71.884249653" watchObservedRunningTime="2026-07-07 19:02:15.294832654 +0000 UTC m=+71.885598869" Jul 07 19:02:15.309469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.309372 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kfrcd" podStartSLOduration=66.581593323 podStartE2EDuration="1m11.309356164s" totalImagesPullingTime="4.727762841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:15.30930414 +0000 UTC m=+71.900070353" watchObservedRunningTime="2026-07-07 19:02:15.309356164 +0000 UTC m=+71.900122377" Jul 07 19:02:15.330051 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.329993 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" podStartSLOduration=71.329966635 podStartE2EDuration="1m11.329966635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:15.329198492 +0000 UTC m=+71.919964720" watchObservedRunningTime="2026-07-07 19:02:15.329966635 +0000 UTC m=+71.920732851" Jul 07 19:02:15.347125 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.347077 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4dpqt" podStartSLOduration=66.605560742 podStartE2EDuration="1m11.347060535s" totalImagesPullingTime="4.741499793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:15.345719541 +0000 UTC m=+71.936485754" watchObservedRunningTime="2026-07-07 19:02:15.347060535 +0000 UTC m=+71.937826748" Jul 07 19:02:15.365782 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.365730 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" podStartSLOduration=42.365711056 podStartE2EDuration="42.365711056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:15.364353341 +0000 UTC m=+71.955119549" watchObservedRunningTime="2026-07-07 19:02:15.365711056 +0000 UTC m=+71.956477270" Jul 07 19:02:15.555627 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.555561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:15.560313 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.560130 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:15.586513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.586482 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-xhjj4" Jul 07 19:02:15.803399 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.803364 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:15.888975 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:15.888944 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:16.057510 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.057424 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:16.170560 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.170527 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:16.267918 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.267880 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:16.298048 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.297821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wp2c" event={"ID":"b3f9eed5-4256-4e43-846d-d84a76085137","Type":"ContainerStarted","Data":"9c71e90d60f6c5f52e113584982f9e8823eaf493b4cf00303fa2967a595268ad"} Jul 07 19:02:16.298048 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.297902 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:16.299641 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.299404 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-548dbc9c89-jx4rq" Jul 07 19:02:16.333869 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.333667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:16.437739 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.437710 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:16.678874 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.678783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:16.751263 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:16.751218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:17.303594 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:17.303517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:17.406972 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:17.406933 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:17.495469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:17.495433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:17.597019 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:17.596985 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:17.697191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:17.697153 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:17.794148 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:17.794076 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:17.894945 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:17.894878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:18.204954 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:18.204874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:18.307411 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:18.307349 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:19.916929 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:19.916899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:20.011373 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:20.011343 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:20.838723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:20.838680 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:21.000117 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.000033 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:21.010682 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.010653 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk"] Jul 07 19:02:21.031933 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.031900 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk"] Jul 07 19:02:21.032071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.031990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" Jul 07 19:02:21.034912 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.034888 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 19:02:21.035076 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.034925 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wscff\"" Jul 07 19:02:21.194894 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.194854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/07fd19ea-8aa7-4e35-a7d7-69cc8c92251f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xj4mk\" (UID: \"07fd19ea-8aa7-4e35-a7d7-69cc8c92251f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" Jul 07 19:02:21.296277 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.296201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/07fd19ea-8aa7-4e35-a7d7-69cc8c92251f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xj4mk\" (UID: \"07fd19ea-8aa7-4e35-a7d7-69cc8c92251f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" Jul 07 19:02:21.298838 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.298816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/07fd19ea-8aa7-4e35-a7d7-69cc8c92251f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xj4mk\" (UID: \"07fd19ea-8aa7-4e35-a7d7-69cc8c92251f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" Jul 07 19:02:21.299601 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.299578 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:21.320221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.320195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2j5c6" event={"ID":"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1","Type":"ContainerStarted","Data":"d82ce73068c51536cbb6744bcb125e99b81116a0cf66681fe947de4c9d8376f8"} Jul 07 19:02:21.320401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.320245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2j5c6" event={"ID":"de064a0b-8524-42b3-ad42-5e2c6dbe4dc1","Type":"ContainerStarted","Data":"17813abd7ff3bf2b95c6177dd7500e05aab57bdd5fdb0b3b114c7ff36b4c44ac"} Jul 07 19:02:21.320401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.320312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2j5c6" Jul 07 19:02:21.321800 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.321771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" event={"ID":"ccb7fdf2-25fc-4996-b5d2-c532576b4627","Type":"ContainerStarted","Data":"382cff7d67255eed042553d1cb0929a4fcf0267e58a774b3f1334500016ad30f"} Jul 07 19:02:21.323748 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.323728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wp2c" event={"ID":"b3f9eed5-4256-4e43-846d-d84a76085137","Type":"ContainerStarted","Data":"f42fa6304477ca392a03a97b232f54558c434eb27bf6f91dac00f2c5768eafd5"} Jul 07 19:02:21.331526 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.331497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" event={"ID":"54cc496d-944f-4ce2-ae3c-612a273a6751","Type":"ContainerStarted","Data":"88ede58e4e2f96c58d25c30353d8f7e9512770d2f32188e196f40d20b6b26a07"} Jul 07 19:02:21.331622 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.331563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" event={"ID":"54cc496d-944f-4ce2-ae3c-612a273a6751","Type":"ContainerStarted","Data":"a8f5bada957c7596a4d91006fdc316eb34741e1cf8eb4b80c09df6babf7b56f8"} Jul 07 19:02:21.341118 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.341086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" Jul 07 19:02:21.342990 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.342950 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2j5c6" podStartSLOduration=35.968656542 podStartE2EDuration="41.342937522s" totalImagesPullingTime="5.37428098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:21.341423615 +0000 UTC m=+77.932189831" watchObservedRunningTime="2026-07-07 19:02:21.342937522 +0000 UTC m=+77.933703767" Jul 07 19:02:21.359674 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.359627 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2wp2c" podStartSLOduration=18.131186675 podStartE2EDuration="29.35961327s" totalImagesPullingTime="11.228426595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:21.359256779 +0000 UTC m=+77.950023011" watchObservedRunningTime="2026-07-07 19:02:21.35961327 +0000 UTC m=+77.950379483" Jul 07 19:02:21.376463 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.376424 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gvrw9" podStartSLOduration=42.960963955 podStartE2EDuration="48.37640982s" totalImagesPullingTime="5.415445865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:21.37559308 +0000 UTC m=+77.966359294" watchObservedRunningTime="2026-07-07 19:02:21.37640982 +0000 UTC m=+77.967176033" Jul 07 19:02:21.397124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.397068 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gqz58" podStartSLOduration=43.088530519 podStartE2EDuration="48.397045697s" totalImagesPullingTime="5.308515178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:21.39536149 +0000 UTC m=+77.986127700" watchObservedRunningTime="2026-07-07 19:02:21.397045697 +0000 UTC m=+77.987811911" Jul 07 19:02:21.491291 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:21.491261 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk"] Jul 07 19:02:21.494210 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:21.494181 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fd19ea_8aa7_4e35_a7d7_69cc8c92251f.slice/crio-489cc6affdfad8036ccb419f68be980fe7b73c6288e6de57f78f77011773e652 WatchSource:0}: Error finding container 489cc6affdfad8036ccb419f68be980fe7b73c6288e6de57f78f77011773e652: Status 404 returned error can't find the container with id 489cc6affdfad8036ccb419f68be980fe7b73c6288e6de57f78f77011773e652 Jul 07 19:02:22.337145 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:22.337108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" event={"ID":"07fd19ea-8aa7-4e35-a7d7-69cc8c92251f","Type":"ContainerStarted","Data":"489cc6affdfad8036ccb419f68be980fe7b73c6288e6de57f78f77011773e652"} Jul 07 19:02:23.341929 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:23.341894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" event={"ID":"07fd19ea-8aa7-4e35-a7d7-69cc8c92251f","Type":"ContainerStarted","Data":"7b4ee0bc1ca216e870a95ec2ae69d83f97a56d25b3b8c3feff2d665396fb2e55"} Jul 07 19:02:23.342399 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:23.342069 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" Jul 07 19:02:23.346798 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:23.346777 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" Jul 07 19:02:23.360293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:23.360254 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj4mk" podStartSLOduration=1.826262541 podStartE2EDuration="3.360241618s" totalImagesPullingTime="1.533979077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:23.358856991 +0000 UTC m=+79.949623205" watchObservedRunningTime="2026-07-07 19:02:23.360241618 +0000 UTC m=+79.951007831" Jul 07 19:02:23.857221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:23.857188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:23.918376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:23.918344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:24.039705 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:24.039673 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:24.113533 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:24.113440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:24.422238 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:24.422088 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:24.911450 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:24.911418 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:25.007092 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:25.007060 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:26.044264 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:26.044229 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:26.146546 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:26.146513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:26.208284 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:26.208251 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:27.855630 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:27.855600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:27.957110 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:27.957081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:29.376095 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:29.376067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:29.673920 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:29.673838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:29.774705 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:29.774672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.008721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.008686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.109099 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.109067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.209912 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.209877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.339487 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.339452 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2j5c6" Jul 07 19:02:31.502943 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.502914 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.633990 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.633906 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c6drz"] Jul 07 19:02:31.637279 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.637255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.640453 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.640426 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 19:02:31.640602 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.640482 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 19:02:31.640602 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.640583 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kc7z\"" Jul 07 19:02:31.641930 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.641911 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 19:02:31.642040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.641942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 19:02:31.655665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.655641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.662192 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-tls\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662280 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-wtmp\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662349 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5hk\" (UniqueName: \"kubernetes.io/projected/af367a88-25a8-4fa0-b787-94db65474760-kube-api-access-zr5hk\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662411 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662454 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-root\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662500 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-textfile\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662541 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af367a88-25a8-4fa0-b787-94db65474760-metrics-client-ca\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662581 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.662581 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.662576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-sys\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763290 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-tls\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763290 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-wtmp\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5hk\" (UniqueName: \"kubernetes.io/projected/af367a88-25a8-4fa0-b787-94db65474760-kube-api-access-zr5hk\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-root\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-textfile\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-wtmp\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af367a88-25a8-4fa0-b787-94db65474760-metrics-client-ca\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-root\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763554 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763951 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-sys\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763951 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af367a88-25a8-4fa0-b787-94db65474760-sys\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.763951 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.763873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-textfile\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.764183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.764102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af367a88-25a8-4fa0-b787-94db65474760-metrics-client-ca\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.764183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.764134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.765833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.765812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-tls\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.765967 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.765951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af367a88-25a8-4fa0-b787-94db65474760-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.775282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.775257 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5hk\" (UniqueName: \"kubernetes.io/projected/af367a88-25a8-4fa0-b787-94db65474760-kube-api-access-zr5hk\") pod \"node-exporter-c6drz\" (UID: \"af367a88-25a8-4fa0-b787-94db65474760\") " pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.791628 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.791600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.894254 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.894176 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:31.946624 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.946600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6drz" Jul 07 19:02:31.992764 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:31.992732 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:32.085073 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.085037 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:32.166006 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.165930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:32.282293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.282263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:32.376988 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.376955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6drz" event={"ID":"af367a88-25a8-4fa0-b787-94db65474760","Type":"ContainerStarted","Data":"401bc6c556916ed4adcda9a54d02960d6bbe50e83163a8d1c31962f54f26eb3c"} Jul 07 19:02:32.495157 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.495074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:32.580388 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.580344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:32.586899 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.585083 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:02:32.588251 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.588226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.591811 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.591791 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 19:02:32.591920 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.591838 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 19:02:32.592639 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.592621 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 19:02:32.592718 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.592691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 19:02:32.592785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.592713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 19:02:32.592785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.592713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jspcd\"" Jul 07 19:02:32.592884 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.592835 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 19:02:32.593782 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.593767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 19:02:32.593875 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.593797 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 19:02:32.594151 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.594136 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 19:02:32.609180 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.609160 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:02:32.670150 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670301 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670301 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-config-out\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670301 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670301 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-config-volume\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670691 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-web-config\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670691 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.670691 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.670611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsjfn\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-kube-api-access-wsjfn\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771643 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771643 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771643 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-config-out\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-config-volume\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.771888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.772153 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-web-config\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.772153 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.772153 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.771964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsjfn\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-kube-api-access-wsjfn\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.772153 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.772000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.774518 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.773314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.774518 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.774467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.775755 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.775714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.777467 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.777424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.777780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.777754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.777900 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.777782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-config-out\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.778879 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.778851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.779022 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.778984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-config-volume\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.779086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.779026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.779915 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.779893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.779991 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.779930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-web-config\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.797147 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.797121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsjfn\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-kube-api-access-wsjfn\") pod \"alertmanager-main-0\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.805631 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.805584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:32.898548 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.898515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:02:32.997903 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:32.997861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:33.092818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:33.092621 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:02:33.094423 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:33.094309 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:33.094984 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:33.094964 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf030efa1_9c72_4629_b97a_2b66870e9e26.slice/crio-8dabc53abfd5b1bbbf04121eb3473901d1d1af706f6216f6f63491ab5c6da601 WatchSource:0}: Error finding container 8dabc53abfd5b1bbbf04121eb3473901d1d1af706f6216f6f63491ab5c6da601: Status 404 returned error can't find the container with id 8dabc53abfd5b1bbbf04121eb3473901d1d1af706f6216f6f63491ab5c6da601 Jul 07 19:02:33.382865 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:33.382827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerStarted","Data":"8dabc53abfd5b1bbbf04121eb3473901d1d1af706f6216f6f63491ab5c6da601"} Jul 07 19:02:33.384440 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:33.384413 2576 generic.go:356] "Generic (PLEG): container finished" podID="af367a88-25a8-4fa0-b787-94db65474760" containerID="68de6cd8ca030eb94d637b8008976bec7012e8e625e634f96f3532ea553b6b18" exitCode=0 Jul 07 19:02:33.384577 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:33.384469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6drz" event={"ID":"af367a88-25a8-4fa0-b787-94db65474760","Type":"ContainerDied","Data":"68de6cd8ca030eb94d637b8008976bec7012e8e625e634f96f3532ea553b6b18"} Jul 07 19:02:34.395363 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.395300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6drz" event={"ID":"af367a88-25a8-4fa0-b787-94db65474760","Type":"ContainerStarted","Data":"da644e8dee7328ca894a25a837c61582f288a6f1f45e6403055507437bfe0cec"} Jul 07 19:02:34.395810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.395393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6drz" event={"ID":"af367a88-25a8-4fa0-b787-94db65474760","Type":"ContainerStarted","Data":"375435d55aeecaf8a05c4bbfcc174d464ac71c0d3e1ec3a2519ee256088db54f"} Jul 07 19:02:34.420621 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.420574 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:34.569959 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.569872 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c6drz" podStartSLOduration=2.495143479 podStartE2EDuration="3.569849162s" totalImagesPullingTime="999.114751ms" totalInitContainerRuntime="75.590932ms" isStatefulPod=true podCreationTimestamp="2026-07-07 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:34.419860099 +0000 UTC m=+91.010626303" watchObservedRunningTime="2026-07-07 19:02:34.569849162 +0000 UTC m=+91.160615375" Jul 07 19:02:34.571187 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.571170 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84d8d858b5-p4zh5"] Jul 07 19:02:34.573797 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.573783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.577541 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.577518 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vtlbp\"" Jul 07 19:02:34.577541 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.577529 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 19:02:34.577704 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.577530 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 19:02:34.577704 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.577564 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 19:02:34.577704 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.577570 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 19:02:34.577918 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.577902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bcpimp3aj3l4n\"" Jul 07 19:02:34.577996 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.577965 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 19:02:34.590294 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.590278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d8d858b5-p4zh5"] Jul 07 19:02:34.591596 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w8v9\" (UniqueName: \"kubernetes.io/projected/b9c945b5-5035-4834-b8ff-6eb32a6aa968-kube-api-access-7w8v9\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.591694 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-grpc-tls\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.591694 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.591792 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.591792 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.591792 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9c945b5-5035-4834-b8ff-6eb32a6aa968-metrics-client-ca\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.591942 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.591942 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.591864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-tls\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.666648 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.666589 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:34.692855 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.692833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-tls\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.692931 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.692874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w8v9\" (UniqueName: \"kubernetes.io/projected/b9c945b5-5035-4834-b8ff-6eb32a6aa968-kube-api-access-7w8v9\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.692931 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.692891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-grpc-tls\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.692931 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.692914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.693085 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.692936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.693085 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.692953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.693085 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.692975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9c945b5-5035-4834-b8ff-6eb32a6aa968-metrics-client-ca\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.693085 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.693019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.694027 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.694004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9c945b5-5035-4834-b8ff-6eb32a6aa968-metrics-client-ca\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.695764 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.695711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.695910 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.695890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-tls\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.696134 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.696104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.696134 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.696128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.696311 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.696158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.696478 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.696458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9c945b5-5035-4834-b8ff-6eb32a6aa968-secret-grpc-tls\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.701471 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.701451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w8v9\" (UniqueName: \"kubernetes.io/projected/b9c945b5-5035-4834-b8ff-6eb32a6aa968-kube-api-access-7w8v9\") pod \"thanos-querier-84d8d858b5-p4zh5\" (UID: \"b9c945b5-5035-4834-b8ff-6eb32a6aa968\") " pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:34.771036 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.771010 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:34.904810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:34.904791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:35.037038 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.037010 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84d8d858b5-p4zh5"] Jul 07 19:02:35.040264 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:35.040231 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c945b5_5035_4834_b8ff_6eb32a6aa968.slice/crio-a96f672bd69cab16573f9b8873ce25211b20aa9ef440377f4256e94253537e48 WatchSource:0}: Error finding container a96f672bd69cab16573f9b8873ce25211b20aa9ef440377f4256e94253537e48: Status 404 returned error can't find the container with id a96f672bd69cab16573f9b8873ce25211b20aa9ef440377f4256e94253537e48 Jul 07 19:02:35.127303 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.127277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:35.400625 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.400599 2576 generic.go:356] "Generic (PLEG): container finished" podID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerID="c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b" exitCode=0 Jul 07 19:02:35.401008 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.400666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b"} Jul 07 19:02:35.401980 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.401959 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" event={"ID":"b9c945b5-5035-4834-b8ff-6eb32a6aa968","Type":"ContainerStarted","Data":"a96f672bd69cab16573f9b8873ce25211b20aa9ef440377f4256e94253537e48"} Jul 07 19:02:35.946759 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.946727 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7659ddcb75-ljtbk"] Jul 07 19:02:35.948932 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.948916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:35.951607 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.951584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 19:02:35.951749 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.951586 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7cmf6\"" Jul 07 19:02:35.951749 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.951623 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8cam27mugmf4u\"" Jul 07 19:02:35.951749 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.951673 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 19:02:35.951749 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.951675 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 19:02:35.951749 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.951646 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 19:02:35.961070 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:35.961048 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7659ddcb75-ljtbk"] Jul 07 19:02:36.005013 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.004986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-client-ca-bundle\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.005121 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.005023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/90cd51ae-5070-435a-8b08-26ab4291d9c9-metrics-server-audit-profiles\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.005121 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.005059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cd51ae-5070-435a-8b08-26ab4291d9c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.005242 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.005122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-secret-metrics-server-tls\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.005242 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.005214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-secret-metrics-server-client-certs\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.005369 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.005245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/90cd51ae-5070-435a-8b08-26ab4291d9c9-audit-log\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.005369 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.005272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj7fc\" (UniqueName: \"kubernetes.io/projected/90cd51ae-5070-435a-8b08-26ab4291d9c9-kube-api-access-dj7fc\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106192 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-secret-metrics-server-client-certs\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106340 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/90cd51ae-5070-435a-8b08-26ab4291d9c9-audit-log\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106340 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj7fc\" (UniqueName: \"kubernetes.io/projected/90cd51ae-5070-435a-8b08-26ab4291d9c9-kube-api-access-dj7fc\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106340 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-client-ca-bundle\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106340 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/90cd51ae-5070-435a-8b08-26ab4291d9c9-metrics-server-audit-profiles\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106340 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cd51ae-5070-435a-8b08-26ab4291d9c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106607 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-secret-metrics-server-tls\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.106838 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.106793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/90cd51ae-5070-435a-8b08-26ab4291d9c9-audit-log\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.107598 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.107574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cd51ae-5070-435a-8b08-26ab4291d9c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.107684 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.107636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/90cd51ae-5070-435a-8b08-26ab4291d9c9-metrics-server-audit-profiles\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.109351 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.109305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-secret-metrics-server-client-certs\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.109469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.109431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-client-ca-bundle\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.109530 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.109485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/90cd51ae-5070-435a-8b08-26ab4291d9c9-secret-metrics-server-tls\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.118812 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.118791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj7fc\" (UniqueName: \"kubernetes.io/projected/90cd51ae-5070-435a-8b08-26ab4291d9c9-kube-api-access-dj7fc\") pod \"metrics-server-7659ddcb75-ljtbk\" (UID: \"90cd51ae-5070-435a-8b08-26ab4291d9c9\") " pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.258421 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.258314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:36.303479 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.303451 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:02:36.403601 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.403572 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7659ddcb75-ljtbk"] Jul 07 19:02:36.409467 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:36.409437 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cd51ae_5070_435a_8b08_26ab4291d9c9.slice/crio-91a2f2909351f0437c07e25e4965bf2d30c9735ec6e221a87e847e2fc7e09f44 WatchSource:0}: Error finding container 91a2f2909351f0437c07e25e4965bf2d30c9735ec6e221a87e847e2fc7e09f44: Status 404 returned error can't find the container with id 91a2f2909351f0437c07e25e4965bf2d30c9735ec6e221a87e847e2fc7e09f44 Jul 07 19:02:36.423114 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.423092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:36.522216 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.522128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:36.590603 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.590556 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:36.750692 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.750650 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr"] Jul 07 19:02:36.753651 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.753631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.756811 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.756610 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 19:02:36.756811 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.756626 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 19:02:36.756811 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.756645 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4mf2b\"" Jul 07 19:02:36.757018 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.756847 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 19:02:36.757018 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.756955 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 19:02:36.757018 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.756968 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 19:02:36.763499 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.763311 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 19:02:36.770188 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.770165 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr"] Jul 07 19:02:36.813940 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.813905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-federate-client-tls\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.814086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.813952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-secret-telemeter-client\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.814086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.813999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-serving-certs-ca-bundle\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.814086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.814038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.814086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.814068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-metrics-client-ca\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.814086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.814084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-telemeter-client-tls\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.814364 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.814100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.814364 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.814222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xncwn\" (UniqueName: \"kubernetes.io/projected/eef204f9-06bb-4aa8-b116-e05cce1ad963-kube-api-access-xncwn\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915269 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-telemeter-client-tls\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915269 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xncwn\" (UniqueName: \"kubernetes.io/projected/eef204f9-06bb-4aa8-b116-e05cce1ad963-kube-api-access-xncwn\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-federate-client-tls\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-secret-telemeter-client\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-serving-certs-ca-bundle\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915731 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.915731 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.915568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-metrics-client-ca\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.916587 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.916351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-metrics-client-ca\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.916587 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.916547 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.916587 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.916576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eef204f9-06bb-4aa8-b116-e05cce1ad963-serving-certs-ca-bundle\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.918367 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.918316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.918522 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.918504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-federate-client-tls\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.918586 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.918552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-telemeter-client-tls\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.918897 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.918880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eef204f9-06bb-4aa8-b116-e05cce1ad963-secret-telemeter-client\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:36.924419 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:36.924384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xncwn\" (UniqueName: \"kubernetes.io/projected/eef204f9-06bb-4aa8-b116-e05cce1ad963-kube-api-access-xncwn\") pod \"telemeter-client-67fd7f8f6-s8zfr\" (UID: \"eef204f9-06bb-4aa8-b116-e05cce1ad963\") " pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:37.067362 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.067231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" Jul 07 19:02:37.412096 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.411943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" event={"ID":"90cd51ae-5070-435a-8b08-26ab4291d9c9","Type":"ContainerStarted","Data":"91a2f2909351f0437c07e25e4965bf2d30c9735ec6e221a87e847e2fc7e09f44"} Jul 07 19:02:37.744501 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.742309 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:37.752741 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.752715 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:02:37.758546 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.758526 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr"] Jul 07 19:02:37.758692 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.758672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.760431 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:37.760407 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef204f9_06bb_4aa8_b116_e05cce1ad963.slice/crio-c3e39e2d08ccffa2b03a8c232bf6c48101b8b34d7b657a68a816bff8ae55b340 WatchSource:0}: Error finding container c3e39e2d08ccffa2b03a8c232bf6c48101b8b34d7b657a68a816bff8ae55b340: Status 404 returned error can't find the container with id c3e39e2d08ccffa2b03a8c232bf6c48101b8b34d7b657a68a816bff8ae55b340 Jul 07 19:02:37.763670 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.763441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 19:02:37.763670 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.763469 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 19:02:37.764277 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.764157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 19:02:37.764277 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.764167 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 19:02:37.764277 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.764266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 19:02:37.764552 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.764387 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 19:02:37.764632 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.764617 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 19:02:37.764968 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.764825 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 19:02:37.764968 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.764968 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mzvs6\"" Jul 07 19:02:37.765099 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.765003 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 19:02:37.766423 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.766140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-16rvi88dd0lnk\"" Jul 07 19:02:37.766423 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.766162 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 19:02:37.766589 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.766539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 19:02:37.766855 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.766732 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 19:02:37.769105 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.769085 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 19:02:37.772769 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.772692 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 19:02:37.775946 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.775913 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:02:37.823203 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823203 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823424 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823424 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823424 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823424 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823424 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823424 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.823720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.824159 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.824159 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbzl\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-kube-api-access-xbbzl\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.824159 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.823768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924574 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbzl\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-kube-api-access-xbbzl\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.924835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.925613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.925613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.925613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.925613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.925613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.925613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.925613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.924988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.928084 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.925980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.928084 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.926512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.928084 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.926949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.928084 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.927735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.928084 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.927975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.928476 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.928448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.932765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.928897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.932765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.929289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.932765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.929310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.932765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.931001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.933044 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.932920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.933044 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.932950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.933296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.933279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.933374 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.933357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.933508 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.933446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.934772 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.934392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.934860 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.934840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.935261 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.935228 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.936219 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.936194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:37.937753 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:37.937274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbzl\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-kube-api-access-xbbzl\") pod \"prometheus-k8s-0\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:38.088074 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.088051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:38.252634 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.252600 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:02:38.257863 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:02:38.257832 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3298c28_e492_4cf6_bcbf_e327f0a5d991.slice/crio-fbc3bd6ccefd1aec7b38b13b53df70c2cca9d6a27fb032717ff4fca21027cf3b WatchSource:0}: Error finding container fbc3bd6ccefd1aec7b38b13b53df70c2cca9d6a27fb032717ff4fca21027cf3b: Status 404 returned error can't find the container with id fbc3bd6ccefd1aec7b38b13b53df70c2cca9d6a27fb032717ff4fca21027cf3b Jul 07 19:02:38.421899 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.421778 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" exitCode=0 Jul 07 19:02:38.421899 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.421817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb"} Jul 07 19:02:38.421899 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.421895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerStarted","Data":"fbc3bd6ccefd1aec7b38b13b53df70c2cca9d6a27fb032717ff4fca21027cf3b"} Jul 07 19:02:38.428220 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.428131 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerStarted","Data":"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce"} Jul 07 19:02:38.428356 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.428240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerStarted","Data":"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea"} Jul 07 19:02:38.428356 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.428290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerStarted","Data":"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa"} Jul 07 19:02:38.428356 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.428347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerStarted","Data":"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364"} Jul 07 19:02:38.428519 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.428386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerStarted","Data":"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1"} Jul 07 19:02:38.431225 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.431202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" event={"ID":"b9c945b5-5035-4834-b8ff-6eb32a6aa968","Type":"ContainerStarted","Data":"368b150e1c9ff23508759a67c95e62d505972738fc45961b02c8fb3a858ec00d"} Jul 07 19:02:38.431437 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.431270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" event={"ID":"b9c945b5-5035-4834-b8ff-6eb32a6aa968","Type":"ContainerStarted","Data":"0238d2fb00f3cf99bf88b053164c926fd52a407c0ce241a3b592c4a7efc7663e"} Jul 07 19:02:38.431437 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.431311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" event={"ID":"b9c945b5-5035-4834-b8ff-6eb32a6aa968","Type":"ContainerStarted","Data":"adb87ca353b99f18fa9ec0b0480607af0934a16c7f9e22818d40f9ccb8cc0747"} Jul 07 19:02:38.434249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.434172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" event={"ID":"eef204f9-06bb-4aa8-b116-e05cce1ad963","Type":"ContainerStarted","Data":"c3e39e2d08ccffa2b03a8c232bf6c48101b8b34d7b657a68a816bff8ae55b340"} Jul 07 19:02:38.499141 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.499109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:38.600801 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:38.600774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:39.442315 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.442214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" event={"ID":"90cd51ae-5070-435a-8b08-26ab4291d9c9","Type":"ContainerStarted","Data":"3842a258ba5a2f6c3e5dd25835a8f1a7b9ab1ed0c9001a65208b75602f26b39e"} Jul 07 19:02:39.447441 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.447409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerStarted","Data":"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b"} Jul 07 19:02:39.451486 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.451455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" event={"ID":"b9c945b5-5035-4834-b8ff-6eb32a6aa968","Type":"ContainerStarted","Data":"32693d7cb3f1a7de0bbc966e51d84145ab56587179d0202bc8bf6f2120ae79df"} Jul 07 19:02:39.451579 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.451525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" event={"ID":"b9c945b5-5035-4834-b8ff-6eb32a6aa968","Type":"ContainerStarted","Data":"870785ce1c8a0cc7dfb3f0d2d1c2ed2bf512e2b84af60d189e3a42658b026ab7"} Jul 07 19:02:39.451579 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.451569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" event={"ID":"b9c945b5-5035-4834-b8ff-6eb32a6aa968","Type":"ContainerStarted","Data":"0f5922e3f2bf7a2a16e524fb752108f70c3f1a559e88445d3b59028fbeba7672"} Jul 07 19:02:39.451677 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.451611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:39.463183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.463145 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" podStartSLOduration=1.799169743 podStartE2EDuration="4.463131142s" totalImagesPullingTime="2.663961399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:39.462650848 +0000 UTC m=+96.053417065" watchObservedRunningTime="2026-07-07 19:02:39.463131142 +0000 UTC m=+96.053897369" Jul 07 19:02:39.522805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.522087 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.806575151 podStartE2EDuration="7.522069815s" totalImagesPullingTime="4.699211559s" totalInitContainerRuntime="16.283105ms" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:39.497625133 +0000 UTC m=+96.088391359" watchObservedRunningTime="2026-07-07 19:02:39.522069815 +0000 UTC m=+96.112836082" Jul 07 19:02:39.616982 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.616942 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:39.718419 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:39.718341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:40.458572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:40.458469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" event={"ID":"eef204f9-06bb-4aa8-b116-e05cce1ad963","Type":"ContainerStarted","Data":"cc99cc6fd423513b9aed161c8ec6ce3370a559e4ebceb7c5192ac7ac266be761"} Jul 07 19:02:40.459006 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:40.458590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" event={"ID":"eef204f9-06bb-4aa8-b116-e05cce1ad963","Type":"ContainerStarted","Data":"eaed6e7681ba623a5f3ce32a42d29b16fb3a0b415fc6b933062a3f63660ca75b"} Jul 07 19:02:40.459006 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:40.458619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" event={"ID":"eef204f9-06bb-4aa8-b116-e05cce1ad963","Type":"ContainerStarted","Data":"20f81abb747f7aa383070d8674f79ce1eaa7787a50e6b66a606270f7bd3642e5"} Jul 07 19:02:40.485518 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:40.485445 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" podStartSLOduration=2.660511298 podStartE2EDuration="6.485426788s" totalImagesPullingTime="3.82491549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:39.523183364 +0000 UTC m=+96.113949604" watchObservedRunningTime="2026-07-07 19:02:40.485426788 +0000 UTC m=+97.076193002" Jul 07 19:02:40.486591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:40.486555 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67fd7f8f6-s8zfr" podStartSLOduration=2.258098875 podStartE2EDuration="4.486538563s" totalImagesPullingTime="2.228439688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:40.485391916 +0000 UTC m=+97.076158132" watchObservedRunningTime="2026-07-07 19:02:40.486538563 +0000 UTC m=+97.077304777" Jul 07 19:02:40.821772 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:40.821739 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d97965b6d-mtjx2"] Jul 07 19:02:40.899772 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:40.899746 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:41.000792 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:41.000763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:41.100581 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:41.100507 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:41.252027 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:41.251996 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6crq2" Jul 07 19:02:42.474095 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:42.474063 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerStarted","Data":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} Jul 07 19:02:42.474437 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:42.474155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerStarted","Data":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} Jul 07 19:02:42.474437 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:42.474180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerStarted","Data":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} Jul 07 19:02:43.486748 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:43.486658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerStarted","Data":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} Jul 07 19:02:43.486748 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:43.486721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerStarted","Data":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} Jul 07 19:02:43.486748 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:43.486748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerStarted","Data":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} Jul 07 19:02:43.520517 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:43.520462 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.733413981 podStartE2EDuration="6.52044581s" totalImagesPullingTime="3.759591191s" totalInitContainerRuntime="27.440638ms" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:43.518662206 +0000 UTC m=+100.109428420" watchObservedRunningTime="2026-07-07 19:02:43.52044581 +0000 UTC m=+100.111212063" Jul 07 19:02:45.465107 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:45.465077 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84d8d858b5-p4zh5" Jul 07 19:02:45.855467 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:45.855435 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:45.957932 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:45.957898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:46.054613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:46.054582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:46.154945 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:46.154845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:46.255477 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:46.255430 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:48.088894 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:48.088863 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:02:52.172034 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:52.171993 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:52.269433 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:52.269398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:52.330946 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:52.330901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:53.599701 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:53.599671 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:53.698610 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:53.698574 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:53.759759 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:53.759721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:02:56.258734 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:56.258689 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:02:56.259182 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:02:56.258996 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:03:01.006916 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:01.006883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:01.087674 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:01.087641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:05.846471 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:05.846436 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" podUID="326b6794-7c42-4da6-ab04-a314ae318bed" containerName="registry" containerID="cri-o://866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7" gracePeriod=30 Jul 07 19:03:06.092758 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.092732 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:03:06.184618 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184558 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-installation-pull-secrets\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.184730 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184639 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b6794-7c42-4da6-ab04-a314ae318bed-ca-trust-extracted\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.184730 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184660 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.184730 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184681 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-trusted-ca\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.184730 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184726 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrhbl\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-kube-api-access-lrhbl\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.184904 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184752 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-registry-certificates\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.184904 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184798 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-bound-sa-token\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.184904 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.184825 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-image-registry-private-configuration\") pod \"326b6794-7c42-4da6-ab04-a314ae318bed\" (UID: \"326b6794-7c42-4da6-ab04-a314ae318bed\") " Jul 07 19:03:06.185620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.185395 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:06.185620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.185441 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:06.187339 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.187276 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-kube-api-access-lrhbl" (OuterVolumeSpecName: "kube-api-access-lrhbl") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "kube-api-access-lrhbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:03:06.187438 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.187347 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:06.187714 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.187680 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:03:06.187714 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.187701 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:06.187835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.187734 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:03:06.193050 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.193027 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326b6794-7c42-4da6-ab04-a314ae318bed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "326b6794-7c42-4da6-ab04-a314ae318bed" (UID: "326b6794-7c42-4da6-ab04-a314ae318bed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:03:06.286040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286005 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrhbl\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-kube-api-access-lrhbl\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.286040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286035 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-registry-certificates\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.286040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286045 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-bound-sa-token\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.286191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286055 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-image-registry-private-configuration\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.286191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286065 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b6794-7c42-4da6-ab04-a314ae318bed-installation-pull-secrets\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.286191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286073 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b6794-7c42-4da6-ab04-a314ae318bed-ca-trust-extracted\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.286191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286081 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b6794-7c42-4da6-ab04-a314ae318bed-registry-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.286191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.286089 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b6794-7c42-4da6-ab04-a314ae318bed-trusted-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:06.584564 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.584534 2576 generic.go:356] "Generic (PLEG): container finished" podID="326b6794-7c42-4da6-ab04-a314ae318bed" containerID="866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7" exitCode=0 Jul 07 19:03:06.584763 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.584581 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" Jul 07 19:03:06.584763 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.584612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" event={"ID":"326b6794-7c42-4da6-ab04-a314ae318bed","Type":"ContainerDied","Data":"866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7"} Jul 07 19:03:06.584763 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.584669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d97965b6d-mtjx2" event={"ID":"326b6794-7c42-4da6-ab04-a314ae318bed","Type":"ContainerDied","Data":"196a27f261b21b2332c41ff2b38c1838634995ad906cae50da45968552e71bef"} Jul 07 19:03:06.584763 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.584691 2576 scope.go:117] "RemoveContainer" containerID="866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7" Jul 07 19:03:06.631593 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.631572 2576 scope.go:117] "RemoveContainer" containerID="866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7" Jul 07 19:03:06.631869 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:06.631849 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7\": container with ID starting with 866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7 not found: ID does not exist" containerID="866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7" Jul 07 19:03:06.631916 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.631879 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7"} err="failed to get container status \"866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7\": rpc error: code = NotFound desc = could not find container \"866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7\": container with ID starting with 866528192f473507d90e26cbd23349ed8fd217bd3f92a25c090fe32c145533b7 not found: ID does not exist" Jul 07 19:03:06.647785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.647762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d97965b6d-mtjx2"] Jul 07 19:03:06.652052 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:06.652030 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d97965b6d-mtjx2"] Jul 07 19:03:07.590043 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:07.590015 2576 generic.go:356] "Generic (PLEG): container finished" podID="50456258-b056-424a-a6af-a9d2f6e8078d" containerID="aee7fc86e48ba6acab8af13a20e7f94aacb5eb3317b7f06b0bacd5d8dcdfe6bd" exitCode=0 Jul 07 19:03:07.590454 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:07.590089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" event={"ID":"50456258-b056-424a-a6af-a9d2f6e8078d","Type":"ContainerDied","Data":"aee7fc86e48ba6acab8af13a20e7f94aacb5eb3317b7f06b0bacd5d8dcdfe6bd"} Jul 07 19:03:07.590513 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:07.590453 2576 scope.go:117] "RemoveContainer" containerID="aee7fc86e48ba6acab8af13a20e7f94aacb5eb3317b7f06b0bacd5d8dcdfe6bd" Jul 07 19:03:07.936169 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:07.936096 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="326b6794-7c42-4da6-ab04-a314ae318bed" path="/var/lib/kubelet/pods/326b6794-7c42-4da6-ab04-a314ae318bed/volumes" Jul 07 19:03:08.596698 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:08.596665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9gf77" event={"ID":"50456258-b056-424a-a6af-a9d2f6e8078d","Type":"ContainerStarted","Data":"ac1a348366873110f88303f27907becfea8218080e1ea0d5d91b20df7cbc4e69"} Jul 07 19:03:12.614750 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:12.614718 2576 generic.go:356] "Generic (PLEG): container finished" podID="62ad0e5b-0a7f-4355-890b-288d9781ff3a" containerID="57589ff703e650a975a66e3c18c4ba6b7d252e85d9e973584884b0e78d83233d" exitCode=0 Jul 07 19:03:12.615129 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:12.614793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" event={"ID":"62ad0e5b-0a7f-4355-890b-288d9781ff3a","Type":"ContainerDied","Data":"57589ff703e650a975a66e3c18c4ba6b7d252e85d9e973584884b0e78d83233d"} Jul 07 19:03:12.615190 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:12.615171 2576 scope.go:117] "RemoveContainer" containerID="57589ff703e650a975a66e3c18c4ba6b7d252e85d9e973584884b0e78d83233d" Jul 07 19:03:13.620116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:13.620084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7ffvv" event={"ID":"62ad0e5b-0a7f-4355-890b-288d9781ff3a","Type":"ContainerStarted","Data":"6961f5195d238ca7605e10bfba6ac7814aa6cbc07a8f3a5199665e7b6c9368b6"} Jul 07 19:03:16.006413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:16.006362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:16.063152 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:16.063123 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:16.264296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:16.264238 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:03:16.268064 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:16.268046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7659ddcb75-ljtbk" Jul 07 19:03:16.638537 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:16.638512 2576 generic.go:356] "Generic (PLEG): container finished" podID="6a173c70-0bda-4d73-99e6-06dc7e1cf302" containerID="a986cc5d9759fdf8a5778b2779c3bf566d65cafc4f889de57c6ff418f282b89d" exitCode=0 Jul 07 19:03:16.638653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:16.638586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" event={"ID":"6a173c70-0bda-4d73-99e6-06dc7e1cf302","Type":"ContainerDied","Data":"a986cc5d9759fdf8a5778b2779c3bf566d65cafc4f889de57c6ff418f282b89d"} Jul 07 19:03:16.639016 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:16.639000 2576 scope.go:117] "RemoveContainer" containerID="a986cc5d9759fdf8a5778b2779c3bf566d65cafc4f889de57c6ff418f282b89d" Jul 07 19:03:17.650987 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:17.650953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7wdsf" event={"ID":"6a173c70-0bda-4d73-99e6-06dc7e1cf302","Type":"ContainerStarted","Data":"ca43ae96d0088bff550d9c2b8e66ec1965ad09215ee72b7df70d6ec16305ac8e"} Jul 07 19:03:38.088470 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:38.088439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:38.107192 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:38.107166 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:38.755152 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:38.755123 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:47.624939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:47.624903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:47.722818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:47.722789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:48.572790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:48.572754 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:48.671918 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:48.671885 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:49.252301 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:49.252267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:49.352473 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:49.352441 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:50.980860 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:50.980825 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:51.949121 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:51.949084 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:03:51.949464 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:51.949438 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="alertmanager" containerID="cri-o://f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1" gracePeriod=120 Jul 07 19:03:51.949636 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:51.949521 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-web" containerID="cri-o://8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa" gracePeriod=120 Jul 07 19:03:51.949636 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:51.949533 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="config-reloader" containerID="cri-o://f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364" gracePeriod=120 Jul 07 19:03:51.949636 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:51.949560 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy" containerID="cri-o://22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea" gracePeriod=120 Jul 07 19:03:51.949796 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:51.949558 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="prom-label-proxy" containerID="cri-o://43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b" gracePeriod=120 Jul 07 19:03:51.949796 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:51.949505 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-metric" containerID="cri-o://7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce" gracePeriod=120 Jul 07 19:03:52.805765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805734 2576 generic.go:356] "Generic (PLEG): container finished" podID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerID="43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b" exitCode=0 Jul 07 19:03:52.805765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805759 2576 generic.go:356] "Generic (PLEG): container finished" podID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerID="22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea" exitCode=0 Jul 07 19:03:52.805765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805766 2576 generic.go:356] "Generic (PLEG): container finished" podID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerID="f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364" exitCode=0 Jul 07 19:03:52.805765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805774 2576 generic.go:356] "Generic (PLEG): container finished" podID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerID="f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1" exitCode=0 Jul 07 19:03:52.806216 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b"} Jul 07 19:03:52.806216 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea"} Jul 07 19:03:52.806216 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364"} Jul 07 19:03:52.806216 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:52.805912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1"} Jul 07 19:03:53.198807 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.198786 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.279088 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279059 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-metrics-client-ca\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsjfn\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-kube-api-access-wsjfn\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279129 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-main-db\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279146 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-config-volume\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279170 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-web-config\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279193 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-tls-assets\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279255 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279286 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-web\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279310 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-main-tls\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279367 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-config-out\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279406 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-cluster-tls-config\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279440 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-trusted-ca-bundle\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279481 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:03:53.279556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279541 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f030efa1-9c72-4629-b97a-2b66870e9e26\" (UID: \"f030efa1-9c72-4629-b97a-2b66870e9e26\") " Jul 07 19:03:53.280008 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.279864 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-main-db\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.280314 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.280239 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:53.280314 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.280249 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:53.282457 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.282426 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:53.283344 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.283288 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-config-volume" (OuterVolumeSpecName: "config-volume") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:53.283344 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.283308 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:53.283508 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.283412 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-kube-api-access-wsjfn" (OuterVolumeSpecName: "kube-api-access-wsjfn") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "kube-api-access-wsjfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:03:53.283564 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.283527 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:53.283564 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.283548 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:53.283726 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.283708 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:03:53.283978 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.283945 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-config-out" (OuterVolumeSpecName: "config-out") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:03:53.288893 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.288872 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:53.294536 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.294516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-web-config" (OuterVolumeSpecName: "web-config") pod "f030efa1-9c72-4629-b97a-2b66870e9e26" (UID: "f030efa1-9c72-4629-b97a-2b66870e9e26"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380676 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-cluster-tls-config\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380723 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380735 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380746 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f030efa1-9c72-4629-b97a-2b66870e9e26-metrics-client-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380754 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsjfn\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-kube-api-access-wsjfn\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380765 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-config-volume\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380774 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-web-config\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380781 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f030efa1-9c72-4629-b97a-2b66870e9e26-tls-assets\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.380773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380789 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.381136 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380798 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.381136 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380807 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f030efa1-9c72-4629-b97a-2b66870e9e26-secret-alertmanager-main-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.381136 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.380815 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f030efa1-9c72-4629-b97a-2b66870e9e26-config-out\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:53.813149 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.813117 2576 generic.go:356] "Generic (PLEG): container finished" podID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerID="7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce" exitCode=0 Jul 07 19:03:53.813149 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.813140 2576 generic.go:356] "Generic (PLEG): container finished" podID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerID="8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa" exitCode=0 Jul 07 19:03:53.813626 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.813199 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.813626 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.813203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce"} Jul 07 19:03:53.813626 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.813272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa"} Jul 07 19:03:53.813626 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.813299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f030efa1-9c72-4629-b97a-2b66870e9e26","Type":"ContainerDied","Data":"8dabc53abfd5b1bbbf04121eb3473901d1d1af706f6216f6f63491ab5c6da601"} Jul 07 19:03:53.813626 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.813343 2576 scope.go:117] "RemoveContainer" containerID="43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b" Jul 07 19:03:53.823867 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.823689 2576 scope.go:117] "RemoveContainer" containerID="7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce" Jul 07 19:03:53.831283 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.831265 2576 scope.go:117] "RemoveContainer" containerID="22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea" Jul 07 19:03:53.838128 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.838106 2576 scope.go:117] "RemoveContainer" containerID="8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa" Jul 07 19:03:53.845341 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.845297 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:03:53.845666 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.845651 2576 scope.go:117] "RemoveContainer" containerID="f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364" Jul 07 19:03:53.853289 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.853272 2576 scope.go:117] "RemoveContainer" containerID="f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1" Jul 07 19:03:53.853604 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.853585 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:03:53.860225 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.860208 2576 scope.go:117] "RemoveContainer" containerID="c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b" Jul 07 19:03:53.868765 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.868749 2576 scope.go:117] "RemoveContainer" containerID="43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b" Jul 07 19:03:53.869022 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:53.868995 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b\": container with ID starting with 43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b not found: ID does not exist" containerID="43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b" Jul 07 19:03:53.869105 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869028 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b"} err="failed to get container status \"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b\": rpc error: code = NotFound desc = could not find container \"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b\": container with ID starting with 43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b not found: ID does not exist" Jul 07 19:03:53.869105 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869046 2576 scope.go:117] "RemoveContainer" containerID="7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce" Jul 07 19:03:53.869313 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:53.869296 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce\": container with ID starting with 7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce not found: ID does not exist" containerID="7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce" Jul 07 19:03:53.869489 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869333 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce"} err="failed to get container status \"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce\": rpc error: code = NotFound desc = could not find container \"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce\": container with ID starting with 7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce not found: ID does not exist" Jul 07 19:03:53.869489 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869355 2576 scope.go:117] "RemoveContainer" containerID="22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea" Jul 07 19:03:53.869594 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:53.869566 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea\": container with ID starting with 22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea not found: ID does not exist" containerID="22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea" Jul 07 19:03:53.869647 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869594 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea"} err="failed to get container status \"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea\": rpc error: code = NotFound desc = could not find container \"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea\": container with ID starting with 22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea not found: ID does not exist" Jul 07 19:03:53.869647 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869616 2576 scope.go:117] "RemoveContainer" containerID="8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa" Jul 07 19:03:53.869894 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:53.869879 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa\": container with ID starting with 8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa not found: ID does not exist" containerID="8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa" Jul 07 19:03:53.869930 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869898 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa"} err="failed to get container status \"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa\": rpc error: code = NotFound desc = could not find container \"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa\": container with ID starting with 8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa not found: ID does not exist" Jul 07 19:03:53.869930 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.869911 2576 scope.go:117] "RemoveContainer" containerID="f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364" Jul 07 19:03:53.870111 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:53.870094 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364\": container with ID starting with f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364 not found: ID does not exist" containerID="f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364" Jul 07 19:03:53.870152 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870117 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364"} err="failed to get container status \"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364\": rpc error: code = NotFound desc = could not find container \"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364\": container with ID starting with f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364 not found: ID does not exist" Jul 07 19:03:53.870152 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870131 2576 scope.go:117] "RemoveContainer" containerID="f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1" Jul 07 19:03:53.870364 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:53.870347 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1\": container with ID starting with f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1 not found: ID does not exist" containerID="f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1" Jul 07 19:03:53.870419 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870369 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1"} err="failed to get container status \"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1\": rpc error: code = NotFound desc = could not find container \"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1\": container with ID starting with f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1 not found: ID does not exist" Jul 07 19:03:53.870419 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870384 2576 scope.go:117] "RemoveContainer" containerID="c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b" Jul 07 19:03:53.870594 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:53.870578 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b\": container with ID starting with c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b not found: ID does not exist" containerID="c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b" Jul 07 19:03:53.870661 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870601 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b"} err="failed to get container status \"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b\": rpc error: code = NotFound desc = could not find container \"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b\": container with ID starting with c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b not found: ID does not exist" Jul 07 19:03:53.870661 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870620 2576 scope.go:117] "RemoveContainer" containerID="43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b" Jul 07 19:03:53.870852 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870836 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b"} err="failed to get container status \"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b\": rpc error: code = NotFound desc = could not find container \"43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b\": container with ID starting with 43f2eab824ffabdbe8ea332dee3f49489fbcbc9a6003ba59c0c5357abb56316b not found: ID does not exist" Jul 07 19:03:53.870912 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.870853 2576 scope.go:117] "RemoveContainer" containerID="7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce" Jul 07 19:03:53.871064 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871048 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce"} err="failed to get container status \"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce\": rpc error: code = NotFound desc = could not find container \"7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce\": container with ID starting with 7bd628e78f8454ea628d1cb0ffcdc0737ce5ff5a709184cd9f97e2f0cfd708ce not found: ID does not exist" Jul 07 19:03:53.871124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871065 2576 scope.go:117] "RemoveContainer" containerID="22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea" Jul 07 19:03:53.871257 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871240 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea"} err="failed to get container status \"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea\": rpc error: code = NotFound desc = could not find container \"22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea\": container with ID starting with 22c9dff8199858c0d39559336cc8d726ea32b614bdfdc231ead180934b282aea not found: ID does not exist" Jul 07 19:03:53.871442 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871257 2576 scope.go:117] "RemoveContainer" containerID="8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa" Jul 07 19:03:53.871515 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871484 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa"} err="failed to get container status \"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa\": rpc error: code = NotFound desc = could not find container \"8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa\": container with ID starting with 8e696438d5bf0f8fdbb9f09590b04c01f6a984932fa8ea945b8030580f6aa1aa not found: ID does not exist" Jul 07 19:03:53.871515 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871504 2576 scope.go:117] "RemoveContainer" containerID="f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364" Jul 07 19:03:53.871722 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871702 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364"} err="failed to get container status \"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364\": rpc error: code = NotFound desc = could not find container \"f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364\": container with ID starting with f9e2c3aed62fe9d7ef38a06ad22748f8afd2de0343c614c7e246116bd5e86364 not found: ID does not exist" Jul 07 19:03:53.871722 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871721 2576 scope.go:117] "RemoveContainer" containerID="f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1" Jul 07 19:03:53.871964 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871949 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1"} err="failed to get container status \"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1\": rpc error: code = NotFound desc = could not find container \"f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1\": container with ID starting with f09ff8e91079cc819d9b93af03b24983389a13ad020111ff8e64b1c76b52e4c1 not found: ID does not exist" Jul 07 19:03:53.872015 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.871964 2576 scope.go:117] "RemoveContainer" containerID="c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b" Jul 07 19:03:53.872214 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.872197 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b"} err="failed to get container status \"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b\": rpc error: code = NotFound desc = could not find container \"c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b\": container with ID starting with c1f32aba5b2057635899e208d1b2aae92f1a70c411e52b823ef0e5b4f8b9a31b not found: ID does not exist" Jul 07 19:03:53.906372 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906350 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:03:53.906727 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906712 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="alertmanager" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906730 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="alertmanager" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906740 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906747 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906759 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-metric" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906764 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-metric" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906777 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="326b6794-7c42-4da6-ab04-a314ae318bed" containerName="registry" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906785 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="326b6794-7c42-4da6-ab04-a314ae318bed" containerName="registry" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906799 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-web" Jul 07 19:03:53.906805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906806 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-web" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906827 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="config-reloader" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906833 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="config-reloader" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906839 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="prom-label-proxy" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906844 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="prom-label-proxy" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906853 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="init-config-reloader" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906863 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="init-config-reloader" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906922 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="326b6794-7c42-4da6-ab04-a314ae318bed" containerName="registry" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906933 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-metric" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906945 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="alertmanager" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906954 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy-web" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906961 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="config-reloader" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906970 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="prom-label-proxy" Jul 07 19:03:53.907116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.906979 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" containerName="kube-rbac-proxy" Jul 07 19:03:53.911259 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.911244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.914269 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.914249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 19:03:53.914490 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.914477 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 19:03:53.914710 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.914693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 19:03:53.914847 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.914832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 19:03:53.915024 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.915013 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 19:03:53.915292 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.915276 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 19:03:53.915373 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.915276 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jspcd\"" Jul 07 19:03:53.915565 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.915550 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 19:03:53.915636 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.915571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 19:03:53.922465 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.922446 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 19:03:53.929743 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.929724 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:03:53.935417 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.935394 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f030efa1-9c72-4629-b97a-2b66870e9e26" path="/var/lib/kubelet/pods/f030efa1-9c72-4629-b97a-2b66870e9e26/volumes" Jul 07 19:03:53.986872 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.986844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64334dff-6a2d-418f-9540-f9804fa4b4af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.986984 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.986881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.986984 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.986909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.986984 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.986943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64334dff-6a2d-418f-9540-f9804fa4b4af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.986984 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.986981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-config-volume\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5skbf\" (UniqueName: \"kubernetes.io/projected/64334dff-6a2d-418f-9540-f9804fa4b4af-kube-api-access-5skbf\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987205 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987205 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-web-config\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987205 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987353 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64334dff-6a2d-418f-9540-f9804fa4b4af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987353 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64334dff-6a2d-418f-9540-f9804fa4b4af-config-out\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:53.987353 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:53.987255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64334dff-6a2d-418f-9540-f9804fa4b4af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088066 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.087997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64334dff-6a2d-418f-9540-f9804fa4b4af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088066 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-config-volume\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088225 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088225 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5skbf\" (UniqueName: \"kubernetes.io/projected/64334dff-6a2d-418f-9540-f9804fa4b4af-kube-api-access-5skbf\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088225 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088225 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-web-config\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64334dff-6a2d-418f-9540-f9804fa4b4af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64334dff-6a2d-418f-9540-f9804fa4b4af-config-out\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64334dff-6a2d-418f-9540-f9804fa4b4af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64334dff-6a2d-418f-9540-f9804fa4b4af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.088447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.088440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.090023 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.089587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64334dff-6a2d-418f-9540-f9804fa4b4af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.090023 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.089830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64334dff-6a2d-418f-9540-f9804fa4b4af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.090838 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.090809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64334dff-6a2d-418f-9540-f9804fa4b4af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.091376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.091316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.091503 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.091468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.091711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.091566 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.091711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.091623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-web-config\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.091843 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.091821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64334dff-6a2d-418f-9540-f9804fa4b4af-config-out\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.091943 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.091825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-config-volume\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.092041 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.092025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64334dff-6a2d-418f-9540-f9804fa4b4af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.092916 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.092900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.093189 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.093170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64334dff-6a2d-418f-9540-f9804fa4b4af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.096540 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.096522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5skbf\" (UniqueName: \"kubernetes.io/projected/64334dff-6a2d-418f-9540-f9804fa4b4af-kube-api-access-5skbf\") pod \"alertmanager-main-0\" (UID: \"64334dff-6a2d-418f-9540-f9804fa4b4af\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.219956 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.219927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 19:03:54.364931 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.364865 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 19:03:54.367227 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:03:54.367205 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64334dff_6a2d_418f_9540_f9804fa4b4af.slice/crio-8d1b269d8d257c0663b45f759cf5226ca3a906772db99a470f4404e0380f12b7 WatchSource:0}: Error finding container 8d1b269d8d257c0663b45f759cf5226ca3a906772db99a470f4404e0380f12b7: Status 404 returned error can't find the container with id 8d1b269d8d257c0663b45f759cf5226ca3a906772db99a470f4404e0380f12b7 Jul 07 19:03:54.820437 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.820408 2576 generic.go:356] "Generic (PLEG): container finished" podID="64334dff-6a2d-418f-9540-f9804fa4b4af" containerID="bb32222c5402301e15da1db60c7d0e6545bb5445f17cce7099c99066357b1f28" exitCode=0 Jul 07 19:03:54.820775 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.820463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerDied","Data":"bb32222c5402301e15da1db60c7d0e6545bb5445f17cce7099c99066357b1f28"} Jul 07 19:03:54.820775 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:54.820541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerStarted","Data":"8d1b269d8d257c0663b45f759cf5226ca3a906772db99a470f4404e0380f12b7"} Jul 07 19:03:55.834346 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:55.834110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerStarted","Data":"041441880a36db3a0164237959e45efa583af7c5e346e1052799155a64f762d9"} Jul 07 19:03:55.834346 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:55.834222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerStarted","Data":"a8a169d4594b8b1833b81003096fb045638ae6f11435bc44dbab3b149e4a3848"} Jul 07 19:03:55.834346 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:55.834262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerStarted","Data":"03384ad2ccff088f65c2da4d1fe2d6e512ece9c926144dd5e7d5a6616c6ba604"} Jul 07 19:03:55.834346 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:55.834290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerStarted","Data":"39c5be8af01095f0f424e599518c81c30f1d39d343fb65eb49683c36b07bd91d"} Jul 07 19:03:55.834346 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:55.834346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerStarted","Data":"f46df35b507f7406d3a9ebdea03d067c049f5ada4def64e6385fa49d9a02cd95"} Jul 07 19:03:55.834998 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:55.834376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64334dff-6a2d-418f-9540-f9804fa4b4af","Type":"ContainerStarted","Data":"2d79efabe3c30c5672bf232be7b6e38efdb1820fa944ca77676c77a4a0fc9fd9"} Jul 07 19:03:55.866864 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:55.866816 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.848594921 podStartE2EDuration="2.866800371s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.20545ms" isStatefulPod=false podCreationTimestamp="2026-07-07 19:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:03:55.864805988 +0000 UTC m=+172.455572204" watchObservedRunningTime="2026-07-07 19:03:55.866800371 +0000 UTC m=+172.457566584" Jul 07 19:03:56.190784 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.190712 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:03:56.191228 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.190995 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="prometheus" containerID="cri-o://73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" gracePeriod=600 Jul 07 19:03:56.191228 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.191050 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy" containerID="cri-o://0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" gracePeriod=600 Jul 07 19:03:56.191228 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.191106 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-web" containerID="cri-o://31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" gracePeriod=600 Jul 07 19:03:56.191228 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.191124 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="config-reloader" containerID="cri-o://b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" gracePeriod=600 Jul 07 19:03:56.191228 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.191065 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-thanos" containerID="cri-o://69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" gracePeriod=600 Jul 07 19:03:56.191228 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.191063 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="thanos-sidecar" containerID="cri-o://0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" gracePeriod=600 Jul 07 19:03:56.437526 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.437502 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:56.508057 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.507982 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-1\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508057 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508021 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-web-config\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508057 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508051 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-0\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508391 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508087 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508391 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-2\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508391 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508354 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-kube-rbac-proxy\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508391 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508382 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-tls\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508408 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:56.508591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508429 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-serving-certs-ca-bundle\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508467 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-tls-assets\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508493 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-thanos-prometheus-http-client-file\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508525 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-db\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508550 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config-out\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508577 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-metrics-client-certs\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508604 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-grpc-tls\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508632 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-trusted-ca-bundle\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508699 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508716 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508743 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-kubelet-serving-ca-bundle\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508778 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-metrics-client-ca\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.508921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.508831 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbbzl\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-kube-api-access-xbbzl\") pod \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\" (UID: \"e3298c28-e492-4cf6-bcbf-e327f0a5d991\") " Jul 07 19:03:56.509296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.509051 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:56.509296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.509170 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.509296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.509189 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.509296 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.509206 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.510469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.510154 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:56.510469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.510442 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:56.511182 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.510725 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:56.511182 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.510820 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:03:56.511182 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.510892 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.512052 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.511770 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:03:56.512950 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.512910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.513432 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.513332 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-kube-api-access-xbbzl" (OuterVolumeSpecName: "kube-api-access-xbbzl") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "kube-api-access-xbbzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:03:56.513432 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.513345 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config-out" (OuterVolumeSpecName: "config-out") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:03:56.513432 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.513424 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.513702 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.513489 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.513898 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.513854 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config" (OuterVolumeSpecName: "config") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.514150 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.514115 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.514384 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.514359 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.514857 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.514830 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.515305 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.515286 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:03:56.524365 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.524345 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-web-config" (OuterVolumeSpecName: "web-config") pod "e3298c28-e492-4cf6-bcbf-e327f0a5d991" (UID: "e3298c28-e492-4cf6-bcbf-e327f0a5d991"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:03:56.610436 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610415 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-web-config\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610436 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610434 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610445 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610455 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-kube-rbac-proxy\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610464 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610474 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-tls-assets\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610482 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610490 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-k8s-db\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610498 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config-out\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610507 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-metrics-client-certs\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610516 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-grpc-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610524 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610532 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-config\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610540 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610548 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3298c28-e492-4cf6-bcbf-e327f0a5d991-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610557 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3298c28-e492-4cf6-bcbf-e327f0a5d991-configmap-metrics-client-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.610932 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.610566 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbbzl\" (UniqueName: \"kubernetes.io/projected/e3298c28-e492-4cf6-bcbf-e327f0a5d991-kube-api-access-xbbzl\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:03:56.841473 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841446 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" exitCode=0 Jul 07 19:03:56.841473 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841470 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" exitCode=0 Jul 07 19:03:56.841473 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841477 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" exitCode=0 Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841482 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" exitCode=0 Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841487 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" exitCode=0 Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841493 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" exitCode=0 Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841528 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841548 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841674 2576 scope.go:117] "RemoveContainer" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} Jul 07 19:03:56.841892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.841747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3298c28-e492-4cf6-bcbf-e327f0a5d991","Type":"ContainerDied","Data":"fbc3bd6ccefd1aec7b38b13b53df70c2cca9d6a27fb032717ff4fca21027cf3b"} Jul 07 19:03:56.850115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.850095 2576 scope.go:117] "RemoveContainer" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.858223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.858209 2576 scope.go:117] "RemoveContainer" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.865150 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.865134 2576 scope.go:117] "RemoveContainer" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.870456 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.870438 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:03:56.874930 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.874908 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:03:56.875715 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.875702 2576 scope.go:117] "RemoveContainer" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.882763 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.882746 2576 scope.go:117] "RemoveContainer" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.890203 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.890180 2576 scope.go:117] "RemoveContainer" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.897011 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.896997 2576 scope.go:117] "RemoveContainer" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.897266 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:56.897249 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": container with ID starting with 69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147 not found: ID does not exist" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.897309 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.897274 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} err="failed to get container status \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": rpc error: code = NotFound desc = could not find container \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": container with ID starting with 69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147 not found: ID does not exist" Jul 07 19:03:56.897309 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.897292 2576 scope.go:117] "RemoveContainer" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.897559 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:56.897544 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": container with ID starting with 0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1 not found: ID does not exist" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.897601 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.897565 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} err="failed to get container status \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": rpc error: code = NotFound desc = could not find container \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": container with ID starting with 0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1 not found: ID does not exist" Jul 07 19:03:56.897601 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.897580 2576 scope.go:117] "RemoveContainer" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.897818 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:56.897801 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": container with ID starting with 31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6 not found: ID does not exist" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.897878 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.897828 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} err="failed to get container status \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": rpc error: code = NotFound desc = could not find container \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": container with ID starting with 31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6 not found: ID does not exist" Jul 07 19:03:56.897878 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.897849 2576 scope.go:117] "RemoveContainer" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.898077 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:56.898061 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": container with ID starting with 0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6 not found: ID does not exist" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.898114 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898081 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} err="failed to get container status \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": rpc error: code = NotFound desc = could not find container \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": container with ID starting with 0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6 not found: ID does not exist" Jul 07 19:03:56.898114 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898096 2576 scope.go:117] "RemoveContainer" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.898301 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:56.898284 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": container with ID starting with b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d not found: ID does not exist" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.898396 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898309 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} err="failed to get container status \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": rpc error: code = NotFound desc = could not find container \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": container with ID starting with b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d not found: ID does not exist" Jul 07 19:03:56.898396 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898346 2576 scope.go:117] "RemoveContainer" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.898621 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:56.898600 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": container with ID starting with 73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a not found: ID does not exist" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.898665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898626 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} err="failed to get container status \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": rpc error: code = NotFound desc = could not find container \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": container with ID starting with 73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a not found: ID does not exist" Jul 07 19:03:56.898665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898640 2576 scope.go:117] "RemoveContainer" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.898844 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:03:56.898829 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": container with ID starting with cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb not found: ID does not exist" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.898879 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898845 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb"} err="failed to get container status \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": rpc error: code = NotFound desc = could not find container \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": container with ID starting with cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb not found: ID does not exist" Jul 07 19:03:56.898879 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.898859 2576 scope.go:117] "RemoveContainer" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.899062 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899044 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} err="failed to get container status \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": rpc error: code = NotFound desc = could not find container \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": container with ID starting with 69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147 not found: ID does not exist" Jul 07 19:03:56.899105 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899065 2576 scope.go:117] "RemoveContainer" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.899241 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899226 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} err="failed to get container status \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": rpc error: code = NotFound desc = could not find container \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": container with ID starting with 0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1 not found: ID does not exist" Jul 07 19:03:56.899283 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899242 2576 scope.go:117] "RemoveContainer" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.899442 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899425 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} err="failed to get container status \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": rpc error: code = NotFound desc = could not find container \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": container with ID starting with 31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6 not found: ID does not exist" Jul 07 19:03:56.899490 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899442 2576 scope.go:117] "RemoveContainer" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.899616 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899599 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} err="failed to get container status \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": rpc error: code = NotFound desc = could not find container \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": container with ID starting with 0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6 not found: ID does not exist" Jul 07 19:03:56.899669 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899615 2576 scope.go:117] "RemoveContainer" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.899832 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899815 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} err="failed to get container status \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": rpc error: code = NotFound desc = could not find container \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": container with ID starting with b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d not found: ID does not exist" Jul 07 19:03:56.899869 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.899834 2576 scope.go:117] "RemoveContainer" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.900066 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900047 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} err="failed to get container status \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": rpc error: code = NotFound desc = could not find container \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": container with ID starting with 73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a not found: ID does not exist" Jul 07 19:03:56.900066 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900065 2576 scope.go:117] "RemoveContainer" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.900276 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900260 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb"} err="failed to get container status \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": rpc error: code = NotFound desc = could not find container \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": container with ID starting with cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb not found: ID does not exist" Jul 07 19:03:56.900276 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900274 2576 scope.go:117] "RemoveContainer" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.900498 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900479 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} err="failed to get container status \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": rpc error: code = NotFound desc = could not find container \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": container with ID starting with 69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147 not found: ID does not exist" Jul 07 19:03:56.900556 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900499 2576 scope.go:117] "RemoveContainer" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.900681 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900659 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} err="failed to get container status \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": rpc error: code = NotFound desc = could not find container \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": container with ID starting with 0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1 not found: ID does not exist" Jul 07 19:03:56.900716 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900683 2576 scope.go:117] "RemoveContainer" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.900898 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900878 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} err="failed to get container status \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": rpc error: code = NotFound desc = could not find container \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": container with ID starting with 31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6 not found: ID does not exist" Jul 07 19:03:56.900956 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.900901 2576 scope.go:117] "RemoveContainer" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.901115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901101 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} err="failed to get container status \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": rpc error: code = NotFound desc = could not find container \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": container with ID starting with 0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6 not found: ID does not exist" Jul 07 19:03:56.901162 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901116 2576 scope.go:117] "RemoveContainer" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.901389 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901370 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} err="failed to get container status \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": rpc error: code = NotFound desc = could not find container \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": container with ID starting with b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d not found: ID does not exist" Jul 07 19:03:56.901447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901390 2576 scope.go:117] "RemoveContainer" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.901616 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901598 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} err="failed to get container status \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": rpc error: code = NotFound desc = could not find container \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": container with ID starting with 73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a not found: ID does not exist" Jul 07 19:03:56.901682 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901618 2576 scope.go:117] "RemoveContainer" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.901863 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901847 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb"} err="failed to get container status \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": rpc error: code = NotFound desc = could not find container \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": container with ID starting with cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb not found: ID does not exist" Jul 07 19:03:56.901909 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.901864 2576 scope.go:117] "RemoveContainer" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.902052 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902037 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} err="failed to get container status \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": rpc error: code = NotFound desc = could not find container \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": container with ID starting with 69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147 not found: ID does not exist" Jul 07 19:03:56.902088 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902052 2576 scope.go:117] "RemoveContainer" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.902291 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902273 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} err="failed to get container status \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": rpc error: code = NotFound desc = could not find container \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": container with ID starting with 0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1 not found: ID does not exist" Jul 07 19:03:56.902359 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902291 2576 scope.go:117] "RemoveContainer" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.902561 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902539 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} err="failed to get container status \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": rpc error: code = NotFound desc = could not find container \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": container with ID starting with 31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6 not found: ID does not exist" Jul 07 19:03:56.902637 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902565 2576 scope.go:117] "RemoveContainer" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.902833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902816 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} err="failed to get container status \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": rpc error: code = NotFound desc = could not find container \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": container with ID starting with 0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6 not found: ID does not exist" Jul 07 19:03:56.902876 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.902834 2576 scope.go:117] "RemoveContainer" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.903055 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.903037 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} err="failed to get container status \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": rpc error: code = NotFound desc = could not find container \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": container with ID starting with b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d not found: ID does not exist" Jul 07 19:03:56.903133 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.903057 2576 scope.go:117] "RemoveContainer" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.903378 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.903357 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} err="failed to get container status \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": rpc error: code = NotFound desc = could not find container \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": container with ID starting with 73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a not found: ID does not exist" Jul 07 19:03:56.903378 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.903379 2576 scope.go:117] "RemoveContainer" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.903724 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.903703 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb"} err="failed to get container status \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": rpc error: code = NotFound desc = could not find container \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": container with ID starting with cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb not found: ID does not exist" Jul 07 19:03:56.903809 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.903727 2576 scope.go:117] "RemoveContainer" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.904153 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904133 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} err="failed to get container status \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": rpc error: code = NotFound desc = could not find container \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": container with ID starting with 69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147 not found: ID does not exist" Jul 07 19:03:56.904247 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904154 2576 scope.go:117] "RemoveContainer" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.904440 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904419 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} err="failed to get container status \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": rpc error: code = NotFound desc = could not find container \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": container with ID starting with 0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1 not found: ID does not exist" Jul 07 19:03:56.904493 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904440 2576 scope.go:117] "RemoveContainer" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.904678 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904660 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} err="failed to get container status \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": rpc error: code = NotFound desc = could not find container \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": container with ID starting with 31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6 not found: ID does not exist" Jul 07 19:03:56.904725 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904681 2576 scope.go:117] "RemoveContainer" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.904902 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904881 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} err="failed to get container status \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": rpc error: code = NotFound desc = could not find container \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": container with ID starting with 0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6 not found: ID does not exist" Jul 07 19:03:56.904946 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.904903 2576 scope.go:117] "RemoveContainer" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.905144 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905124 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} err="failed to get container status \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": rpc error: code = NotFound desc = could not find container \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": container with ID starting with b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d not found: ID does not exist" Jul 07 19:03:56.905206 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905153 2576 scope.go:117] "RemoveContainer" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.905422 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905406 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} err="failed to get container status \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": rpc error: code = NotFound desc = could not find container \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": container with ID starting with 73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a not found: ID does not exist" Jul 07 19:03:56.905465 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905422 2576 scope.go:117] "RemoveContainer" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.905647 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905629 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:03:56.905726 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905629 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb"} err="failed to get container status \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": rpc error: code = NotFound desc = could not find container \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": container with ID starting with cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb not found: ID does not exist" Jul 07 19:03:56.905786 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905733 2576 scope.go:117] "RemoveContainer" containerID="69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147" Jul 07 19:03:56.905957 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905938 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147"} err="failed to get container status \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": rpc error: code = NotFound desc = could not find container \"69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147\": container with ID starting with 69735c46bce02afcf6e27fc6d82c79fca8af482eb19145726c44ca9fdaad7147 not found: ID does not exist" Jul 07 19:03:56.906001 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905959 2576 scope.go:117] "RemoveContainer" containerID="0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1" Jul 07 19:03:56.906001 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.905960 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="prometheus" Jul 07 19:03:56.906001 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906000 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="prometheus" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906026 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-thanos" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906032 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-thanos" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906041 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-web" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906047 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-web" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906058 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="config-reloader" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906064 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="config-reloader" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906075 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="init-config-reloader" Jul 07 19:03:56.906090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906084 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="init-config-reloader" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906096 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="thanos-sidecar" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906102 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="thanos-sidecar" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906109 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906116 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906178 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1"} err="failed to get container status \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": rpc error: code = NotFound desc = could not find container \"0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1\": container with ID starting with 0348ec7481fb1af4521facfb87b8ea0ab571299b637bda67b8fbbab0abbf7ab1 not found: ID does not exist" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906199 2576 scope.go:117] "RemoveContainer" containerID="31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906214 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="thanos-sidecar" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906225 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906232 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="prometheus" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906238 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-web" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906245 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="kube-rbac-proxy-thanos" Jul 07 19:03:56.906392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906251 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" containerName="config-reloader" Jul 07 19:03:56.906810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906456 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6"} err="failed to get container status \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": rpc error: code = NotFound desc = could not find container \"31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6\": container with ID starting with 31bb833d351e575fc738ee7579ffe9165c31c840eda8741acff16f878fd067c6 not found: ID does not exist" Jul 07 19:03:56.906810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906472 2576 scope.go:117] "RemoveContainer" containerID="0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6" Jul 07 19:03:56.906810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906641 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6"} err="failed to get container status \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": rpc error: code = NotFound desc = could not find container \"0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6\": container with ID starting with 0bb564b47b944b16055062a5313b17c663fffed7524732b55eb8e222120f23a6 not found: ID does not exist" Jul 07 19:03:56.906810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906656 2576 scope.go:117] "RemoveContainer" containerID="b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d" Jul 07 19:03:56.906938 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906869 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d"} err="failed to get container status \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": rpc error: code = NotFound desc = could not find container \"b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d\": container with ID starting with b5baf64a75b210cab6bf07427648e6a36e71aa69fefccf7fec361441f4094c9d not found: ID does not exist" Jul 07 19:03:56.906938 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.906886 2576 scope.go:117] "RemoveContainer" containerID="73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a" Jul 07 19:03:56.907137 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.907113 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a"} err="failed to get container status \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": rpc error: code = NotFound desc = could not find container \"73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a\": container with ID starting with 73ba4bf39b8cd5f1d570ee74d01183c2efcdddbe8ac50cd1e5a07bb1b473891a not found: ID does not exist" Jul 07 19:03:56.907190 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.907139 2576 scope.go:117] "RemoveContainer" containerID="cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb" Jul 07 19:03:56.907398 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.907380 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb"} err="failed to get container status \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": rpc error: code = NotFound desc = could not find container \"cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb\": container with ID starting with cff277e4bf3e3d4a5239d2bb3567cee4bffa5e645b3ca82b59d654320952b4eb not found: ID does not exist" Jul 07 19:03:56.909789 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.909775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:56.913221 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.913204 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 19:03:56.913314 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.913226 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 19:03:56.913524 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.913503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 19:03:56.913672 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.913657 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mzvs6\"" Jul 07 19:03:56.913757 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.913742 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 19:03:56.913958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.913939 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 19:03:56.914281 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.914263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 19:03:56.914906 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.914888 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 19:03:56.914990 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.914958 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 19:03:56.915145 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.915131 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-16rvi88dd0lnk\"" Jul 07 19:03:56.915216 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.915164 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 19:03:56.915531 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.915517 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 19:03:56.915948 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.915931 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 19:03:56.918620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.918603 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 19:03:56.918942 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.918928 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 19:03:56.923076 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.923058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 19:03:56.934601 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:56.934583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:03:57.014139 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014139 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6hw\" (UniqueName: \"kubernetes.io/projected/36989d3c-0aa4-4e88-87df-7a09d78859f4-kube-api-access-vc6hw\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36989d3c-0aa4-4e88-87df-7a09d78859f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-config\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.014828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.014664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36989d3c-0aa4-4e88-87df-7a09d78859f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115474 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6hw\" (UniqueName: \"kubernetes.io/projected/36989d3c-0aa4-4e88-87df-7a09d78859f4-kube-api-access-vc6hw\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115474 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115474 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115474 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36989d3c-0aa4-4e88-87df-7a09d78859f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.115779 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-config\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.115999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36989d3c-0aa4-4e88-87df-7a09d78859f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116485 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116485 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116485 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116485 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116675 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116675 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.116775 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.116700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.119054 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.118932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.119054 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.118979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.119229 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.119144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.120088 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.119639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36989d3c-0aa4-4e88-87df-7a09d78859f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.120088 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.119740 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.120088 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.120037 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-config\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.120303 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.120096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.120303 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.120237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.120781 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.120757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.120982 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.120963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.121657 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.121637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.121816 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.121796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36989d3c-0aa4-4e88-87df-7a09d78859f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.122048 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.122030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36989d3c-0aa4-4e88-87df-7a09d78859f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.122206 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.122190 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36989d3c-0aa4-4e88-87df-7a09d78859f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.125046 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.125024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6hw\" (UniqueName: \"kubernetes.io/projected/36989d3c-0aa4-4e88-87df-7a09d78859f4-kube-api-access-vc6hw\") pod \"prometheus-k8s-0\" (UID: \"36989d3c-0aa4-4e88-87df-7a09d78859f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.220028 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.219981 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:03:57.372024 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.371993 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 19:03:57.373738 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:03:57.373713 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36989d3c_0aa4_4e88_87df_7a09d78859f4.slice/crio-680d2081358c0bfcc9efc433eeed9927b199ecb4e2014845a896c524fc702caa WatchSource:0}: Error finding container 680d2081358c0bfcc9efc433eeed9927b199ecb4e2014845a896c524fc702caa: Status 404 returned error can't find the container with id 680d2081358c0bfcc9efc433eeed9927b199ecb4e2014845a896c524fc702caa Jul 07 19:03:57.848453 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.848422 2576 generic.go:356] "Generic (PLEG): container finished" podID="36989d3c-0aa4-4e88-87df-7a09d78859f4" containerID="5747c26ad66704dcff078ba30fd036da114f759da0554fef71355a40d96bcdb8" exitCode=0 Jul 07 19:03:57.848789 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.848483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerDied","Data":"5747c26ad66704dcff078ba30fd036da114f759da0554fef71355a40d96bcdb8"} Jul 07 19:03:57.848789 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.848530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerStarted","Data":"680d2081358c0bfcc9efc433eeed9927b199ecb4e2014845a896c524fc702caa"} Jul 07 19:03:57.935676 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:57.935651 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3298c28-e492-4cf6-bcbf-e327f0a5d991" path="/var/lib/kubelet/pods/e3298c28-e492-4cf6-bcbf-e327f0a5d991/volumes" Jul 07 19:03:58.352382 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.352349 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:58.855371 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.855341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerStarted","Data":"e374063632fce9faa5660630e0985bffc83cc60f4b281b29eac7ec23fbc1f560"} Jul 07 19:03:58.855801 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.855418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerStarted","Data":"1f9336c84eb1bec0fe736762e8a5772d6bb8445efde6271823a9efb50dccb046"} Jul 07 19:03:58.855801 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.855468 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerStarted","Data":"f260802e709f28023d787c8bf2d2f99cf5efc07d6394f39607742557359a898e"} Jul 07 19:03:58.855801 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.855511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerStarted","Data":"c0fbb40b78d91ab50e3022735934ac5dc5235bd52389e0d05a4c49a385f2966d"} Jul 07 19:03:58.855801 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.855554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerStarted","Data":"68eeaa7bd27e79d9a718756f06e0a7fedb16b6e3576536137ba1d75c562bb305"} Jul 07 19:03:58.855801 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.855594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36989d3c-0aa4-4e88-87df-7a09d78859f4","Type":"ContainerStarted","Data":"dc32f0dff934eedf49ef60aa86c0166f9da800b9542c3501b1c0ae6cec444c05"} Jul 07 19:03:58.885456 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:58.885408 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.869308788 podStartE2EDuration="2.885393075s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.084287ms" isStatefulPod=false podCreationTimestamp="2026-07-07 19:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:03:58.882658349 +0000 UTC m=+175.473424580" watchObservedRunningTime="2026-07-07 19:03:58.885393075 +0000 UTC m=+175.476159288" Jul 07 19:03:59.377124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:59.377091 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:59.477825 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:59.477795 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:59.578468 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:59.578444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:03:59.678316 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:03:59.678248 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:02.220698 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:02.220654 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:04:05.589068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:05.589033 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:16.024909 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:16.024876 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:16.126786 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:16.126751 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:16.197169 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:16.197143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:35.444890 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:35.444857 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:35.546278 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:35.546247 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:39.676887 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:39.676859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:57.221192 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:57.221160 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:04:57.236629 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:57.236604 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:04:58.121098 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:04:58.121060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 19:05:12.462690 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:12.462647 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:12.811933 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:12.811873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:16.085955 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:16.085925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:16.185333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:16.185266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:17.931909 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:17.931879 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:18.067000 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:18.066974 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:18.382686 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:18.382661 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:18.484353 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:18.484316 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:20.776435 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:20.776400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:21.204241 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:21.204206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:22.669050 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:22.669015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:22.769902 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:22.769877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:27.702041 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:27.701952 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:28.378462 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:28.378433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:29.069371 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:29.069341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:29.170304 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:29.170278 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:31.321758 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.321730 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st"] Jul 07 19:05:31.324920 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.324905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.328337 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.328307 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:05:31.328459 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.328348 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 19:05:31.328459 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.328308 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-np5mp\"" Jul 07 19:05:31.333262 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.333239 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st"] Jul 07 19:05:31.429930 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.429908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5611e0c-5d67-4385-bb07-df6124bd4858-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ph4st\" (UID: \"a5611e0c-5d67-4385-bb07-df6124bd4858\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.430025 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.429935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvm65\" (UniqueName: \"kubernetes.io/projected/a5611e0c-5d67-4385-bb07-df6124bd4858-kube-api-access-rvm65\") pod \"openshift-lws-operator-fd8ccff4c-ph4st\" (UID: \"a5611e0c-5d67-4385-bb07-df6124bd4858\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.530522 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.530499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5611e0c-5d67-4385-bb07-df6124bd4858-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ph4st\" (UID: \"a5611e0c-5d67-4385-bb07-df6124bd4858\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.530606 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.530528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvm65\" (UniqueName: \"kubernetes.io/projected/a5611e0c-5d67-4385-bb07-df6124bd4858-kube-api-access-rvm65\") pod \"openshift-lws-operator-fd8ccff4c-ph4st\" (UID: \"a5611e0c-5d67-4385-bb07-df6124bd4858\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.530806 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.530789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5611e0c-5d67-4385-bb07-df6124bd4858-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ph4st\" (UID: \"a5611e0c-5d67-4385-bb07-df6124bd4858\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.539790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.539770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvm65\" (UniqueName: \"kubernetes.io/projected/a5611e0c-5d67-4385-bb07-df6124bd4858-kube-api-access-rvm65\") pod \"openshift-lws-operator-fd8ccff4c-ph4st\" (UID: \"a5611e0c-5d67-4385-bb07-df6124bd4858\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.646576 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.646528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" Jul 07 19:05:31.774855 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:31.774832 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st"] Jul 07 19:05:31.777296 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:05:31.777270 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5611e0c_5d67_4385_bb07_df6124bd4858.slice/crio-66bcda38e5b9cf71b1133fe9d7567b53071161cd5d03c79387ae64ed47c521df WatchSource:0}: Error finding container 66bcda38e5b9cf71b1133fe9d7567b53071161cd5d03c79387ae64ed47c521df: Status 404 returned error can't find the container with id 66bcda38e5b9cf71b1133fe9d7567b53071161cd5d03c79387ae64ed47c521df Jul 07 19:05:32.246484 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:32.246457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" event={"ID":"a5611e0c-5d67-4385-bb07-df6124bd4858","Type":"ContainerStarted","Data":"66bcda38e5b9cf71b1133fe9d7567b53071161cd5d03c79387ae64ed47c521df"} Jul 07 19:05:35.261183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:35.261146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" event={"ID":"a5611e0c-5d67-4385-bb07-df6124bd4858","Type":"ContainerStarted","Data":"8423a677c5213d6db46a9a872083f31af5a1517c6b9a19d9ee1ba236649c8937"} Jul 07 19:05:35.280791 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:35.280736 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ph4st" podStartSLOduration=1.834039991 podStartE2EDuration="4.280720931s" totalImagesPullingTime="2.44668094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:05:35.278872241 +0000 UTC m=+271.869638452" watchObservedRunningTime="2026-07-07 19:05:35.280720931 +0000 UTC m=+271.871487144" Jul 07 19:05:36.100055 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:36.100022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:36.200090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:36.200063 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:37.914490 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:37.914461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:47.676146 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:47.676114 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:47.776497 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:47.776470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:50.101988 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:50.101960 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:50.202260 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:50.202232 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:50.733580 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:50.733550 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:51.254980 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.254950 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:51.353303 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.353271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:51.447677 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.447645 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb"] Jul 07 19:05:51.451150 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.451131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.454671 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.454652 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sflhs\"" Jul 07 19:05:51.455103 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.455081 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 19:05:51.455204 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.455081 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 19:05:51.455204 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.455155 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 19:05:51.455748 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.455733 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 19:05:51.486287 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.486259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb"] Jul 07 19:05:51.497675 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.497654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-webhook-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.497780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.497682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thkxg\" (UniqueName: \"kubernetes.io/projected/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-kube-api-access-thkxg\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.497780 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.497764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-manifests\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.497904 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.497814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.497904 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.497836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-tmp\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.598859 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.598837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-manifests\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.598949 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.598887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.598949 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.598907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-tmp\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.598949 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.598934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-webhook-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.599262 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.598958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thkxg\" (UniqueName: \"kubernetes.io/projected/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-kube-api-access-thkxg\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.599262 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.599207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-manifests\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.601366 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.601342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-tmp\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.601463 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.601442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-webhook-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.601541 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.601527 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.613458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.613439 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thkxg\" (UniqueName: \"kubernetes.io/projected/887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea-kube-api-access-thkxg\") pod \"opendatahub-operator-controller-manager-59996cbd9d-csvmb\" (UID: \"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.679561 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.679542 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:51.761877 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.761855 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:51.785181 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.785161 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:51.869725 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.869651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:51.913715 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.913695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb"] Jul 07 19:05:51.915760 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:05:51.915732 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887cbfc8_4fbb_4cf2_acc6_1f7ea4dd2aea.slice/crio-439507a72083be499aa0d351c9c095adcbf3ec39edc77dbcd322bb1c04ada21f WatchSource:0}: Error finding container 439507a72083be499aa0d351c9c095adcbf3ec39edc77dbcd322bb1c04ada21f: Status 404 returned error can't find the container with id 439507a72083be499aa0d351c9c095adcbf3ec39edc77dbcd322bb1c04ada21f Jul 07 19:05:51.952716 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:51.952694 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:52.053897 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:52.053875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:52.153310 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:52.153232 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:52.333886 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:52.333859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" event={"ID":"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea","Type":"ContainerStarted","Data":"439507a72083be499aa0d351c9c095adcbf3ec39edc77dbcd322bb1c04ada21f"} Jul 07 19:05:55.349238 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:55.349171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" event={"ID":"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea","Type":"ContainerStarted","Data":"86b33de1aab2f161b6691a3f3e0e6a647dc54a40525e1a1a862498e687b46099"} Jul 07 19:05:56.355127 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:56.355096 2576 generic.go:356] "Generic (PLEG): container finished" podID="887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea" containerID="86b33de1aab2f161b6691a3f3e0e6a647dc54a40525e1a1a862498e687b46099" exitCode=0 Jul 07 19:05:56.355469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:56.355152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" event={"ID":"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea","Type":"ContainerDied","Data":"86b33de1aab2f161b6691a3f3e0e6a647dc54a40525e1a1a862498e687b46099"} Jul 07 19:05:57.364714 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:57.364681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" event={"ID":"887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea","Type":"ContainerStarted","Data":"d5935795609e3b2a5a218a9509243131d7904880263f392ace1d5b21b4e4df6a"} Jul 07 19:05:57.365130 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:57.364798 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:05:57.388134 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:05:57.388072 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" podStartSLOduration=1.706679169 podStartE2EDuration="6.388053159s" totalImagesPullingTime="3.609695543s" totalInitContainerRuntime="1.071678447s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:05:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:05:57.387945105 +0000 UTC m=+293.978711340" watchObservedRunningTime="2026-07-07 19:05:57.388053159 +0000 UTC m=+293.978819373" Jul 07 19:06:00.120199 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:00.120152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:00.223887 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:00.223839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:03.810186 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:03.810156 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:06:03.811858 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:03.811832 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:06:03.820178 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:03.820159 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 19:06:08.371803 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:08.371774 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-csvmb" Jul 07 19:06:10.323542 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:10.323506 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:11.522003 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:11.521962 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:11.624912 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:11.624869 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:11.866712 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:11.866675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:11.966362 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:11.966313 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:12.075234 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:12.075206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:12.933523 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:12.933494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:12.995817 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:12.995790 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:13.988049 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:13.988020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:16.949960 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:16.949925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:17.098444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:17.098414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:17.987963 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:17.987932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:18.250516 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.250435 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:18.363619 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.363587 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:18.550206 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.550177 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc"] Jul 07 19:06:18.555806 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.555784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.559411 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.559393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 19:06:18.560493 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.560479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2w9rd\"" Jul 07 19:06:18.560590 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.560572 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 19:06:18.561491 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.561476 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 19:06:18.568253 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.568233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc"] Jul 07 19:06:18.621552 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.621528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-manager-config\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.621677 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.621566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-cert\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.621677 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.621595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-metrics-cert\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.621775 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.621722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx6rs\" (UniqueName: \"kubernetes.io/projected/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-kube-api-access-sx6rs\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.722387 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.722358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx6rs\" (UniqueName: \"kubernetes.io/projected/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-kube-api-access-sx6rs\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.722526 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.722436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-manager-config\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.722526 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.722464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-cert\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.722526 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.722487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-metrics-cert\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.723048 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.723027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-manager-config\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.725053 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.725031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-metrics-cert\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.725134 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.725099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-cert\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.738118 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.738089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx6rs\" (UniqueName: \"kubernetes.io/projected/ec2371d0-481d-4fc0-b835-bffa93f2e2b8-kube-api-access-sx6rs\") pod \"lws-controller-manager-6c8bfdd549-krxlc\" (UID: \"ec2371d0-481d-4fc0-b835-bffa93f2e2b8\") " pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.865936 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.865860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:18.997682 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:18.997620 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc"] Jul 07 19:06:19.001369 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:06:19.001346 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2371d0_481d_4fc0_b835_bffa93f2e2b8.slice/crio-624316b3454ca619dc7e44d32396ce9b43bbbc8adb17c4bd0fc2d6be458c68b1 WatchSource:0}: Error finding container 624316b3454ca619dc7e44d32396ce9b43bbbc8adb17c4bd0fc2d6be458c68b1: Status 404 returned error can't find the container with id 624316b3454ca619dc7e44d32396ce9b43bbbc8adb17c4bd0fc2d6be458c68b1 Jul 07 19:06:19.003240 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.003222 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:06:19.468641 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.468606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" event={"ID":"ec2371d0-481d-4fc0-b835-bffa93f2e2b8","Type":"ContainerStarted","Data":"624316b3454ca619dc7e44d32396ce9b43bbbc8adb17c4bd0fc2d6be458c68b1"} Jul 07 19:06:19.837675 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.837642 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k"] Jul 07 19:06:19.840181 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.840154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:19.845521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.845494 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 19:06:19.845521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.845517 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 19:06:19.845754 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.845665 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 19:06:19.845969 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.845939 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2gpc4\"" Jul 07 19:06:19.846494 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.846472 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 19:06:19.857550 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.857529 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k"] Jul 07 19:06:19.934362 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.934340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:19.934362 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.934371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh49t\" (UniqueName: \"kubernetes.io/projected/bbf45b19-d725-4a45-99a4-c056f2d373fb-kube-api-access-fh49t\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:19.934557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.934397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:19.934557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.934417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:19.934557 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.934432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:19.934684 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.934590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf45b19-d725-4a45-99a4-c056f2d373fb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:19.934684 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:19.934631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.035937 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.035906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf45b19-d725-4a45-99a4-c056f2d373fb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.036413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.035959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.036413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.036065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.036413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.036096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh49t\" (UniqueName: \"kubernetes.io/projected/bbf45b19-d725-4a45-99a4-c056f2d373fb-kube-api-access-fh49t\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.036413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.036134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.036413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.036171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.036413 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.036194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.037132 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.037115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.038729 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.038702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf45b19-d725-4a45-99a4-c056f2d373fb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.039230 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.039200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.039472 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.039429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.040256 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.040226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.055973 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.055785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf45b19-d725-4a45-99a4-c056f2d373fb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.055973 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.055947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh49t\" (UniqueName: \"kubernetes.io/projected/bbf45b19-d725-4a45-99a4-c056f2d373fb-kube-api-access-fh49t\") pod \"istiod-openshift-gateway-94bb8fbfd-q557k\" (UID: \"bbf45b19-d725-4a45-99a4-c056f2d373fb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.153200 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.153121 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:20.308543 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.308518 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k"] Jul 07 19:06:20.310808 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:06:20.310775 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf45b19_d725_4a45_99a4_c056f2d373fb.slice/crio-8c3c95b236ffd5b94a94ecfc7592e4c0b0867a43e6608b3a164847ea0220ede5 WatchSource:0}: Error finding container 8c3c95b236ffd5b94a94ecfc7592e4c0b0867a43e6608b3a164847ea0220ede5: Status 404 returned error can't find the container with id 8c3c95b236ffd5b94a94ecfc7592e4c0b0867a43e6608b3a164847ea0220ede5 Jul 07 19:06:20.475794 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:20.475725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" event={"ID":"bbf45b19-d725-4a45-99a4-c056f2d373fb","Type":"ContainerStarted","Data":"8c3c95b236ffd5b94a94ecfc7592e4c0b0867a43e6608b3a164847ea0220ede5"} Jul 07 19:06:21.485342 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:21.485293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" event={"ID":"ec2371d0-481d-4fc0-b835-bffa93f2e2b8","Type":"ContainerStarted","Data":"49ad87a84b915874f06f3ccf2f826c7ad6a26ae5fa475101ed871f7a3a8304ad"} Jul 07 19:06:21.485892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:21.485541 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:21.508092 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:21.508034 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" podStartSLOduration=1.663372332 podStartE2EDuration="3.508012847s" totalImagesPullingTime="1.844640515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:21.50628326 +0000 UTC m=+318.097049474" watchObservedRunningTime="2026-07-07 19:06:21.508012847 +0000 UTC m=+318.098779061" Jul 07 19:06:21.530694 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:21.530664 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:21.624152 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:21.624093 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:21.720067 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:21.720036 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:21.897315 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:21.897279 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:22.017000 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:22.016955 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:22.130592 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:22.130562 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:23.209096 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:23.209059 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 19:06:23.209411 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:23.209122 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 19:06:23.498880 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:23.498792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" event={"ID":"bbf45b19-d725-4a45-99a4-c056f2d373fb","Type":"ContainerStarted","Data":"f172cd63c2df1f19994f4f2424322d285f16e2ace4b1fff5e9ed123131f6be84"} Jul 07 19:06:23.499062 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:23.498893 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:23.531371 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:23.531299 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" podStartSLOduration=1.6354279379999999 podStartE2EDuration="4.531279695s" totalImagesPullingTime="2.895851757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:23.524951788 +0000 UTC m=+320.115718001" watchObservedRunningTime="2026-07-07 19:06:23.531279695 +0000 UTC m=+320.122045908" Jul 07 19:06:24.505170 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:24.505142 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q557k" Jul 07 19:06:32.492896 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:32.492867 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c8bfdd549-krxlc" Jul 07 19:06:56.168576 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:56.168506 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:57.917692 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:57.917659 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:06:58.019236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:06:58.019182 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:00.279636 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:00.279608 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:11.870639 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:11.870560 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:11.967910 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:11.967888 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:12.059437 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:12.059405 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:40.257269 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:40.257240 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:40.862562 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:40.862527 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:41.914505 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:41.914465 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:42.010020 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:42.009984 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:45.481376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:45.481314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:45.955232 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:45.955178 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:49.490983 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:49.490951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:49.721446 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:49.721414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:52.722681 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:52.722648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:52.881090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:52.881042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:56.534017 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:56.533971 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:56.632134 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:56.632086 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:07:56.731994 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:07:56.731964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:00.085021 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:00.084988 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:00.184971 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:00.184941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:00.682081 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:00.682056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:00.760613 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:00.760591 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:01.329865 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:01.329829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:04.494587 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:04.494554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:04.561914 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:04.561860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:08.299725 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:08.299692 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:08.507870 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:08.507828 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:08.609414 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:08.609351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:12.078132 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:12.078101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:12.179510 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:12.179475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:15.777294 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:15.777258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:18.859812 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.859784 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs"] Jul 07 19:08:18.863169 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.863155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:18.866248 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.866220 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 19:08:18.866399 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.866315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8zk2w\"" Jul 07 19:08:18.866471 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.866427 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 19:08:18.877376 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.877353 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs"] Jul 07 19:08:18.928611 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.928579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6nxv\" (UniqueName: \"kubernetes.io/projected/f8042824-736b-41b9-9d9c-5424ad59a967-kube-api-access-d6nxv\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:18.928719 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:18.928639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8042824-736b-41b9-9d9c-5424ad59a967-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:19.029025 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.029004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8042824-736b-41b9-9d9c-5424ad59a967-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:19.029133 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.029077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6nxv\" (UniqueName: \"kubernetes.io/projected/f8042824-736b-41b9-9d9c-5424ad59a967-kube-api-access-d6nxv\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:19.029384 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.029369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8042824-736b-41b9-9d9c-5424ad59a967-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:19.041088 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.041071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6nxv\" (UniqueName: \"kubernetes.io/projected/f8042824-736b-41b9-9d9c-5424ad59a967-kube-api-access-d6nxv\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:19.173815 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.173763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:19.214653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.214630 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs"] Jul 07 19:08:19.221287 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.221265 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs"] Jul 07 19:08:19.236132 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.236098 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn"] Jul 07 19:08:19.239502 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.239484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.263275 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.263231 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn"] Jul 07 19:08:19.332398 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.332373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt8q9\" (UniqueName: \"kubernetes.io/projected/b7423717-e9ed-42b5-82ac-25c7c77e52f0-kube-api-access-xt8q9\") pod \"kuadrant-operator-controller-manager-55467d9f7-wg7pn\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.332534 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.332411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7423717-e9ed-42b5-82ac-25c7c77e52f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wg7pn\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.432950 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.432891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt8q9\" (UniqueName: \"kubernetes.io/projected/b7423717-e9ed-42b5-82ac-25c7c77e52f0-kube-api-access-xt8q9\") pod \"kuadrant-operator-controller-manager-55467d9f7-wg7pn\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.432950 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.432927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7423717-e9ed-42b5-82ac-25c7c77e52f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wg7pn\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.433358 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.433343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7423717-e9ed-42b5-82ac-25c7c77e52f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-wg7pn\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.443937 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.443913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt8q9\" (UniqueName: \"kubernetes.io/projected/b7423717-e9ed-42b5-82ac-25c7c77e52f0-kube-api-access-xt8q9\") pod \"kuadrant-operator-controller-manager-55467d9f7-wg7pn\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.549983 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.549961 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:19.701683 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:19.701613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn"] Jul 07 19:08:19.705006 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:08:19.704982 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7423717_e9ed_42b5_82ac_25c7c77e52f0.slice/crio-af57ae7c20ff20d15af612c0e04143e2473a715ded6a201688d29168a54ec46e WatchSource:0}: Error finding container af57ae7c20ff20d15af612c0e04143e2473a715ded6a201688d29168a54ec46e: Status 404 returned error can't find the container with id af57ae7c20ff20d15af612c0e04143e2473a715ded6a201688d29168a54ec46e Jul 07 19:08:20.040264 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:20.040201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" event={"ID":"b7423717-e9ed-42b5-82ac-25c7c77e52f0","Type":"ContainerStarted","Data":"af57ae7c20ff20d15af612c0e04143e2473a715ded6a201688d29168a54ec46e"} Jul 07 19:08:20.221492 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:08:20.221463 2576 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 07 19:08:20.221492 ip-10-0-140-243 kubenswrapper[2576]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fdhvs_kuadrant-system_f8042824-736b-41b9-9d9c-5424ad59a967_0(3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fdhvs to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73" Netns:"/var/run/netns/96863169-4aa0-4a3f-b2d6-ad1a575ead98" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-fdhvs;K8S_POD_INFRA_CONTAINER_ID=3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73;K8S_POD_UID=f8042824-736b-41b9-9d9c-5424ad59a967" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs/f8042824-736b-41b9-9d9c-5424ad59a967:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs 3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs 3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-fdhvs" not found Jul 07 19:08:20.221492 ip-10-0-140-243 kubenswrapper[2576]: ' Jul 07 19:08:20.221492 ip-10-0-140-243 kubenswrapper[2576]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 07 19:08:20.221492 ip-10-0-140-243 kubenswrapper[2576]: > Jul 07 19:08:20.221684 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:08:20.221520 2576 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 07 19:08:20.221684 ip-10-0-140-243 kubenswrapper[2576]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fdhvs_kuadrant-system_f8042824-736b-41b9-9d9c-5424ad59a967_0(3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fdhvs to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73" Netns:"/var/run/netns/96863169-4aa0-4a3f-b2d6-ad1a575ead98" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-fdhvs;K8S_POD_INFRA_CONTAINER_ID=3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73;K8S_POD_UID=f8042824-736b-41b9-9d9c-5424ad59a967" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs/f8042824-736b-41b9-9d9c-5424ad59a967:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs 3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs 3b74e4523736a4de1fa4307f5f9def3458dabff613515c25059b57d2e3894a73 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-fdhvs" not found Jul 07 19:08:20.221684 ip-10-0-140-243 kubenswrapper[2576]: ' Jul 07 19:08:20.221684 ip-10-0-140-243 kubenswrapper[2576]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 07 19:08:20.221684 ip-10-0-140-243 kubenswrapper[2576]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:21.045106 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.045077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:21.051803 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.051783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:21.054862 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:08:21.054836 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" is forbidden: User \"system:node:ip-10-0-140-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-243.ec2.internal' and this object" podUID="f8042824-736b-41b9-9d9c-5424ad59a967" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:21.149808 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.149783 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6nxv\" (UniqueName: \"kubernetes.io/projected/f8042824-736b-41b9-9d9c-5424ad59a967-kube-api-access-d6nxv\") pod \"f8042824-736b-41b9-9d9c-5424ad59a967\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " Jul 07 19:08:21.149920 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.149864 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8042824-736b-41b9-9d9c-5424ad59a967-extensions-socket-volume\") pod \"f8042824-736b-41b9-9d9c-5424ad59a967\" (UID: \"f8042824-736b-41b9-9d9c-5424ad59a967\") " Jul 07 19:08:21.150142 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.150123 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8042824-736b-41b9-9d9c-5424ad59a967-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f8042824-736b-41b9-9d9c-5424ad59a967" (UID: "f8042824-736b-41b9-9d9c-5424ad59a967"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:08:21.151931 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.151909 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8042824-736b-41b9-9d9c-5424ad59a967-kube-api-access-d6nxv" (OuterVolumeSpecName: "kube-api-access-d6nxv") pod "f8042824-736b-41b9-9d9c-5424ad59a967" (UID: "f8042824-736b-41b9-9d9c-5424ad59a967"). InnerVolumeSpecName "kube-api-access-d6nxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:08:21.250515 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.250489 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6nxv\" (UniqueName: \"kubernetes.io/projected/f8042824-736b-41b9-9d9c-5424ad59a967-kube-api-access-d6nxv\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:08:21.250515 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.250513 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8042824-736b-41b9-9d9c-5424ad59a967-extensions-socket-volume\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:08:21.557233 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.557207 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:21.700639 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.700610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:21.936131 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:21.936063 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8042824-736b-41b9-9d9c-5424ad59a967" path="/var/lib/kubelet/pods/f8042824-736b-41b9-9d9c-5424ad59a967/volumes" Jul 07 19:08:22.050458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:22.050435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:22.057904 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:08:22.057874 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" is forbidden: User \"system:node:ip-10-0-140-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-243.ec2.internal' and this object" podUID="f8042824-736b-41b9-9d9c-5424ad59a967" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:22.136609 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:22.136564 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:22.259582 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:22.259516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:23.935684 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:08:23.935645 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fdhvs\" is forbidden: User \"system:node:ip-10-0-140-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-243.ec2.internal' and this object" podUID="f8042824-736b-41b9-9d9c-5424ad59a967" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdhvs" Jul 07 19:08:24.918881 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:24.918804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:25.059298 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:25.059259 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:26.071216 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:26.071183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" event={"ID":"b7423717-e9ed-42b5-82ac-25c7c77e52f0","Type":"ContainerStarted","Data":"40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee"} Jul 07 19:08:26.071523 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:26.071350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:26.100718 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:26.100672 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" podStartSLOduration=0.926638745 podStartE2EDuration="7.100658466s" totalImagesPullingTime="6.174019721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:26.097697749 +0000 UTC m=+442.688463962" watchObservedRunningTime="2026-07-07 19:08:26.100658466 +0000 UTC m=+442.691424737" Jul 07 19:08:30.377671 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:30.377645 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:30.491960 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:30.491934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:33.089180 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:33.089147 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:33.233498 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:33.233461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:37.078136 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:37.078109 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:49.715425 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:49.715392 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn"] Jul 07 19:08:49.715913 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:49.715609 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" podUID="b7423717-e9ed-42b5-82ac-25c7c77e52f0" containerName="manager" containerID="cri-o://40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee" gracePeriod=10 Jul 07 19:08:49.965220 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:49.965200 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:49.976310 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:49.976262 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7423717-e9ed-42b5-82ac-25c7c77e52f0-extensions-socket-volume\") pod \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " Jul 07 19:08:49.976445 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:49.976354 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt8q9\" (UniqueName: \"kubernetes.io/projected/b7423717-e9ed-42b5-82ac-25c7c77e52f0-kube-api-access-xt8q9\") pod \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\" (UID: \"b7423717-e9ed-42b5-82ac-25c7c77e52f0\") " Jul 07 19:08:49.976834 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:49.976810 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7423717-e9ed-42b5-82ac-25c7c77e52f0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b7423717-e9ed-42b5-82ac-25c7c77e52f0" (UID: "b7423717-e9ed-42b5-82ac-25c7c77e52f0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:08:49.978563 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:49.978544 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7423717-e9ed-42b5-82ac-25c7c77e52f0-kube-api-access-xt8q9" (OuterVolumeSpecName: "kube-api-access-xt8q9") pod "b7423717-e9ed-42b5-82ac-25c7c77e52f0" (UID: "b7423717-e9ed-42b5-82ac-25c7c77e52f0"). InnerVolumeSpecName "kube-api-access-xt8q9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:08:50.077565 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.077543 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7423717-e9ed-42b5-82ac-25c7c77e52f0-extensions-socket-volume\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:08:50.077565 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.077568 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt8q9\" (UniqueName: \"kubernetes.io/projected/b7423717-e9ed-42b5-82ac-25c7c77e52f0-kube-api-access-xt8q9\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:08:50.180722 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.180687 2576 generic.go:356] "Generic (PLEG): container finished" podID="b7423717-e9ed-42b5-82ac-25c7c77e52f0" containerID="40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee" exitCode=0 Jul 07 19:08:50.180835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.180733 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" Jul 07 19:08:50.180835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.180773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" event={"ID":"b7423717-e9ed-42b5-82ac-25c7c77e52f0","Type":"ContainerDied","Data":"40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee"} Jul 07 19:08:50.180835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.180821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn" event={"ID":"b7423717-e9ed-42b5-82ac-25c7c77e52f0","Type":"ContainerDied","Data":"af57ae7c20ff20d15af612c0e04143e2473a715ded6a201688d29168a54ec46e"} Jul 07 19:08:50.181039 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.180843 2576 scope.go:117] "RemoveContainer" containerID="40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee" Jul 07 19:08:50.192878 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.192859 2576 scope.go:117] "RemoveContainer" containerID="40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee" Jul 07 19:08:50.193126 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:08:50.193106 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee\": container with ID starting with 40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee not found: ID does not exist" containerID="40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee" Jul 07 19:08:50.193171 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.193134 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee"} err="failed to get container status \"40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee\": rpc error: code = NotFound desc = could not find container \"40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee\": container with ID starting with 40721b7adaea962266d1fb3652e56a4bbbd997d8e34b3cff58e50211f0bb8fee not found: ID does not exist" Jul 07 19:08:50.224349 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.224311 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn"] Jul 07 19:08:50.228725 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:50.228682 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-wg7pn"] Jul 07 19:08:51.941936 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:51.941902 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7423717-e9ed-42b5-82ac-25c7c77e52f0" path="/var/lib/kubelet/pods/b7423717-e9ed-42b5-82ac-25c7c77e52f0/volumes" Jul 07 19:08:53.771873 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:53.771840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:54.011280 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:08:54.011244 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:10.763117 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:10.763086 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:10.903294 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:10.903261 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:11.011783 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.011754 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:11.372421 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.372397 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:09:11.372774 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.372763 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7423717-e9ed-42b5-82ac-25c7c77e52f0" containerName="manager" Jul 07 19:09:11.372815 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.372777 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7423717-e9ed-42b5-82ac-25c7c77e52f0" containerName="manager" Jul 07 19:09:11.372856 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.372847 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7423717-e9ed-42b5-82ac-25c7c77e52f0" containerName="manager" Jul 07 19:09:11.375443 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.375429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.380218 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.380191 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 19:09:11.380218 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.380195 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 19:09:11.383546 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.383527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 19:09:11.383659 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.383529 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jqsvg\"" Jul 07 19:09:11.393958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.393926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:09:11.451890 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.451866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:09:11.455410 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.455394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73d02e81-2553-4f6c-aa80-503fafa27589-config-file\") pod \"limitador-limitador-54d6d988d5-sm4js\" (UID: \"73d02e81-2553-4f6c-aa80-503fafa27589\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.455481 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.455437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c92f\" (UniqueName: \"kubernetes.io/projected/73d02e81-2553-4f6c-aa80-503fafa27589-kube-api-access-7c92f\") pod \"limitador-limitador-54d6d988d5-sm4js\" (UID: \"73d02e81-2553-4f6c-aa80-503fafa27589\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.556178 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.556154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73d02e81-2553-4f6c-aa80-503fafa27589-config-file\") pod \"limitador-limitador-54d6d988d5-sm4js\" (UID: \"73d02e81-2553-4f6c-aa80-503fafa27589\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.556283 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.556196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c92f\" (UniqueName: \"kubernetes.io/projected/73d02e81-2553-4f6c-aa80-503fafa27589-kube-api-access-7c92f\") pod \"limitador-limitador-54d6d988d5-sm4js\" (UID: \"73d02e81-2553-4f6c-aa80-503fafa27589\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.556752 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.556735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73d02e81-2553-4f6c-aa80-503fafa27589-config-file\") pod \"limitador-limitador-54d6d988d5-sm4js\" (UID: \"73d02e81-2553-4f6c-aa80-503fafa27589\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.568153 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.568126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c92f\" (UniqueName: \"kubernetes.io/projected/73d02e81-2553-4f6c-aa80-503fafa27589-kube-api-access-7c92f\") pod \"limitador-limitador-54d6d988d5-sm4js\" (UID: \"73d02e81-2553-4f6c-aa80-503fafa27589\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.685666 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.685611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:11.852306 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.852280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:09:11.856135 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:09:11.856109 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d02e81_2553_4f6c_aa80_503fafa27589.slice/crio-ecdde9541d8b12ba39ecb14c7ce6eb346ec25050c8aa553e1b0406ca3c182ea6 WatchSource:0}: Error finding container ecdde9541d8b12ba39ecb14c7ce6eb346ec25050c8aa553e1b0406ca3c182ea6: Status 404 returned error can't find the container with id ecdde9541d8b12ba39ecb14c7ce6eb346ec25050c8aa553e1b0406ca3c182ea6 Jul 07 19:09:11.908860 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:11.908839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:12.140432 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:12.140409 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:12.283752 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:12.283723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" event={"ID":"73d02e81-2553-4f6c-aa80-503fafa27589","Type":"ContainerStarted","Data":"ecdde9541d8b12ba39ecb14c7ce6eb346ec25050c8aa553e1b0406ca3c182ea6"} Jul 07 19:09:15.299620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:15.299590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" event={"ID":"73d02e81-2553-4f6c-aa80-503fafa27589","Type":"ContainerStarted","Data":"2a6f6a787bb8b495c9f285eb174dc31048b68ff3bd13f89120708b11d0257095"} Jul 07 19:09:15.300020 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:15.299672 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:15.346403 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:15.346349 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" podStartSLOduration=1.750481218 podStartE2EDuration="4.346311246s" totalImagesPullingTime="2.595830028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:15.345136783 +0000 UTC m=+491.935902996" watchObservedRunningTime="2026-07-07 19:09:15.346311246 +0000 UTC m=+491.937077459" Jul 07 19:09:26.305408 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:26.305382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sm4js" Jul 07 19:09:32.037261 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:32.037225 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:32.144785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:32.144756 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:32.604823 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:32.604792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:45.396086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:45.396057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:45.626398 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:45.626356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:45.805347 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:45.805283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:52.326968 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:52.326935 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:52.408098 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:52.408066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:52.737051 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:52.736961 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:52.856643 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:52.856611 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:52.940172 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:52.940142 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:56.113849 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:56.113777 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:56.219709 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:09:56.219680 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:15.316785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:15.316747 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:15.380115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:15.380088 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:27.538768 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:27.538735 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:28.088179 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:28.088130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:28.223278 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:28.223247 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:28.765962 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:28.765929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:28.882680 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:28.882649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:29.121815 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:29.121786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:10:39.368339 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:39.368293 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:39.471430 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:39.471400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:48.083484 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:48.083454 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:48.449154 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:48.449083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:10:53.663469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:53.663440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:53.759962 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:53.759928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:56.195743 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.195706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff"] Jul 07 19:10:56.199299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.199276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.203697 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.203678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8m2wx\"" Jul 07 19:10:56.205141 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.205121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 19:10:56.205252 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.205141 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 19:10:56.209150 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.209133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 19:10:56.215634 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.215614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff"] Jul 07 19:10:56.239042 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.239012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.239199 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.239076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.239199 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.239139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.239392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.239233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/950de243-f634-4275-aea3-73d23bb9706c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.239392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.239288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.239392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.239360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrdbp\" (UniqueName: \"kubernetes.io/projected/950de243-f634-4275-aea3-73d23bb9706c-kube-api-access-nrdbp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.288851 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.288825 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:10:56.340785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.340762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/950de243-f634-4275-aea3-73d23bb9706c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.340888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.340789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.340888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.340819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdbp\" (UniqueName: \"kubernetes.io/projected/950de243-f634-4275-aea3-73d23bb9706c-kube-api-access-nrdbp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.340888 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.340855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.341047 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.340896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.341047 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.340922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.341248 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.341231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.341348 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.341307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.341400 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.341365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.343199 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.343181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/950de243-f634-4275-aea3-73d23bb9706c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.343502 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.343482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/950de243-f634-4275-aea3-73d23bb9706c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.355085 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.355066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrdbp\" (UniqueName: \"kubernetes.io/projected/950de243-f634-4275-aea3-73d23bb9706c-kube-api-access-nrdbp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4cff\" (UID: \"950de243-f634-4275-aea3-73d23bb9706c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.510142 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.510087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:10:56.642480 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.642452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff"] Jul 07 19:10:56.645823 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:10:56.645798 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950de243_f634_4275_aea3_73d23bb9706c.slice/crio-47bc0a3832085cdba6a98cc48d69dd2ab0b0fe4c771400f924c371fe868aa3f3 WatchSource:0}: Error finding container 47bc0a3832085cdba6a98cc48d69dd2ab0b0fe4c771400f924c371fe868aa3f3: Status 404 returned error can't find the container with id 47bc0a3832085cdba6a98cc48d69dd2ab0b0fe4c771400f924c371fe868aa3f3 Jul 07 19:10:56.783353 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.783285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" event={"ID":"950de243-f634-4275-aea3-73d23bb9706c","Type":"ContainerStarted","Data":"47bc0a3832085cdba6a98cc48d69dd2ab0b0fe4c771400f924c371fe868aa3f3"} Jul 07 19:10:56.900977 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:56.900923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:10:57.790402 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:57.790362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" event={"ID":"950de243-f634-4275-aea3-73d23bb9706c","Type":"ContainerStarted","Data":"2038b49696e1018b2aa83be0e084c8fd201f9704a91bf8d3dc66b1cb1e2a3ad4"} Jul 07 19:10:57.813470 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:10:57.813426 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" podStartSLOduration=0.775575625 podStartE2EDuration="1.813412535s" totalImagesPullingTime="1.03783691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:57.811120082 +0000 UTC m=+594.401886294" watchObservedRunningTime="2026-07-07 19:10:57.813412535 +0000 UTC m=+594.404178747" Jul 07 19:11:03.846391 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:03.846362 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:11:03.846833 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:03.846457 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:11:06.510304 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:06.510275 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:11:06.510690 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:06.510340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:11:06.522573 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:06.522555 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:11:06.852060 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:06.852030 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4cff" Jul 07 19:11:08.497398 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.497284 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2"] Jul 07 19:11:08.511838 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.501581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.511838 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.504575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 19:11:08.511838 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.511537 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2"] Jul 07 19:11:08.533090 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.533068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:11:08.644813 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.644783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.644969 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.644831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcda21c7-b8a3-4327-af03-f6d425e270e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.644969 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.644910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slz2j\" (UniqueName: \"kubernetes.io/projected/bcda21c7-b8a3-4327-af03-f6d425e270e9-kube-api-access-slz2j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.644969 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.644941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.644969 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.644965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.645142 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.644992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746388 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746388 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746492 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcda21c7-b8a3-4327-af03-f6d425e270e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746545 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slz2j\" (UniqueName: \"kubernetes.io/projected/bcda21c7-b8a3-4327-af03-f6d425e270e9-kube-api-access-slz2j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746628 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746628 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.746733 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.746689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.748590 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.748539 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcda21c7-b8a3-4327-af03-f6d425e270e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.748847 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.748829 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcda21c7-b8a3-4327-af03-f6d425e270e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.755521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.755500 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slz2j\" (UniqueName: \"kubernetes.io/projected/bcda21c7-b8a3-4327-af03-f6d425e270e9-kube-api-access-slz2j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2xm2\" (UID: \"bcda21c7-b8a3-4327-af03-f6d425e270e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.812657 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.812633 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:08.950229 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:08.950192 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2"] Jul 07 19:11:08.954473 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:11:08.954448 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcda21c7_b8a3_4327_af03_f6d425e270e9.slice/crio-8be27b986688a1aa9aea9f9619f76ee5efc5758293902ade987ce58600aab5cd WatchSource:0}: Error finding container 8be27b986688a1aa9aea9f9619f76ee5efc5758293902ade987ce58600aab5cd: Status 404 returned error can't find the container with id 8be27b986688a1aa9aea9f9619f76ee5efc5758293902ade987ce58600aab5cd Jul 07 19:11:09.598600 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:09.598569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:11:09.856877 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:09.856789 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" event={"ID":"bcda21c7-b8a3-4327-af03-f6d425e270e9","Type":"ContainerStarted","Data":"644c87854a66b120b210ec499bf2bef13276fa58efb385f99c3c566af8e21b0e"} Jul 07 19:11:09.856877 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:09.856848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" event={"ID":"bcda21c7-b8a3-4327-af03-f6d425e270e9","Type":"ContainerStarted","Data":"8be27b986688a1aa9aea9f9619f76ee5efc5758293902ade987ce58600aab5cd"} Jul 07 19:11:09.884915 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:09.884726 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" podStartSLOduration=1.666772163 podStartE2EDuration="1.884694802s" totalImagesPullingTime="217.922639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:11:09.877928395 +0000 UTC m=+606.468694610" watchObservedRunningTime="2026-07-07 19:11:09.884694802 +0000 UTC m=+606.475461015" Jul 07 19:11:18.813356 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:18.813300 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:18.813825 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:18.813388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:18.826403 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:18.826380 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:18.908778 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:18.908755 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2xm2" Jul 07 19:11:19.946684 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:19.946651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:11:21.300873 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:21.300839 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:11:29.244919 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:29.244845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:11:31.824516 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:31.824487 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:11:33.706379 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:33.706346 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:11:48.229358 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:48.229313 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:11:50.896624 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:11:50.896590 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:12:31.968498 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:31.968459 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:12:32.028616 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:32.028590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:12:37.748521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:37.748490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:12:37.837183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:37.837154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:12:38.868526 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:38.868493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:12:38.985115 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:38.985072 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:12:41.249871 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:41.249841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:12:41.348782 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:12:41.348749 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:13:06.767876 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:06.767791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:13:16.309251 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:16.309212 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:13:28.205449 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:28.205412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:13:36.910195 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:36.910161 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:13:47.719236 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:47.719204 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:13:50.197009 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:50.196975 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:13:52.144006 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:52.143979 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:13:52.875050 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:13:52.875015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:10.636761 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:10.636733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:16.412046 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:16.412017 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:14:27.197447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:27.197370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:14:33.133991 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:33.133966 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:33.290292 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:33.290262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:33.396783 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:33.396704 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:39.154170 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:39.154136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:39.263052 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:39.263021 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:39.357929 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:39.357903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:39.519971 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:39.519912 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:45.291082 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:45.291053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:14:45.359963 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:14:45.359938 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:15:01.668348 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:15:01.668302 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:15:09.100949 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:15:09.100917 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:15:19.413452 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:15:19.413423 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:15:27.419414 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:15:27.419381 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:15:37.207927 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:15:37.207889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:15:48.417375 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:15:48.417344 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:15:58.211491 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:15:58.211450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:16:03.877265 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:16:03.877240 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:16:03.878288 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:16:03.878270 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:16:07.715280 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:16:07.715251 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:16:30.504738 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:16:30.504707 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:16:40.929428 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:16:40.929392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:17:04.318255 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:17:04.318226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:17:15.094352 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:17:15.094305 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:17:31.495723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:17:31.495644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:17:40.468397 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:17:40.468363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:17:50.114753 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:17:50.114723 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:18:00.844258 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:18:00.844225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:18:10.144267 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:18:10.144232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:18:16.740065 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:18:16.740024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:18:18.056805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:18:18.056764 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:19:40.976806 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:19:40.976769 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:19:59.938990 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:19:59.938960 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:20:08.346264 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:20:08.346222 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:20:10.318656 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:20:10.318623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:20:20.812563 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:20:20.812532 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:20:31.506421 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:20:31.506338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:20:41.445475 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:20:41.445434 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:20:43.300240 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:20:43.300211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:20:53.997253 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:20:53.997220 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:21:02.203164 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:02.203136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:21:03.908866 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:03.908840 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:21:03.911680 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:03.911660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:21:04.510220 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:04.510179 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:21:04.611563 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:04.611535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:21:13.106528 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:13.106500 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:21:24.900799 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:24.900762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:21:33.994224 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:33.994195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:21:43.503563 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:21:43.503536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:22:08.904114 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:22:08.904081 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:22:16.228730 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:22:16.228695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:22:26.112102 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:22:26.112071 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:22:36.798617 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:22:36.798590 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:22:45.308807 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:22:45.308773 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:22:58.469776 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:22:58.469745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:23:09.703937 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:23:09.703900 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:23:19.493783 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:23:19.493747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:23:29.394674 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:23:29.394602 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:23:29.691187 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:23:29.691113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:23:38.504162 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:23:38.504130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:23:47.803881 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:23:47.803828 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:24:01.002034 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:24:01.002003 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:24:09.854686 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:24:09.854655 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:24:19.611388 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:24:19.611356 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:24:30.614295 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:24:30.614260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:24:42.398176 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:24:42.398136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:24:51.514985 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:24:51.514955 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:25:03.413754 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:03.413677 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:25:14.308602 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:14.308570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:25:25.803991 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:25.803960 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:25:28.618069 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:28.618041 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:36.151307 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:36.151273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:39.101484 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:39.101451 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:25:44.480581 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:44.480540 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:49.568201 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:49.568156 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:52.623162 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:52.623133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:25:53.174043 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:53.173999 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:53.273778 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:53.273752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:59.476958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:59.476924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:59.577723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:59.577694 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:59.778214 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:59.778136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:25:59.864805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:25:59.864772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:00.932313 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:00.932283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:01.043469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:01.043419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:01.146357 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:01.146310 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:01.426699 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:01.426668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:01.640235 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:01.640189 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:01.743784 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:01.743703 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:03.859986 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:03.859950 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:03.940838 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:03.940812 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:26:03.944635 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:03.944615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:26:06.005298 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:06.005271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:06.169261 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:06.169226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:06.385471 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:06.385443 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:06.520573 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:06.520545 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:07.896311 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:07.896279 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:10.965790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:10.965764 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:12.525035 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:12.525002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:12.618656 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:12.618626 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:12.833272 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:12.833245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:12.934762 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:12.934731 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:14.003721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:14.003688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:14.101016 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:14.100987 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:14.298822 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:14.298799 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:14.603246 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:14.603167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:15.135727 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:15.135696 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:15.280180 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:15.280150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:16.181004 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:16.180973 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:19.063097 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:19.063065 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:19.610956 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:19.610929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:25.136249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:25.136164 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:25.271186 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:25.271160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:26.578171 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:26.578146 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:31.707311 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:31.707284 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:31.810828 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:31.810802 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:31.928497 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:31.928469 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:32.027881 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:32.027788 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:33.114094 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:33.114054 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:33.206074 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:33.206049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:33.348487 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:33.348460 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:33.811522 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:33.811488 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:33.910845 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:33.910814 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:35.138497 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:35.138474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:36.203231 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:36.203201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:26:37.468501 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:37.468468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:37.676643 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:37.676612 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:37.760492 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:37.760423 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:37.981934 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:37.981905 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:39.543897 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:39.543869 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:43.575955 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:43.575906 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:43.674043 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:43.674016 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:44.030370 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:44.030263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:44.133810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:44.133779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:44.236679 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:44.236651 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:45.640799 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:45.640762 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:47.015344 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:47.015292 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:26:51.867099 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:51.867066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:51.934573 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:51.934546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:52.024842 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:52.024805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:52.119390 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:52.119298 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:52.220603 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:52.220572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:26:52.579047 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:26:52.579017 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:02.274683 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:02.274639 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:02.375277 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:02.375233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:18.570821 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:18.570793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:24.960986 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:24.960952 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:25.065680 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:25.065649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:25.211845 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:25.211748 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:41.108397 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:41.108369 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:47.896573 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:47.896533 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:48.009756 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:48.009731 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:48.128192 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:48.128159 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:48.360573 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:48.360548 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:58.650073 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:58.650001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:27:59.495372 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:27:59.495343 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:05.807469 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:05.807433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:05.921212 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:05.921185 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:06.089127 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:06.089049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:06.186054 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:06.186027 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:07.009262 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:07.009206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:07.103913 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:07.103888 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:08.811704 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:08.811675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:09.199733 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:09.199664 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:28:15.156535 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:15.156498 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:15.242811 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:15.242785 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:15.846916 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:15.846883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:17.905440 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:17.905404 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:28:22.332831 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:22.332801 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:22.413218 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:22.413188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:22.583223 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:22.583162 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:22.919364 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:22.919252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:22.985855 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:22.985829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:26.503476 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:26.503450 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:26.623037 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:26.623008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:26.834273 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:26.834235 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:27.131611 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:27.131533 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:27.457716 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:27.457649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:27.560447 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:27.560419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:30.892282 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:30.892248 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:32.104800 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:32.104770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:33.402514 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:33.402479 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:28:38.105392 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:38.105313 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:38.376527 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:38.376454 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:38.610082 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:38.610057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:38.981534 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:38.981504 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:39.087567 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:39.087542 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:43.708733 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:43.708703 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:28:45.548792 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:45.548760 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:45.642567 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:45.642544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:45.864845 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:45.864763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:46.305243 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:46.305201 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:46.456748 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:46.456724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:46.571292 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:46.571228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:52.316191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:52.316154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:52.427052 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:52.427004 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:52.521385 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:52.521358 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:52.708486 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:52.708427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:58.673692 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:58.673658 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:28:58.816097 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:28:58.816062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:05.652278 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:05.652242 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:06.036186 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:06.036110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:06.689495 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:06.689461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:08.680061 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:08.680032 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:08.770866 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:08.770843 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:08.947046 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:08.946967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:09.105882 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:09.105857 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:09.618172 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:09.618141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:09.724335 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:09.724298 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:12.702149 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:12.702115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:29:13.101728 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:13.101697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:15.725212 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:15.725185 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:15.825837 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:15.825807 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:26.159660 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:26.159584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:29.610128 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:29.610096 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:29:31.322234 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:31.322207 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:31.423017 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:31.422982 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:50.955195 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:50.955163 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:29:56.491458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:56.491428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:29:56.882693 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:29:56.882652 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:01.296813 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:01.296783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:30:02.590855 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:02.590817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:07.666131 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:07.666098 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:10.197570 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:10.197538 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:30:43.806053 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:43.806020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:45.141744 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:45.141707 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:46.912721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:46.912687 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:30:51.205394 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:51.205364 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:57.056977 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:57.056905 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:57.128198 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:57.128154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:57.358998 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:57.358907 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:58.661299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:58.661257 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:58.751886 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:58.751859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:58.854929 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:58.854906 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:59.722921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:59.722892 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:30:59.836984 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:30:59.836958 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:01.228991 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:01.228967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:01.402625 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:01.402596 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:31:03.978738 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:03.978709 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:31:03.982863 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:03.982840 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:31:07.036548 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:07.036511 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:07.106485 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:07.106458 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:07.800208 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:07.800180 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:11.831206 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:11.831173 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:13.656700 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:13.656653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:13.759249 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:13.759219 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:13.856817 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:13.856796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:14.596403 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:14.596375 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:31:24.393208 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:24.393177 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:24.750136 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:24.750067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:30.948769 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:30.948736 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:45.685067 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:45.685037 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:52.613598 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:52.613567 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:52.682664 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:52.682634 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:52.969073 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:52.969004 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:53.286737 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:53.286543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:53.396384 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:53.396344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:56.624966 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:56.624922 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:56.715025 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:56.714996 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:56.847721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:56.847696 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:57.192041 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:57.192009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:57.560653 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:57.560629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:31:57.661108 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:31:57.661024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:01.187707 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:01.187674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:01.495869 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:01.495771 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:01.829958 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:01.829926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:02.308475 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:02.308444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:04.602481 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.602453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:32:04.683068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.683032 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:04.771806 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.771770 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj"] Jul 07 19:32:04.775771 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.775752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:04.778722 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.778699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a4aa66-serving-cert\"" Jul 07 19:32:04.778856 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.778839 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\"" Jul 07 19:32:04.780114 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.780092 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 07 19:32:04.780239 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.780095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 07 19:32:04.792038 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.792015 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj"] Jul 07 19:32:04.805521 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.805500 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:04.856822 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.856759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce8721e-3431-42b3-9ceb-76d1343b31b9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:04.856920 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.856848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:04.856920 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.856886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxq72\" (UniqueName: \"kubernetes.io/projected/1ce8721e-3431-42b3-9ceb-76d1343b31b9-kube-api-access-bxq72\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:04.906116 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.906075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:04.957782 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.957757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:04.957921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.957791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxq72\" (UniqueName: \"kubernetes.io/projected/1ce8721e-3431-42b3-9ceb-76d1343b31b9-kube-api-access-bxq72\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:04.957921 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.957845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce8721e-3431-42b3-9ceb-76d1343b31b9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:04.958038 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:32:04.957921 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-serving-cert: secret "maas-api-e2e-inf-b-a4aa66-serving-cert" not found Jul 07 19:32:04.958038 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:32:04.958006 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls podName:1ce8721e-3431-42b3-9ceb-76d1343b31b9 nodeName:}" failed. No retries permitted until 2026-07-07 19:32:05.457984432 +0000 UTC m=+1862.048750637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls") pod "maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" (UID: "1ce8721e-3431-42b3-9ceb-76d1343b31b9") : secret "maas-api-e2e-inf-b-a4aa66-serving-cert" not found Jul 07 19:32:04.958404 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:04.958388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce8721e-3431-42b3-9ceb-76d1343b31b9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:05.001871 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.001850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxq72\" (UniqueName: \"kubernetes.io/projected/1ce8721e-3431-42b3-9ceb-76d1343b31b9-kube-api-access-bxq72\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:05.290415 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.290311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:05.461678 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.461648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:05.464189 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.464158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls\") pod \"maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:05.623017 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.622986 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:05.687189 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.687163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:05.726477 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.726453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:05.823177 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.823145 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj"] Jul 07 19:32:05.826504 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:32:05.826476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce8721e_3431_42b3_9ceb_76d1343b31b9.slice/crio-01b431d8122eb10e79a94627de434e71ae172a4a3dc7a3e741dc26bc810fad30 WatchSource:0}: Error finding container 01b431d8122eb10e79a94627de434e71ae172a4a3dc7a3e741dc26bc810fad30: Status 404 returned error can't find the container with id 01b431d8122eb10e79a94627de434e71ae172a4a3dc7a3e741dc26bc810fad30 Jul 07 19:32:05.827810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:05.827781 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:32:06.756315 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:06.756282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" event={"ID":"1ce8721e-3431-42b3-9ceb-76d1343b31b9","Type":"ContainerStarted","Data":"01b431d8122eb10e79a94627de434e71ae172a4a3dc7a3e741dc26bc810fad30"} Jul 07 19:32:08.768057 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:08.767985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" event={"ID":"1ce8721e-3431-42b3-9ceb-76d1343b31b9","Type":"ContainerStarted","Data":"6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6"} Jul 07 19:32:08.768401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:08.768093 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:08.799954 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:08.799913 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" podStartSLOduration=2.283719494 podStartE2EDuration="4.799898844s" totalImagesPullingTime="2.51617935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:32:08.799036848 +0000 UTC m=+1865.389803061" watchObservedRunningTime="2026-07-07 19:32:08.799898844 +0000 UTC m=+1865.390665055" Jul 07 19:32:09.261738 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:09.261712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:14.778078 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:14.778051 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:32:18.452386 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:18.452355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:18.517986 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:18.517923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:32:18.572718 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:18.572689 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:23.206927 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:23.206891 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:26.727071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:26.726980 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:26.828516 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:26.828484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:27.935631 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:27.935597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:32:41.054721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:41.054687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:32:48.112745 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:32:48.112705 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:33:02.660581 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:02.660542 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:03.630778 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:03.630749 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:03.884943 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:03.884853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:04.327206 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:04.327169 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:04.600226 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:04.600143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:04.692852 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:04.692815 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:04.916304 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:04.916228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:07.916465 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:07.916431 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:33:09.368208 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:09.368177 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:14.960020 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:14.959982 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:47.107693 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:47.107662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:48.477174 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.477142 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj"] Jul 07 19:33:48.477591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.477375 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" podUID="1ce8721e-3431-42b3-9ceb-76d1343b31b9" containerName="maas-api" containerID="cri-o://6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6" gracePeriod=30 Jul 07 19:33:48.723204 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.723173 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:48.730800 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.730747 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:33:48.775225 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.775200 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce8721e-3431-42b3-9ceb-76d1343b31b9-openshift-service-ca\") pod \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " Jul 07 19:33:48.775428 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.775268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxq72\" (UniqueName: \"kubernetes.io/projected/1ce8721e-3431-42b3-9ceb-76d1343b31b9-kube-api-access-bxq72\") pod \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " Jul 07 19:33:48.775428 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.775299 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls\") pod \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\" (UID: \"1ce8721e-3431-42b3-9ceb-76d1343b31b9\") " Jul 07 19:33:48.775705 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.775669 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce8721e-3431-42b3-9ceb-76d1343b31b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ce8721e-3431-42b3-9ceb-76d1343b31b9" (UID: "1ce8721e-3431-42b3-9ceb-76d1343b31b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:33:48.777771 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.777746 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce8721e-3431-42b3-9ceb-76d1343b31b9-kube-api-access-bxq72" (OuterVolumeSpecName: "kube-api-access-bxq72") pod "1ce8721e-3431-42b3-9ceb-76d1343b31b9" (UID: "1ce8721e-3431-42b3-9ceb-76d1343b31b9"). InnerVolumeSpecName "kube-api-access-bxq72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:33:48.777859 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.777807 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ce8721e-3431-42b3-9ceb-76d1343b31b9" (UID: "1ce8721e-3431-42b3-9ceb-76d1343b31b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:33:48.876711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.876676 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ce8721e-3431-42b3-9ceb-76d1343b31b9-openshift-service-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:33:48.876711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.876702 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxq72\" (UniqueName: \"kubernetes.io/projected/1ce8721e-3431-42b3-9ceb-76d1343b31b9-kube-api-access-bxq72\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:33:48.876711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:48.876713 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ce8721e-3431-42b3-9ceb-76d1343b31b9-maas-api-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:33:49.261274 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.261237 2576 generic.go:356] "Generic (PLEG): container finished" podID="1ce8721e-3431-42b3-9ceb-76d1343b31b9" containerID="6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6" exitCode=0 Jul 07 19:33:49.261458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.261284 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" Jul 07 19:33:49.261458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.261337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" event={"ID":"1ce8721e-3431-42b3-9ceb-76d1343b31b9","Type":"ContainerDied","Data":"6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6"} Jul 07 19:33:49.261458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.261386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj" event={"ID":"1ce8721e-3431-42b3-9ceb-76d1343b31b9","Type":"ContainerDied","Data":"01b431d8122eb10e79a94627de434e71ae172a4a3dc7a3e741dc26bc810fad30"} Jul 07 19:33:49.261458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.261408 2576 scope.go:117] "RemoveContainer" containerID="6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6" Jul 07 19:33:49.271265 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.271245 2576 scope.go:117] "RemoveContainer" containerID="6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6" Jul 07 19:33:49.271550 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:33:49.271527 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6\": container with ID starting with 6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6 not found: ID does not exist" containerID="6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6" Jul 07 19:33:49.271642 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.271563 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6"} err="failed to get container status \"6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6\": rpc error: code = NotFound desc = could not find container \"6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6\": container with ID starting with 6842f94213622ca4a10427650438e2b82b7bcdf58655bf07b6ef56d138f20dc6 not found: ID does not exist" Jul 07 19:33:49.292350 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.292306 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj"] Jul 07 19:33:49.300400 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.300370 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a4aa66-5fcf688944-bs5nj"] Jul 07 19:33:49.936294 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:49.936262 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce8721e-3431-42b3-9ceb-76d1343b31b9" path="/var/lib/kubelet/pods/1ce8721e-3431-42b3-9ceb-76d1343b31b9/volumes" Jul 07 19:33:51.573566 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:51.573537 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:33:54.494962 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:54.494883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:54.592712 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:54.592670 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:54.754753 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:54.754668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:55.325604 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:55.325565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:55.653725 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:55.653645 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:55.746622 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:55.746589 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:58.364661 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.364625 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:58.460203 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.460171 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:58.462741 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.462715 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt"] Jul 07 19:33:58.463351 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.463313 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce8721e-3431-42b3-9ceb-76d1343b31b9" containerName="maas-api" Jul 07 19:33:58.463351 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.463353 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce8721e-3431-42b3-9ceb-76d1343b31b9" containerName="maas-api" Jul 07 19:33:58.463507 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.463464 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce8721e-3431-42b3-9ceb-76d1343b31b9" containerName="maas-api" Jul 07 19:33:58.466944 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.466927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.469788 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.469766 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\"" Jul 07 19:33:58.470471 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.470451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-58a302-serving-cert\"" Jul 07 19:33:58.471060 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.471041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 07 19:33:58.471150 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.471082 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 07 19:33:58.481750 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.481397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt"] Jul 07 19:33:58.565834 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.565800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dztjj\" (UniqueName: \"kubernetes.io/projected/ec885213-63f4-4f9e-bfa5-6ac96024807e-kube-api-access-dztjj\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.565990 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.565938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec885213-63f4-4f9e-bfa5-6ac96024807e-openshift-service-ca\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.566058 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.565990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.576028 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.575997 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:58.667444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.667372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.667444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.667441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dztjj\" (UniqueName: \"kubernetes.io/projected/ec885213-63f4-4f9e-bfa5-6ac96024807e-kube-api-access-dztjj\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.667609 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:33:58.667529 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-serving-cert: secret "maas-api-e2e-api-a-58a302-serving-cert" not found Jul 07 19:33:58.667609 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.667565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec885213-63f4-4f9e-bfa5-6ac96024807e-openshift-service-ca\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.667690 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:33:58.667609 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls podName:ec885213-63f4-4f9e-bfa5-6ac96024807e nodeName:}" failed. No retries permitted until 2026-07-07 19:33:59.167585869 +0000 UTC m=+1975.758352066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls") pod "maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" (UID: "ec885213-63f4-4f9e-bfa5-6ac96024807e") : secret "maas-api-e2e-api-a-58a302-serving-cert" not found Jul 07 19:33:58.668207 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.668189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec885213-63f4-4f9e-bfa5-6ac96024807e-openshift-service-ca\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:58.684687 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:58.684660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dztjj\" (UniqueName: \"kubernetes.io/projected/ec885213-63f4-4f9e-bfa5-6ac96024807e-kube-api-access-dztjj\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:59.049081 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:59.049052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:59.151514 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:59.151482 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:33:59.172730 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:59.172708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:59.175250 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:59.175228 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls\") pod \"maas-api-e2e-api-a-58a302-58b8459b74-l4cmt\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:59.385714 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:59.385644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:33:59.528584 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:33:59.528562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt"] Jul 07 19:33:59.530305 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:33:59.530271 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec885213_63f4_4f9e_bfa5_6ac96024807e.slice/crio-392b265999717641e93620754cddcc6d78924010561bbe09c318fd4d18fa935c WatchSource:0}: Error finding container 392b265999717641e93620754cddcc6d78924010561bbe09c318fd4d18fa935c: Status 404 returned error can't find the container with id 392b265999717641e93620754cddcc6d78924010561bbe09c318fd4d18fa935c Jul 07 19:34:00.317251 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:00.317168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" event={"ID":"ec885213-63f4-4f9e-bfa5-6ac96024807e","Type":"ContainerStarted","Data":"66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd"} Jul 07 19:34:00.317251 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:00.317229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" event={"ID":"ec885213-63f4-4f9e-bfa5-6ac96024807e","Type":"ContainerStarted","Data":"392b265999717641e93620754cddcc6d78924010561bbe09c318fd4d18fa935c"} Jul 07 19:34:00.317440 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:00.317342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:34:00.338967 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:00.338920 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" podStartSLOduration=1.8031307540000001 podStartE2EDuration="2.338905461s" totalImagesPullingTime="535.774707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:34:00.336456067 +0000 UTC m=+1976.927222280" watchObservedRunningTime="2026-07-07 19:34:00.338905461 +0000 UTC m=+1976.929671674" Jul 07 19:34:02.837985 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:02.837938 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:03.288931 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:03.288831 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:03.613783 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:03.613745 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:03.894901 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:03.894801 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:05.693022 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:05.692983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:34:06.335019 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.334993 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:34:06.452080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.452047 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:06.544260 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.544226 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk"] Jul 07 19:34:06.547752 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.547730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.555196 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.555174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0ffa2c-serving-cert\"" Jul 07 19:34:06.575673 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.575648 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk"] Jul 07 19:34:06.618537 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.618455 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:06.644647 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.644624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgvqf\" (UniqueName: \"kubernetes.io/projected/cc805d0c-3333-4e3f-91d1-55df560cb7c9-kube-api-access-sgvqf\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.644766 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.644653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc805d0c-3333-4e3f-91d1-55df560cb7c9-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.644766 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.644680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc805d0c-3333-4e3f-91d1-55df560cb7c9-maas-api-tls\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.730124 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.730092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:06.745507 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.745483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgvqf\" (UniqueName: \"kubernetes.io/projected/cc805d0c-3333-4e3f-91d1-55df560cb7c9-kube-api-access-sgvqf\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.745589 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.745514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc805d0c-3333-4e3f-91d1-55df560cb7c9-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.745589 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.745538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc805d0c-3333-4e3f-91d1-55df560cb7c9-maas-api-tls\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.746080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.746059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc805d0c-3333-4e3f-91d1-55df560cb7c9-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.748050 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.748031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc805d0c-3333-4e3f-91d1-55df560cb7c9-maas-api-tls\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.758212 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.758195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgvqf\" (UniqueName: \"kubernetes.io/projected/cc805d0c-3333-4e3f-91d1-55df560cb7c9-kube-api-access-sgvqf\") pod \"maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.826992 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.826969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:06.858262 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.858238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:06.995198 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:06.995172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk"] Jul 07 19:34:06.997995 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:34:06.997964 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc805d0c_3333_4e3f_91d1_55df560cb7c9.slice/crio-24fe69df3a4d6ccd20289c9879b621c851a6d7ac5abb415bb6405e6c3a1d7763 WatchSource:0}: Error finding container 24fe69df3a4d6ccd20289c9879b621c851a6d7ac5abb415bb6405e6c3a1d7763: Status 404 returned error can't find the container with id 24fe69df3a4d6ccd20289c9879b621c851a6d7ac5abb415bb6405e6c3a1d7763 Jul 07 19:34:07.318667 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:07.318642 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:07.356808 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:07.356786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" event={"ID":"cc805d0c-3333-4e3f-91d1-55df560cb7c9","Type":"ContainerStarted","Data":"24fe69df3a4d6ccd20289c9879b621c851a6d7ac5abb415bb6405e6c3a1d7763"} Jul 07 19:34:07.416446 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:07.416423 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:08.363075 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:08.363041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" event={"ID":"cc805d0c-3333-4e3f-91d1-55df560cb7c9","Type":"ContainerStarted","Data":"aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49"} Jul 07 19:34:08.363594 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:08.363150 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:08.392071 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:08.392017 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" podStartSLOduration=2.054276516 podStartE2EDuration="2.391998909s" totalImagesPullingTime="337.722393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:34:08.39146571 +0000 UTC m=+1984.982231922" watchObservedRunningTime="2026-07-07 19:34:08.391998909 +0000 UTC m=+1984.982765149" Jul 07 19:34:10.883814 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:10.883774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:14.373439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:14.373409 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:16.688752 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:16.688719 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:16.788702 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:16.788674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:18.695955 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:18.695922 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:19.061950 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:19.061921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:19.430010 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:19.429940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:19.575068 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:19.575039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:19.676816 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:19.676792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:19.840720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:19.840694 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt"] Jul 07 19:34:19.841095 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:19.840919 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" podUID="ec885213-63f4-4f9e-bfa5-6ac96024807e" containerName="maas-api" containerID="cri-o://66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd" gracePeriod=30 Jul 07 19:34:19.868299 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:19.868273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:20.090568 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.090548 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:34:20.266810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.266733 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls\") pod \"ec885213-63f4-4f9e-bfa5-6ac96024807e\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " Jul 07 19:34:20.266810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.266777 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec885213-63f4-4f9e-bfa5-6ac96024807e-openshift-service-ca\") pod \"ec885213-63f4-4f9e-bfa5-6ac96024807e\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " Jul 07 19:34:20.266810 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.266801 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dztjj\" (UniqueName: \"kubernetes.io/projected/ec885213-63f4-4f9e-bfa5-6ac96024807e-kube-api-access-dztjj\") pod \"ec885213-63f4-4f9e-bfa5-6ac96024807e\" (UID: \"ec885213-63f4-4f9e-bfa5-6ac96024807e\") " Jul 07 19:34:20.267123 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.267100 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec885213-63f4-4f9e-bfa5-6ac96024807e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec885213-63f4-4f9e-bfa5-6ac96024807e" (UID: "ec885213-63f4-4f9e-bfa5-6ac96024807e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:34:20.268906 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.268879 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec885213-63f4-4f9e-bfa5-6ac96024807e" (UID: "ec885213-63f4-4f9e-bfa5-6ac96024807e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:34:20.269049 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.269028 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec885213-63f4-4f9e-bfa5-6ac96024807e-kube-api-access-dztjj" (OuterVolumeSpecName: "kube-api-access-dztjj") pod "ec885213-63f4-4f9e-bfa5-6ac96024807e" (UID: "ec885213-63f4-4f9e-bfa5-6ac96024807e"). InnerVolumeSpecName "kube-api-access-dztjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:34:20.367668 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.367635 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec885213-63f4-4f9e-bfa5-6ac96024807e-maas-api-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:34:20.367668 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.367665 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec885213-63f4-4f9e-bfa5-6ac96024807e-openshift-service-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:34:20.367668 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.367675 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dztjj\" (UniqueName: \"kubernetes.io/projected/ec885213-63f4-4f9e-bfa5-6ac96024807e-kube-api-access-dztjj\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:34:20.426915 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.426886 2576 generic.go:356] "Generic (PLEG): container finished" podID="ec885213-63f4-4f9e-bfa5-6ac96024807e" containerID="66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd" exitCode=0 Jul 07 19:34:20.427018 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.426936 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" Jul 07 19:34:20.427018 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.426969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" event={"ID":"ec885213-63f4-4f9e-bfa5-6ac96024807e","Type":"ContainerDied","Data":"66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd"} Jul 07 19:34:20.427103 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.427020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt" event={"ID":"ec885213-63f4-4f9e-bfa5-6ac96024807e","Type":"ContainerDied","Data":"392b265999717641e93620754cddcc6d78924010561bbe09c318fd4d18fa935c"} Jul 07 19:34:20.427103 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.427043 2576 scope.go:117] "RemoveContainer" containerID="66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd" Jul 07 19:34:20.436094 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.436080 2576 scope.go:117] "RemoveContainer" containerID="66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd" Jul 07 19:34:20.436332 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:34:20.436298 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd\": container with ID starting with 66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd not found: ID does not exist" containerID="66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd" Jul 07 19:34:20.436395 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.436355 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd"} err="failed to get container status \"66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd\": rpc error: code = NotFound desc = could not find container \"66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd\": container with ID starting with 66862a01850a4b644f8ad1e0c0e6b21b4aa4a596d10b17e4f158e07eb0e626fd not found: ID does not exist" Jul 07 19:34:20.453785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.453762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt"] Jul 07 19:34:20.459274 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:20.459255 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-58a302-58b8459b74-l4cmt"] Jul 07 19:34:21.935937 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:21.935908 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec885213-63f4-4f9e-bfa5-6ac96024807e" path="/var/lib/kubelet/pods/ec885213-63f4-4f9e-bfa5-6ac96024807e/volumes" Jul 07 19:34:23.619891 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:23.619856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:34:25.916303 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:25.916250 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:26.018148 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:26.018092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:26.171951 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:26.171879 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:26.719511 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:26.719480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:27.080097 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.080067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:27.287836 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.287787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:27.388245 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.388167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:27.552893 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.552863 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk"] Jul 07 19:34:27.553169 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.553129 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" podUID="cc805d0c-3333-4e3f-91d1-55df560cb7c9" containerName="maas-api" containerID="cri-o://aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49" gracePeriod=30 Jul 07 19:34:27.585962 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.585932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:27.814601 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.814578 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:27.826298 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.826277 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgvqf\" (UniqueName: \"kubernetes.io/projected/cc805d0c-3333-4e3f-91d1-55df560cb7c9-kube-api-access-sgvqf\") pod \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " Jul 07 19:34:27.826412 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.826341 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc805d0c-3333-4e3f-91d1-55df560cb7c9-openshift-service-ca\") pod \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " Jul 07 19:34:27.826412 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.826410 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc805d0c-3333-4e3f-91d1-55df560cb7c9-maas-api-tls\") pod \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\" (UID: \"cc805d0c-3333-4e3f-91d1-55df560cb7c9\") " Jul 07 19:34:27.826750 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.826724 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc805d0c-3333-4e3f-91d1-55df560cb7c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc805d0c-3333-4e3f-91d1-55df560cb7c9" (UID: "cc805d0c-3333-4e3f-91d1-55df560cb7c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:34:27.828362 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.828340 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc805d0c-3333-4e3f-91d1-55df560cb7c9-kube-api-access-sgvqf" (OuterVolumeSpecName: "kube-api-access-sgvqf") pod "cc805d0c-3333-4e3f-91d1-55df560cb7c9" (UID: "cc805d0c-3333-4e3f-91d1-55df560cb7c9"). InnerVolumeSpecName "kube-api-access-sgvqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:34:27.828523 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.828506 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc805d0c-3333-4e3f-91d1-55df560cb7c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc805d0c-3333-4e3f-91d1-55df560cb7c9" (UID: "cc805d0c-3333-4e3f-91d1-55df560cb7c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:34:27.927049 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.926978 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc805d0c-3333-4e3f-91d1-55df560cb7c9-maas-api-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:34:27.927049 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.927004 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgvqf\" (UniqueName: \"kubernetes.io/projected/cc805d0c-3333-4e3f-91d1-55df560cb7c9-kube-api-access-sgvqf\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:34:27.927049 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:27.927019 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc805d0c-3333-4e3f-91d1-55df560cb7c9-openshift-service-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:34:28.474626 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.474589 2576 generic.go:356] "Generic (PLEG): container finished" podID="cc805d0c-3333-4e3f-91d1-55df560cb7c9" containerID="aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49" exitCode=0 Jul 07 19:34:28.475040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.474633 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" Jul 07 19:34:28.475040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.474634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" event={"ID":"cc805d0c-3333-4e3f-91d1-55df560cb7c9","Type":"ContainerDied","Data":"aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49"} Jul 07 19:34:28.475040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.474687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk" event={"ID":"cc805d0c-3333-4e3f-91d1-55df560cb7c9","Type":"ContainerDied","Data":"24fe69df3a4d6ccd20289c9879b621c851a6d7ac5abb415bb6405e6c3a1d7763"} Jul 07 19:34:28.475040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.474710 2576 scope.go:117] "RemoveContainer" containerID="aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49" Jul 07 19:34:28.483168 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.483145 2576 scope.go:117] "RemoveContainer" containerID="aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49" Jul 07 19:34:28.483467 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:34:28.483447 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49\": container with ID starting with aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49 not found: ID does not exist" containerID="aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49" Jul 07 19:34:28.483561 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.483474 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49"} err="failed to get container status \"aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49\": rpc error: code = NotFound desc = could not find container \"aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49\": container with ID starting with aecbfd3457cb7595f6aac59d829a4788d3267823f5785e9caba53995eb04bf49 not found: ID does not exist" Jul 07 19:34:28.494787 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.494764 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk"] Jul 07 19:34:28.499783 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:28.499760 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0ffa2c-85f98577d-tcknk"] Jul 07 19:34:29.935523 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:29.935491 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc805d0c-3333-4e3f-91d1-55df560cb7c9" path="/var/lib/kubelet/pods/cc805d0c-3333-4e3f-91d1-55df560cb7c9/volumes" Jul 07 19:34:32.903971 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:32.903939 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:33.004403 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:33.004355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:33.181142 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:33.181049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:33.728401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:33.728362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:34.034821 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:34.034740 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:34.501665 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:34.501633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:36.683442 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.683414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:36.815711 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.815676 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w"] Jul 07 19:34:36.817670 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.817643 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec885213-63f4-4f9e-bfa5-6ac96024807e" containerName="maas-api" Jul 07 19:34:36.817670 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.817668 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec885213-63f4-4f9e-bfa5-6ac96024807e" containerName="maas-api" Jul 07 19:34:36.817869 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.817749 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc805d0c-3333-4e3f-91d1-55df560cb7c9" containerName="maas-api" Jul 07 19:34:36.817869 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.817758 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc805d0c-3333-4e3f-91d1-55df560cb7c9" containerName="maas-api" Jul 07 19:34:36.817969 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.817910 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec885213-63f4-4f9e-bfa5-6ac96024807e" containerName="maas-api" Jul 07 19:34:36.817969 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.817933 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc805d0c-3333-4e3f-91d1-55df560cb7c9" containerName="maas-api" Jul 07 19:34:36.820993 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.818872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:36.823263 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.823242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:36.829720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.829613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c576d2-serving-cert\"" Jul 07 19:34:36.830137 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.829925 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 07 19:34:36.831080 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.831062 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 07 19:34:36.831168 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.831062 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\"" Jul 07 19:34:36.837464 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.837441 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w"] Jul 07 19:34:36.911069 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.911040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:36.911171 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.911126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:36.911241 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.911182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlmx\" (UniqueName: \"kubernetes.io/projected/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-kube-api-access-htlmx\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:36.911763 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:36.911739 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:37.012641 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.012584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.012641 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.012620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htlmx\" (UniqueName: \"kubernetes.io/projected/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-kube-api-access-htlmx\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.012818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.012654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.012818 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:34:37.012766 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-serving-cert: secret "maas-api-e2e-shared-a-c576d2-serving-cert" not found Jul 07 19:34:37.012933 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:34:37.012824 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls podName:314faf27-2a9f-45b1-8bc9-9defc3adb8f4 nodeName:}" failed. No retries permitted until 2026-07-07 19:34:37.51280497 +0000 UTC m=+2014.103571163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls") pod "maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" (UID: "314faf27-2a9f-45b1-8bc9-9defc3adb8f4") : secret "maas-api-e2e-shared-a-c576d2-serving-cert" not found Jul 07 19:34:37.013257 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.013234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.022114 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.022096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlmx\" (UniqueName: \"kubernetes.io/projected/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-kube-api-access-htlmx\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.093541 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.093514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:37.496889 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.496861 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:34:37.516545 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.516518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.518984 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.518967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-c576d2-9676b4779-69q7w\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.642271 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.642245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:37.733480 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.733455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:37.764591 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.764532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:37.875739 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:37.875714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w"] Jul 07 19:34:37.877481 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:34:37.877457 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314faf27_2a9f_45b1_8bc9_9defc3adb8f4.slice/crio-b6c3400c6bf6305bb7629ae9b0aac01791d9d122d088ecc05f3ba651ebfc6fa3 WatchSource:0}: Error finding container b6c3400c6bf6305bb7629ae9b0aac01791d9d122d088ecc05f3ba651ebfc6fa3: Status 404 returned error can't find the container with id b6c3400c6bf6305bb7629ae9b0aac01791d9d122d088ecc05f3ba651ebfc6fa3 Jul 07 19:34:38.530112 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:38.530025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" event={"ID":"314faf27-2a9f-45b1-8bc9-9defc3adb8f4","Type":"ContainerStarted","Data":"1925c18572d1efbe8ad62940c63e7f445d837c4ed6e05caa439eb945ca3fdf71"} Jul 07 19:34:38.530112 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:38.530094 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:38.530112 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:38.530114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" event={"ID":"314faf27-2a9f-45b1-8bc9-9defc3adb8f4","Type":"ContainerStarted","Data":"b6c3400c6bf6305bb7629ae9b0aac01791d9d122d088ecc05f3ba651ebfc6fa3"} Jul 07 19:34:38.554286 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:38.554242 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" podStartSLOduration=2.230559106 podStartE2EDuration="2.554229002s" totalImagesPullingTime="323.669896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:34:38.551173525 +0000 UTC m=+2015.141939738" watchObservedRunningTime="2026-07-07 19:34:38.554229002 +0000 UTC m=+2015.144995215" Jul 07 19:34:41.080782 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:41.080751 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:41.405187 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:41.405096 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:41.718102 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:41.718029 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:41.985205 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:41.985131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:44.539983 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.539955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:34:44.639189 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.639158 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:44.712587 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.712555 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5"] Jul 07 19:34:44.716778 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.716758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.720113 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.720085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-2620f1-serving-cert\"" Jul 07 19:34:44.724270 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.723941 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5"] Jul 07 19:34:44.728251 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.728230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:44.776003 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.775976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b79a98d0-7df2-44da-af1f-aaec61cbca56-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.776126 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.776086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dkx\" (UniqueName: \"kubernetes.io/projected/b79a98d0-7df2-44da-af1f-aaec61cbca56-kube-api-access-q7dkx\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.776187 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.776133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.805304 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.805280 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:44.877688 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.877655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b79a98d0-7df2-44da-af1f-aaec61cbca56-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.877794 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.877724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dkx\" (UniqueName: \"kubernetes.io/projected/b79a98d0-7df2-44da-af1f-aaec61cbca56-kube-api-access-q7dkx\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.877794 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.877748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.877891 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:34:44.877873 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-serving-cert: secret "maas-api-e2e-shared-b-2620f1-serving-cert" not found Jul 07 19:34:44.877939 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:34:44.877928 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls podName:b79a98d0-7df2-44da-af1f-aaec61cbca56 nodeName:}" failed. No retries permitted until 2026-07-07 19:34:45.377909047 +0000 UTC m=+2021.968675255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls") pod "maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" (UID: "b79a98d0-7df2-44da-af1f-aaec61cbca56") : secret "maas-api-e2e-shared-b-2620f1-serving-cert" not found Jul 07 19:34:44.878406 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.878389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b79a98d0-7df2-44da-af1f-aaec61cbca56-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:44.888947 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:44.888927 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dkx\" (UniqueName: \"kubernetes.io/projected/b79a98d0-7df2-44da-af1f-aaec61cbca56-kube-api-access-q7dkx\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:45.205915 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:45.205838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:45.312050 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:45.312025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:45.382646 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:45.382610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:45.385136 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:45.385102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls\") pod \"maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:45.412202 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:45.412171 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:45.628015 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:45.627991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:45.761065 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:45.761043 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5"] Jul 07 19:34:45.763122 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:34:45.763096 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79a98d0_7df2_44da_af1f_aaec61cbca56.slice/crio-64fcd7ec1a4284530906d6cf6a3efa69c594addd79d6832422adc0f416684d07 WatchSource:0}: Error finding container 64fcd7ec1a4284530906d6cf6a3efa69c594addd79d6832422adc0f416684d07: Status 404 returned error can't find the container with id 64fcd7ec1a4284530906d6cf6a3efa69c594addd79d6832422adc0f416684d07 Jul 07 19:34:46.568892 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:46.568862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" event={"ID":"b79a98d0-7df2-44da-af1f-aaec61cbca56","Type":"ContainerStarted","Data":"ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52"} Jul 07 19:34:46.569045 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:46.568913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" event={"ID":"b79a98d0-7df2-44da-af1f-aaec61cbca56","Type":"ContainerStarted","Data":"64fcd7ec1a4284530906d6cf6a3efa69c594addd79d6832422adc0f416684d07"} Jul 07 19:34:46.569045 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:46.568957 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:46.591811 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:46.591763 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" podStartSLOduration=2.227658016 podStartE2EDuration="2.591749287s" totalImagesPullingTime="364.091271ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:34:46.590546658 +0000 UTC m=+2023.181312873" watchObservedRunningTime="2026-07-07 19:34:46.591749287 +0000 UTC m=+2023.182515499" Jul 07 19:34:49.175534 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:49.175496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:52.309196 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:52.309162 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:34:52.579416 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:52.579311 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:34:52.642506 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:52.642477 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:59.721057 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:59.721018 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:34:59.821531 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:34:59.821496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:35:04.913440 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:04.913404 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:35:06.121946 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:06.121917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:35:06.222590 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:06.222558 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:35:13.535575 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:13.535537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:35:17.408104 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:17.408068 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:35:31.088062 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:31.087991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:35:46.500535 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:46.500503 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:35:51.448092 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:35:51.448051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:36:02.511344 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:36:02.511300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:36:04.011821 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:36:04.011792 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:36:04.017728 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:36:04.017709 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:36:19.205549 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:36:19.205512 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:36:33.692864 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:36:33.692827 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:36:50.907214 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:36:50.907171 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:37:04.525183 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:37:04.525106 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:37:05.507293 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:37:05.507254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:37:08.603389 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:37:08.603354 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:37:11.232375 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:37:11.232345 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:37:23.499940 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:37:23.499908 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:37:45.139194 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:37:45.139153 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:37:49.606421 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:37:49.606391 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:38:03.502585 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:38:03.502546 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:38:19.000458 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:38:19.000415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:38:20.117004 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:38:20.116973 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:38:22.310805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:38:22.310770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:38:24.587883 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:38:24.587804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:38:38.609954 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:38:38.609915 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:39:00.745304 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:00.745273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:05.301881 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:05.301851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:39:11.010796 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:11.010763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:16.861532 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:16.861492 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:17.925785 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:17.925749 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:18.036716 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:18.036683 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:31.210515 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:31.210484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:39:44.907620 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:44.907591 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:39:51.930773 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:51.930742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:52.997572 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:52.997533 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:54.083333 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:54.083296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:54.470961 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:54.470851 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:54.578721 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:54.578697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:54.679246 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:54.679221 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:54.867549 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:54.867520 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w"] Jul 07 19:39:54.867790 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:54.867760 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" podUID="314faf27-2a9f-45b1-8bc9-9defc3adb8f4" containerName="maas-api" containerID="cri-o://1925c18572d1efbe8ad62940c63e7f445d837c4ed6e05caa439eb945ca3fdf71" gracePeriod=30 Jul 07 19:39:54.896952 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:54.896911 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:39:55.081663 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.081638 2576 generic.go:356] "Generic (PLEG): container finished" podID="314faf27-2a9f-45b1-8bc9-9defc3adb8f4" containerID="1925c18572d1efbe8ad62940c63e7f445d837c4ed6e05caa439eb945ca3fdf71" exitCode=0 Jul 07 19:39:55.081798 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.081712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" event={"ID":"314faf27-2a9f-45b1-8bc9-9defc3adb8f4","Type":"ContainerDied","Data":"1925c18572d1efbe8ad62940c63e7f445d837c4ed6e05caa439eb945ca3fdf71"} Jul 07 19:39:55.117628 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.117572 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:39:55.272875 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.272846 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls\") pod \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " Jul 07 19:39:55.272875 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.272876 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htlmx\" (UniqueName: \"kubernetes.io/projected/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-kube-api-access-htlmx\") pod \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " Jul 07 19:39:55.273156 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.272910 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-openshift-service-ca\") pod \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\" (UID: \"314faf27-2a9f-45b1-8bc9-9defc3adb8f4\") " Jul 07 19:39:55.273313 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.273281 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "314faf27-2a9f-45b1-8bc9-9defc3adb8f4" (UID: "314faf27-2a9f-45b1-8bc9-9defc3adb8f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:39:55.275056 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.275035 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-kube-api-access-htlmx" (OuterVolumeSpecName: "kube-api-access-htlmx") pod "314faf27-2a9f-45b1-8bc9-9defc3adb8f4" (UID: "314faf27-2a9f-45b1-8bc9-9defc3adb8f4"). InnerVolumeSpecName "kube-api-access-htlmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:39:55.275273 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.275257 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "314faf27-2a9f-45b1-8bc9-9defc3adb8f4" (UID: "314faf27-2a9f-45b1-8bc9-9defc3adb8f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:39:55.374287 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.374235 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-maas-api-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:39:55.374287 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.374256 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htlmx\" (UniqueName: \"kubernetes.io/projected/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-kube-api-access-htlmx\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:39:55.374287 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:55.374266 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/314faf27-2a9f-45b1-8bc9-9defc3adb8f4-openshift-service-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:39:56.087363 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:56.087333 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" Jul 07 19:39:56.087363 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:56.087353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w" event={"ID":"314faf27-2a9f-45b1-8bc9-9defc3adb8f4","Type":"ContainerDied","Data":"b6c3400c6bf6305bb7629ae9b0aac01791d9d122d088ecc05f3ba651ebfc6fa3"} Jul 07 19:39:56.087544 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:56.087410 2576 scope.go:117] "RemoveContainer" containerID="1925c18572d1efbe8ad62940c63e7f445d837c4ed6e05caa439eb945ca3fdf71" Jul 07 19:39:56.105956 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:56.105932 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w"] Jul 07 19:39:56.109885 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:56.109865 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c576d2-9676b4779-69q7w"] Jul 07 19:39:57.935753 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:57.935723 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="314faf27-2a9f-45b1-8bc9-9defc3adb8f4" path="/var/lib/kubelet/pods/314faf27-2a9f-45b1-8bc9-9defc3adb8f4/volumes" Jul 07 19:39:58.204076 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:58.204004 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:39:59.529211 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:39:59.529176 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:06.892432 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:06.892398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:06.992334 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:06.992303 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:37.297215 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:37.297188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:37.574519 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:37.574490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:38.083439 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.083395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:38.464260 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.464193 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:38.508233 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.508207 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5"] Jul 07 19:40:38.508457 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.508436 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" podUID="b79a98d0-7df2-44da-af1f-aaec61cbca56" containerName="maas-api" containerID="cri-o://ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52" gracePeriod=30 Jul 07 19:40:38.564463 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.564436 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:38.759149 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.759126 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:40:38.823051 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.823031 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b79a98d0-7df2-44da-af1f-aaec61cbca56-openshift-service-ca\") pod \"b79a98d0-7df2-44da-af1f-aaec61cbca56\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " Jul 07 19:40:38.823191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.823068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls\") pod \"b79a98d0-7df2-44da-af1f-aaec61cbca56\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " Jul 07 19:40:38.823191 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.823135 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7dkx\" (UniqueName: \"kubernetes.io/projected/b79a98d0-7df2-44da-af1f-aaec61cbca56-kube-api-access-q7dkx\") pod \"b79a98d0-7df2-44da-af1f-aaec61cbca56\" (UID: \"b79a98d0-7df2-44da-af1f-aaec61cbca56\") " Jul 07 19:40:38.823453 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.823431 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b79a98d0-7df2-44da-af1f-aaec61cbca56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b79a98d0-7df2-44da-af1f-aaec61cbca56" (UID: "b79a98d0-7df2-44da-af1f-aaec61cbca56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:40:38.823547 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.823536 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b79a98d0-7df2-44da-af1f-aaec61cbca56-openshift-service-ca\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:40:38.825358 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.825304 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b79a98d0-7df2-44da-af1f-aaec61cbca56-kube-api-access-q7dkx" (OuterVolumeSpecName: "kube-api-access-q7dkx") pod "b79a98d0-7df2-44da-af1f-aaec61cbca56" (UID: "b79a98d0-7df2-44da-af1f-aaec61cbca56"). InnerVolumeSpecName "kube-api-access-q7dkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:40:38.825480 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.825379 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b79a98d0-7df2-44da-af1f-aaec61cbca56" (UID: "b79a98d0-7df2-44da-af1f-aaec61cbca56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:40:38.924897 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.924872 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b79a98d0-7df2-44da-af1f-aaec61cbca56-maas-api-tls\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:40:38.924897 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:38.924894 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7dkx\" (UniqueName: \"kubernetes.io/projected/b79a98d0-7df2-44da-af1f-aaec61cbca56-kube-api-access-q7dkx\") on node \"ip-10-0-140-243.ec2.internal\" DevicePath \"\"" Jul 07 19:40:39.290871 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.290843 2576 generic.go:356] "Generic (PLEG): container finished" podID="b79a98d0-7df2-44da-af1f-aaec61cbca56" containerID="ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52" exitCode=0 Jul 07 19:40:39.291016 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.290890 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" Jul 07 19:40:39.291016 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.290929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" event={"ID":"b79a98d0-7df2-44da-af1f-aaec61cbca56","Type":"ContainerDied","Data":"ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52"} Jul 07 19:40:39.291016 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.290977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5" event={"ID":"b79a98d0-7df2-44da-af1f-aaec61cbca56","Type":"ContainerDied","Data":"64fcd7ec1a4284530906d6cf6a3efa69c594addd79d6832422adc0f416684d07"} Jul 07 19:40:39.291016 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.291003 2576 scope.go:117] "RemoveContainer" containerID="ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52" Jul 07 19:40:39.300067 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.300049 2576 scope.go:117] "RemoveContainer" containerID="ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52" Jul 07 19:40:39.300347 ip-10-0-140-243 kubenswrapper[2576]: E0707 19:40:39.300311 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52\": container with ID starting with ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52 not found: ID does not exist" containerID="ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52" Jul 07 19:40:39.300444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.300351 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52"} err="failed to get container status \"ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52\": rpc error: code = NotFound desc = could not find container \"ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52\": container with ID starting with ca3032b54c8c129064040739e0eaf1bdbb7c0548edd77c2d4bdab99419055a52 not found: ID does not exist" Jul 07 19:40:39.314311 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.314292 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5"] Jul 07 19:40:39.321178 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.321159 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2620f1-b5c8c4c9d-5tvq5"] Jul 07 19:40:39.935825 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:39.935790 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b79a98d0-7df2-44da-af1f-aaec61cbca56" path="/var/lib/kubelet/pods/b79a98d0-7df2-44da-af1f-aaec61cbca56/volumes" Jul 07 19:40:41.704154 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:41.704121 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sm4js"] Jul 07 19:40:45.405391 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:45.405357 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:45.507611 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:45.507568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:45.679103 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:45.679008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:47.239343 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:47.239301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:40:51.937148 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:51.937121 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-csvmb_887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea/copy-manifests/0.log" Jul 07 19:40:51.950351 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:51.950303 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-csvmb_887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea/manager/0.log" Jul 07 19:40:54.177987 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:54.177959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sm4js_73d02e81-2553-4f6c-aa80-503fafa27589/limitador/0.log" Jul 07 19:40:54.777663 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:54.777632 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q557k_bbf45b19-d725-4a45-99a4-c056f2d373fb/discovery/0.log" Jul 07 19:40:55.506896 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:55.506873 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-548dbc9c89-jx4rq_b089f97c-3e75-43dd-931a-4ce7c5cb2f11/router/0.log" Jul 07 19:40:55.963157 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:55.963130 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-s4cff_950de243-f634-4275-aea3-73d23bb9706c/main/0.log" Jul 07 19:40:56.081930 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:40:56.081901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-z2xm2_bcda21c7-b8a3-4327-af03-f6d425e270e9/main/0.log" Jul 07 19:41:00.694401 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:00.694369 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:41:00.794165 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:00.794139 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:41:04.045742 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:04.045707 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:41:04.051281 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:04.051259 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:41:04.188072 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:04.188048 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kfrcd_12e4cd8c-678c-4c7d-8d55-0354d18dea85/global-pull-secret-syncer/0.log" Jul 07 19:41:04.347723 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:04.347694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" Jul 07 19:41:04.522717 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:04.522694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-243.ec2.internal_565d89ca2fa2c4a95da46d78283f2b5a/haproxy/0.log" Jul 07 19:41:10.239597 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:10.239569 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sm4js_73d02e81-2553-4f6c-aa80-503fafa27589/limitador/0.log" Jul 07 19:41:12.065818 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.065789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:41:12.085528 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.085506 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64334dff-6a2d-418f-9540-f9804fa4b4af/alertmanager/0.log" Jul 07 19:41:12.114027 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.114008 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64334dff-6a2d-418f-9540-f9804fa4b4af/config-reloader/0.log" Jul 07 19:41:12.146031 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.146012 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64334dff-6a2d-418f-9540-f9804fa4b4af/kube-rbac-proxy-web/0.log" Jul 07 19:41:12.146760 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.146743 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cqddl_f33b645d-59c6-4a38-a6a3-d181c594285c/konnectivity-agent/0.log" limit=1024 Jul 07 19:41:12.178869 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.178853 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64334dff-6a2d-418f-9540-f9804fa4b4af/kube-rbac-proxy/0.log" Jul 07 19:41:12.205860 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.205845 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64334dff-6a2d-418f-9540-f9804fa4b4af/kube-rbac-proxy-metric/0.log" Jul 07 19:41:12.232998 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.232980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64334dff-6a2d-418f-9540-f9804fa4b4af/prom-label-proxy/0.log" Jul 07 19:41:12.260957 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.260941 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64334dff-6a2d-418f-9540-f9804fa4b4af/init-config-reloader/0.log" Jul 07 19:41:12.303343 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.303264 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-gvrw9_ccb7fdf2-25fc-4996-b5d2-c532576b4627/cluster-monitoring-operator/0.log" Jul 07 19:41:12.438256 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.438231 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7659ddcb75-ljtbk_90cd51ae-5070-435a-8b08-26ab4291d9c9/metrics-server/0.log" Jul 07 19:41:12.531086 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.531072 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6drz_af367a88-25a8-4fa0-b787-94db65474760/node-exporter/0.log" Jul 07 19:41:12.567916 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.567871 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6drz_af367a88-25a8-4fa0-b787-94db65474760/kube-rbac-proxy/0.log" Jul 07 19:41:12.610360 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.610341 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6drz_af367a88-25a8-4fa0-b787-94db65474760/init-textfile/0.log" Jul 07 19:41:12.926993 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.926945 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36989d3c-0aa4-4e88-87df-7a09d78859f4/prometheus/0.log" Jul 07 19:41:12.953874 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.953856 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36989d3c-0aa4-4e88-87df-7a09d78859f4/config-reloader/0.log" Jul 07 19:41:12.982279 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:12.982263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36989d3c-0aa4-4e88-87df-7a09d78859f4/thanos-sidecar/0.log" Jul 07 19:41:13.008815 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.008796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36989d3c-0aa4-4e88-87df-7a09d78859f4/kube-rbac-proxy-web/0.log" Jul 07 19:41:13.041045 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.041025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36989d3c-0aa4-4e88-87df-7a09d78859f4/kube-rbac-proxy/0.log" Jul 07 19:41:13.068814 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.068797 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36989d3c-0aa4-4e88-87df-7a09d78859f4/kube-rbac-proxy-thanos/0.log" Jul 07 19:41:13.100656 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.100641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36989d3c-0aa4-4e88-87df-7a09d78859f4/init-config-reloader/0.log" Jul 07 19:41:13.194021 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.193972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-xj4mk_07fd19ea-8aa7-4e35-a7d7-69cc8c92251f/prometheus-operator-admission-webhook/0.log" Jul 07 19:41:13.225609 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.225595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67fd7f8f6-s8zfr_eef204f9-06bb-4aa8-b116-e05cce1ad963/telemeter-client/0.log" Jul 07 19:41:13.252476 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.252463 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67fd7f8f6-s8zfr_eef204f9-06bb-4aa8-b116-e05cce1ad963/reload/0.log" Jul 07 19:41:13.280848 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.280832 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67fd7f8f6-s8zfr_eef204f9-06bb-4aa8-b116-e05cce1ad963/kube-rbac-proxy/0.log" Jul 07 19:41:13.316636 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.316615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8d858b5-p4zh5_b9c945b5-5035-4834-b8ff-6eb32a6aa968/thanos-query/0.log" Jul 07 19:41:13.343108 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.343095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8d858b5-p4zh5_b9c945b5-5035-4834-b8ff-6eb32a6aa968/kube-rbac-proxy-web/0.log" Jul 07 19:41:13.368971 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.368937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8d858b5-p4zh5_b9c945b5-5035-4834-b8ff-6eb32a6aa968/kube-rbac-proxy/0.log" Jul 07 19:41:13.394117 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.394096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8d858b5-p4zh5_b9c945b5-5035-4834-b8ff-6eb32a6aa968/prom-label-proxy/0.log" Jul 07 19:41:13.417992 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.417974 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8d858b5-p4zh5_b9c945b5-5035-4834-b8ff-6eb32a6aa968/kube-rbac-proxy-rules/0.log" Jul 07 19:41:13.441069 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:13.441049 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84d8d858b5-p4zh5_b9c945b5-5035-4834-b8ff-6eb32a6aa968/kube-rbac-proxy-metrics/0.log" Jul 07 19:41:14.191342 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.191290 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9"] Jul 07 19:41:14.191675 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.191659 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314faf27-2a9f-45b1-8bc9-9defc3adb8f4" containerName="maas-api" Jul 07 19:41:14.191675 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.191669 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="314faf27-2a9f-45b1-8bc9-9defc3adb8f4" containerName="maas-api" Jul 07 19:41:14.191751 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.191682 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79a98d0-7df2-44da-af1f-aaec61cbca56" containerName="maas-api" Jul 07 19:41:14.191751 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.191688 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79a98d0-7df2-44da-af1f-aaec61cbca56" containerName="maas-api" Jul 07 19:41:14.191813 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.191761 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="314faf27-2a9f-45b1-8bc9-9defc3adb8f4" containerName="maas-api" Jul 07 19:41:14.191813 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.191769 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b79a98d0-7df2-44da-af1f-aaec61cbca56" containerName="maas-api" Jul 07 19:41:14.194835 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.194819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.198689 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.198669 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4c88\"/\"kube-root-ca.crt\"" Jul 07 19:41:14.199719 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.199701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v4c88\"/\"default-dockercfg-drvns\"" Jul 07 19:41:14.200467 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.200449 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4c88\"/\"openshift-service-ca.crt\"" Jul 07 19:41:14.206936 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.206914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9"] Jul 07 19:41:14.300451 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.300431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-proc\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.300542 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.300474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-sys\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.300542 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.300494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-podres\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.300615 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.300549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-lib-modules\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.300615 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.300593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnwj\" (UniqueName: \"kubernetes.io/projected/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-kube-api-access-bxnwj\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.401731 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnwj\" (UniqueName: \"kubernetes.io/projected/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-kube-api-access-bxnwj\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.401805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-proc\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.401805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-sys\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.401805 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-podres\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.401902 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-lib-modules\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.401902 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-proc\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.401902 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-sys\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.402003 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-podres\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.402003 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.401927 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-lib-modules\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.411702 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.411674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnwj\" (UniqueName: \"kubernetes.io/projected/506c2ad1-5887-478f-a9d2-9d09bb12a3e7-kube-api-access-bxnwj\") pod \"perf-node-gather-daemonset-v78m9\" (UID: \"506c2ad1-5887-478f-a9d2-9d09bb12a3e7\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.504204 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.504188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:14.634040 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:14.633935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9"] Jul 07 19:41:14.636265 ip-10-0-140-243 kubenswrapper[2576]: W0707 19:41:14.636233 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod506c2ad1_5887_478f_a9d2_9d09bb12a3e7.slice/crio-e6ef78ed685e1c1493bf514775fe283dff9344f12d82a6724f26f8cd54ce3fd1 WatchSource:0}: Error finding container e6ef78ed685e1c1493bf514775fe283dff9344f12d82a6724f26f8cd54ce3fd1: Status 404 returned error can't find the container with id e6ef78ed685e1c1493bf514775fe283dff9344f12d82a6724f26f8cd54ce3fd1 Jul 07 19:41:15.359332 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:15.359300 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/1.log" Jul 07 19:41:15.363028 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:15.363008 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xhjj4_7a9b20b3-1e8f-460c-b497-4e32040140de/console-operator/2.log" Jul 07 19:41:15.455391 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:15.455368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" event={"ID":"506c2ad1-5887-478f-a9d2-9d09bb12a3e7","Type":"ContainerStarted","Data":"92a4b2443d1145df5795b7b14dabb7918062c657c95fd941ff75c44ee954e646"} Jul 07 19:41:15.455480 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:15.455409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" event={"ID":"506c2ad1-5887-478f-a9d2-9d09bb12a3e7","Type":"ContainerStarted","Data":"e6ef78ed685e1c1493bf514775fe283dff9344f12d82a6724f26f8cd54ce3fd1"} Jul 07 19:41:15.455545 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:15.455505 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:15.481275 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:15.481232 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" podStartSLOduration=1.481217935 podStartE2EDuration="1.481217935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:41:15.473097773 +0000 UTC m=+2412.063863990" watchObservedRunningTime="2026-07-07 19:41:15.481217935 +0000 UTC m=+2412.071984125" Jul 07 19:41:16.513854 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:16.513823 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-h8xxm_115370df-63e1-4e7a-ba41-60b67a3e8e51/volume-data-source-validator/0.log" Jul 07 19:41:17.643207 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:17.643176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2j5c6_de064a0b-8524-42b3-ad42-5e2c6dbe4dc1/dns/0.log" Jul 07 19:41:17.667265 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:17.667239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2j5c6_de064a0b-8524-42b3-ad42-5e2c6dbe4dc1/kube-rbac-proxy/0.log" Jul 07 19:41:17.800108 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:17.800087 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gxnw_9664d9cc-a34b-477c-97ad-047b1dce7293/dns-node-resolver/0.log" Jul 07 19:41:18.495607 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:18.495554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7r7rc_78c4fb26-b80c-4c87-9fab-cefe20c5a71c/node-ca/0.log" Jul 07 19:41:19.664931 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:19.664908 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q557k_bbf45b19-d725-4a45-99a4-c056f2d373fb/discovery/0.log" Jul 07 19:41:19.901868 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:19.901847 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-548dbc9c89-jx4rq_b089f97c-3e75-43dd-931a-4ce7c5cb2f11/router/0.log" Jul 07 19:41:20.747291 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:20.747264 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n699n_9e540e5a-bdce-4be1-bf26-d7bddd7c1629/serve-healthcheck-canary/0.log" Jul 07 19:41:21.355977 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:21.355947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-7wdsf_6a173c70-0bda-4d73-99e6-06dc7e1cf302/insights-operator/0.log" Jul 07 19:41:21.357297 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:21.357270 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-7wdsf_6a173c70-0bda-4d73-99e6-06dc7e1cf302/insights-operator/1.log" Jul 07 19:41:21.384913 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:21.384895 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wp2c_b3f9eed5-4256-4e43-846d-d84a76085137/kube-rbac-proxy/0.log" Jul 07 19:41:21.411452 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:21.411431 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wp2c_b3f9eed5-4256-4e43-846d-d84a76085137/exporter/0.log" Jul 07 19:41:21.440421 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:21.440400 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wp2c_b3f9eed5-4256-4e43-846d-d84a76085137/extractor/0.log" Jul 07 19:41:21.469720 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:21.469704 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-v78m9" Jul 07 19:41:24.809673 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:24.809643 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-csvmb_887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea/manager/0.log" Jul 07 19:41:24.829232 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:24.829209 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-csvmb_887cbfc8-4fbb-4cf2-acc6-1f7ea4dd2aea/copy-manifests/0.log" Jul 07 19:41:25.163444 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:25.163382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q557k_bbf45b19-d725-4a45-99a4-c056f2d373fb/discovery/0.log" Jul 07 19:41:25.452271 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:25.452203 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-548dbc9c89-jx4rq_b089f97c-3e75-43dd-931a-4ce7c5cb2f11/router/0.log" Jul 07 19:41:26.256654 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:26.256590 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c8bfdd549-krxlc_ec2371d0-481d-4fc0-b835-bffa93f2e2b8/manager/0.log" Jul 07 19:41:26.285001 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:26.284975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ph4st_a5611e0c-5d67-4385-bb07-df6124bd4858/openshift-lws-operator/0.log" Jul 07 19:41:26.760424 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:26.760405 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q557k_bbf45b19-d725-4a45-99a4-c056f2d373fb/discovery/0.log" Jul 07 19:41:26.932255 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:26.932234 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-548dbc9c89-jx4rq_b089f97c-3e75-43dd-931a-4ce7c5cb2f11/router/0.log" Jul 07 19:41:31.758202 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:31.758171 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7ffvv_62ad0e5b-0a7f-4355-890b-288d9781ff3a/kube-storage-version-migrator-operator/1.log" Jul 07 19:41:31.758939 ip-10-0-140-243 kubenswrapper[2576]: I0707 19:41:31.758923 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7ffvv_62ad0e5b-0a7f-4355-890b-288d9781ff3a/kube-storage-version-migrator-operator/0.log"