Jul 01 16:38:35.379071 ip-10-0-143-15 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:38:36.003943 ip-10-0-143-15 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:38:36.003943 ip-10-0-143-15 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:38:36.003943 ip-10-0-143-15 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:38:36.003943 ip-10-0-143-15 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:38:36.003943 ip-10-0-143-15 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:38:36.005846 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.005773 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:38:36.012437 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012412 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:36.012437 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012430 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:36.012437 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012434 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:36.012437 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012437 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:36.012437 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012440 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:36.012437 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012443 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012447 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012449 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012452 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012455 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012457 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012460 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012463 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012465 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012468 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012470 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012473 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012476 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012478 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012481 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012483 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012486 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012489 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012491 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012494 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:36.012629 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012496 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012499 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012501 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012504 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012506 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012509 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012512 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012516 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012521 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012525 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012528 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012531 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012534 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012537 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012540 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012543 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012547 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012551 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:36.013110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012556 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012559 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012562 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012564 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012567 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012570 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012572 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012575 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012578 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012580 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012584 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012587 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012589 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012592 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012594 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012597 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012600 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012602 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012605 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:36.013540 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012607 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012610 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012612 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012615 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012617 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012620 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012622 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012625 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012628 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012631 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012634 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012636 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012639 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012642 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012645 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012647 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012650 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012652 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012655 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012657 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:36.014019 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012660 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012663 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012665 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012668 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012670 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012673 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012675 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012677 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012680 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012682 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012685 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012687 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012690 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012692 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012695 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012715 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.012719 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013399 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013406 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013409 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:36.014521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013412 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013416 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013420 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013423 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013425 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013428 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013431 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013433 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013436 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013438 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013441 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013444 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013446 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013449 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013452 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013454 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013457 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013459 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013463 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:36.015004 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013467 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013470 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013472 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013475 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013477 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013480 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013483 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013485 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013488 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013490 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013493 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013495 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013498 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013501 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013504 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013507 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013510 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013512 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013515 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013518 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:36.015453 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013520 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013523 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013526 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013528 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013531 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013534 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013536 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013539 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013542 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013545 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013547 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013550 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013553 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013556 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013558 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013560 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013563 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013565 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013568 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013570 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:36.015946 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013573 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013576 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013579 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013581 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013584 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013586 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013590 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013592 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013595 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013598 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013600 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013603 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013605 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013608 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013611 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013614 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013616 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013619 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013621 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013624 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:36.016408 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013626 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013630 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013632 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013636 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013640 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013644 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013647 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013650 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013652 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013655 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013657 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013660 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013662 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013665 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013669 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013672 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.013675 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014070 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014077 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:36.016891 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014080 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014082 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014085 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014088 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014090 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014093 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014095 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014098 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014101 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014103 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014105 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014108 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014110 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014113 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014116 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014119 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014122 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014125 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014130 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014133 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:36.017369 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014136 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014140 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014144 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014146 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014149 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014152 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014154 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014157 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014159 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014161 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014164 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014167 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014169 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014172 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014174 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014177 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014180 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014184 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014187 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:36.017875 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014189 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014192 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014195 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014197 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014200 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014202 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014204 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014207 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014210 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014213 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014216 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014218 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014221 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014223 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014226 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014228 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014231 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014233 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014236 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014238 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:36.018358 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014241 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014243 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014246 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014248 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014250 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014253 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014255 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014258 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014260 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014263 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014265 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014268 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014270 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014272 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014275 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014278 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014280 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014283 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014287 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014291 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:36.018833 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014294 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014297 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014300 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014302 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014304 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014307 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014310 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014312 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014314 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014317 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014319 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014322 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014324 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014327 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014329 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014332 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014334 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.014337 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014410 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014416 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014421 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:38:36.019337 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014426 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014429 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014432 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014436 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014441 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014444 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014447 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014450 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014453 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014458 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014461 2575 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014464 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014467 2575 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014471 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014474 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014478 2575 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014481 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014484 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014487 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014490 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014494 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014497 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014500 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:38:36.019904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014503 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014506 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014509 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014512 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014515 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014518 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014522 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014525 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014528 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014531 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014534 2575 flags.go:64] FLAG: --enable-server="true" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014537 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014541 2575 flags.go:64] FLAG: --event-burst="100" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014544 2575 flags.go:64] FLAG: --event-qps="50" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014546 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014549 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014552 2575 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014555 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014560 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014564 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014566 2575 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014569 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014572 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014576 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014579 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:38:36.020436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014581 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014584 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014587 2575 flags.go:64] FLAG: --feature-gates="" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014590 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014593 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014596 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014599 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014602 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014605 2575 flags.go:64] FLAG: --help="false" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014608 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-143-15.ec2.internal" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014611 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014613 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014616 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014620 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014623 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014626 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014629 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014631 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014634 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014636 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014640 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014642 2575 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014645 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014648 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:38:36.021162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014650 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014655 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014658 2575 flags.go:64] FLAG: --lock-file="" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014661 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014664 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014667 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014672 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014675 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014678 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014681 2575 flags.go:64] FLAG: --logging-format="text" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014684 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014687 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014690 2575 flags.go:64] FLAG: --manifest-url="" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014693 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014710 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014713 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014717 2575 flags.go:64] FLAG: --max-pods="110" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014720 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014723 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014726 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014729 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014732 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014734 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014738 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014745 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:38:36.021812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014748 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014751 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014754 2575 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014756 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014761 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014764 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014767 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014770 2575 flags.go:64] FLAG: --port="10250" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014773 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014777 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e30c4fb5076072a" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014780 2575 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014783 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014786 2575 flags.go:64] FLAG: --register-node="true" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014789 2575 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014792 2575 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014796 2575 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014799 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014802 2575 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014805 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014808 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014811 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014814 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014816 2575 flags.go:64] FLAG: --runonce="false" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014819 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014822 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:38:36.022396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014825 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014828 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014830 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014833 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014836 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014839 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014842 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014845 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014848 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014851 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014853 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014857 2575 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014859 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014864 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014867 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014870 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014876 2575 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014879 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014881 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014884 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014887 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014890 2575 flags.go:64] FLAG: --v="2" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014894 2575 flags.go:64] FLAG: --version="false" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014898 2575 flags.go:64] FLAG: --vmodule="" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014902 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:38:36.022996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.014905 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015013 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015017 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015020 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015024 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015027 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015029 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015032 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015035 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015038 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015040 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015043 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015045 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015048 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015050 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015053 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015056 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015059 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015061 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015064 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:36.023621 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015067 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015071 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015073 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015077 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015079 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015082 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015085 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015088 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015092 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015096 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015099 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015102 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015105 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015107 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015110 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015113 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015115 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015118 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015121 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015123 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:36.024105 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015126 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015128 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015131 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015133 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015136 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015138 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015141 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015143 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015146 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015148 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015151 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015153 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015156 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015159 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015162 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015167 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015170 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015173 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015176 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:36.024593 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015179 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015182 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015185 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015188 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015191 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015194 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015197 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015199 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015202 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015206 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015209 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015212 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015215 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015217 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015220 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015222 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015225 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015228 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015230 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:36.025070 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015233 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015235 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015238 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015240 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015243 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015245 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015247 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015251 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015254 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015258 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015260 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015263 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015265 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015268 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015270 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015273 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015275 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015278 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015280 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015283 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:36.025519 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015286 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.015288 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.016108 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.022424 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.022440 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.023437 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.023448 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023502 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023507 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023511 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023514 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023517 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023520 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023524 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:36.026011 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023527 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023529 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023532 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023536 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023539 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023541 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023544 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023547 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023550 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023553 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023556 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023558 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023561 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023564 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023567 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023569 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023572 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023574 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023577 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023580 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:36.026357 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023582 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023585 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023589 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023592 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023594 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023597 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023601 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023605 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023607 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023610 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023613 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023615 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023618 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023621 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023623 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023626 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023629 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023631 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023634 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023638 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:36.026925 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023641 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023644 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023646 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023649 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023652 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023654 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023657 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023659 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023662 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023664 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023667 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023669 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023672 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023675 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023679 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023683 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023687 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023690 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023693 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:36.027395 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023706 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023710 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023713 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023716 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023719 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023722 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023725 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023727 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023730 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023733 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023735 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023738 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023741 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023744 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023747 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023749 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023752 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023755 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023757 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023760 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:36.027846 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023762 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023765 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023768 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023770 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023773 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023775 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023778 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023781 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023785 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023790 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023793 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023796 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023799 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.023804 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:38:36.028327 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023913 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023917 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023920 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023923 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023926 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023929 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023931 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023934 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023936 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023939 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023943 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023945 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023948 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023951 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023954 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023957 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023959 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023962 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023965 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:36.028654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023967 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023970 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023972 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023975 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023977 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023980 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023983 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023985 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023988 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023991 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023993 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023996 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.023999 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024001 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024004 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024006 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024009 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024013 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024016 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024019 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:36.029110 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024021 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024024 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024026 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024029 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024031 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024034 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024037 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024041 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024043 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024046 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024049 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024051 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024054 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024056 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024059 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024062 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024064 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024066 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024069 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024072 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:36.029579 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024075 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024077 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024080 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024083 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024085 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024087 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024090 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024092 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024095 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024097 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024100 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024102 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024104 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024107 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024110 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024112 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024115 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024117 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024120 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024123 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:36.030078 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024125 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024128 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024131 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024134 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024137 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024141 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024144 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024147 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024149 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024152 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024155 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024158 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024160 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024163 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024166 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024169 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024171 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024173 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024176 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:36.030547 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:36.024178 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:36.031009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.024183 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:38:36.031009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.024280 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:38:36.031009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.026151 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:38:36.031009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.027514 2575 server.go:1019] "Starting client certificate rotation" Jul 01 16:38:36.031009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.027612 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:38:36.031009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.027654 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:38:36.031009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.030061 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:38:36.031187 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.031151 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:38:36.044388 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.044368 2575 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:38:36.046517 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.046497 2575 log.go:25] "Validated CRI v1 image API" Jul 01 16:38:36.048412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.048396 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:38:36.050983 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.050963 2575 fs.go:135] Filesystem UUIDs: map[461eca74-b52c-4a71-ac1b-4fe4dc1dff5e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dcfbaab3-a402-4b51-87a8-01e12cee9c9a:/dev/nvme0n1p3] Jul 01 16:38:36.051034 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.050983 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:38:36.056116 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.056014 2575 manager.go:216] Machine: {Timestamp:2026-07-01 16:38:36.054476748 +0000 UTC m=+0.545299993 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100033 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec274d7d7029a04a221190c9f956c321 SystemUUID:ec274d7d-7029-a04a-2211-90c9f956c321 BootID:ef3dd064-5a6b-406f-b562-9f1ae142b33f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:fd:30:9d:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:fd:30:9d:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:91:74:ec:16:65 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:38:36.056116 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.056112 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:38:36.056214 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.056204 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:38:36.059313 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.059292 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:38:36.059434 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.059316 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-15.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:38:36.059905 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.059895 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:38:36.059935 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.059908 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:38:36.059935 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.059916 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:38:36.059935 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.059928 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:38:36.060617 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.060608 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:38:36.063360 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.063346 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:38:36.064398 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.064387 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:38:36.064497 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.064488 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:38:36.064530 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.064515 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:38:36.064530 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.064524 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:38:36.064584 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.064534 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:38:36.064584 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.064542 2575 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:38:36.064584 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.064550 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:38:36.065046 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.065028 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:38:36.065119 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.065058 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:38:36.067444 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.067399 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:38:36.070820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.070802 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:38:36.070963 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.070851 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:38:36.071037 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071025 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:38:36.071081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071045 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:38:36.071081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071054 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:38:36.071081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071064 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:38:36.071081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071075 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:38:36.071188 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071084 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:38:36.071469 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071460 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:38:36.071499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071470 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:38:36.071499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071476 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:38:36.071499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071482 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:38:36.071499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071489 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:38:36.071499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.071497 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:38:36.072068 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.072059 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:38:36.072099 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.072070 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:38:36.075147 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.075134 2575 server.go:1268] "Started kubelet" Jul 01 16:38:36.075250 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.075204 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:38:36.075303 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.075270 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:38:36.075409 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.075382 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:38:36.075866 ip-10-0-143-15 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:38:36.076278 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.076261 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:38:36.077338 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.077319 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:38:36.077469 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.077453 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-15.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:38:36.077755 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.077730 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:38:36.079989 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.079973 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:38:36.081224 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.081210 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:38:36.081224 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.081218 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:38:36.081347 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.081316 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:36.082078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082063 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:38:36.082194 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082075 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:38:36.082194 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082101 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:38:36.082194 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082156 2575 factory.go:55] Registering systemd factory Jul 01 16:38:36.082194 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082171 2575 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:38:36.082385 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082205 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:38:36.082385 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082214 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:38:36.082465 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082415 2575 factory.go:153] Registering CRI-O factory Jul 01 16:38:36.082465 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082431 2575 factory.go:223] Registration of the crio container factory successfully Jul 01 16:38:36.082538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082491 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:38:36.082538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082514 2575 factory.go:103] Registering Raw factory Jul 01 16:38:36.082538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.082531 2575 manager.go:1196] Started watching for new ooms in manager Jul 01 16:38:36.084933 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.084919 2575 manager.go:349] Starting recovery of all containers Jul 01 16:38:36.086110 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.086081 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 16:38:36.086211 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.086174 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 16:38:36.086211 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.086194 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:38:36.087095 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.086097 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-15.ec2.internal.18be37daf734951d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-15.ec2.internal,UID:ip-10-0-143-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-15.ec2.internal,},FirstTimestamp:2026-07-01 16:38:36.075111709 +0000 UTC m=+0.565934953,LastTimestamp:2026-07-01 16:38:36.075111709 +0000 UTC m=+0.565934953,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-15.ec2.internal,}" Jul 01 16:38:36.096280 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.096261 2575 manager.go:354] Recovery completed Jul 01 16:38:36.100363 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.100350 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:36.102039 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.102023 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:36.102108 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.102049 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:36.102108 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.102058 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:36.102581 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.102568 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:38:36.102623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.102582 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:38:36.102623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.102589 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:36.102623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.102598 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:38:36.103723 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.103694 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:36.103796 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.103732 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:36.103796 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.103741 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:36.104387 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.104331 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-15.ec2.internal.18be37daf8cf6f10 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-15.ec2.internal,UID:ip-10-0-143-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-15.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-15.ec2.internal,},FirstTimestamp:2026-07-01 16:38:36.102037264 +0000 UTC m=+0.592860508,LastTimestamp:2026-07-01 16:38:36.102037264 +0000 UTC m=+0.592860508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-15.ec2.internal,}" Jul 01 16:38:36.104758 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.104746 2575 policy_none.go:49] "None policy: Start" Jul 01 16:38:36.104796 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.104762 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:38:36.104796 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.104772 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:38:36.106684 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.106672 2575 policy_none.go:47] "Start" Jul 01 16:38:36.112453 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.112435 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlwds" Jul 01 16:38:36.113647 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.113592 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-15.ec2.internal.18be37daf8cfad84 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-15.ec2.internal,UID:ip-10-0-143-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-15.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-15.ec2.internal,},FirstTimestamp:2026-07-01 16:38:36.102053252 +0000 UTC m=+0.592876500,LastTimestamp:2026-07-01 16:38:36.102053252 +0000 UTC m=+0.592876500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-15.ec2.internal,}" Jul 01 16:38:36.115869 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.115819 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-15.ec2.internal.18be37daf8cfd047 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-15.ec2.internal,UID:ip-10-0-143-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-15.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-15.ec2.internal,},FirstTimestamp:2026-07-01 16:38:36.102062151 +0000 UTC m=+0.592885396,LastTimestamp:2026-07-01 16:38:36.102062151 +0000 UTC m=+0.592885396,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-15.ec2.internal,}" Jul 01 16:38:36.122833 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.122815 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlwds" Jul 01 16:38:36.125690 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.125632 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-15.ec2.internal.18be37daf8cf6f10\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-15.ec2.internal.18be37daf8cf6f10 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-15.ec2.internal,UID:ip-10-0-143-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-15.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-15.ec2.internal,},FirstTimestamp:2026-07-01 16:38:36.102037264 +0000 UTC m=+0.592860508,LastTimestamp:2026-07-01 16:38:36.103720671 +0000 UTC m=+0.594543916,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-15.ec2.internal,}" Jul 01 16:38:36.136249 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.136236 2575 manager.go:337] "Starting Device Plugin manager" Jul 01 16:38:36.136318 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.136265 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:38:36.136318 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.136275 2575 server.go:87] "Starting device plugin registration server" Jul 01 16:38:36.136496 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.136482 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:38:36.136578 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.136498 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:38:36.136654 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.136591 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:38:36.137052 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.136672 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:38:36.137052 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.136684 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:38:36.137267 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.137244 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:38:36.137347 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.137297 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:36.147973 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.147947 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:38:36.149262 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.149248 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:38:36.149325 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.149308 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:38:36.149356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.149345 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:38:36.149394 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:36.149381 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:38:36.152346 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:36.152332 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:37.253072 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.253054 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:37.253895 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.253876 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:37.253960 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.253900 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:37.253960 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.253910 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:37.253960 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.253931 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.262611 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.262594 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.262656 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.262624 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-15.ec2.internal\": node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.265782 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.265765 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal"] Jul 01 16:38:37.265823 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.265819 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:37.266618 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.266605 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:37.266668 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.266638 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:37.266668 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.266647 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:37.268868 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.268856 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:37.269014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.269002 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.269075 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.269066 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:37.269513 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.269500 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:37.269573 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.269525 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:37.269573 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.269535 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:37.270099 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.270046 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:37.270099 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.270085 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:37.270099 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.270098 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:37.272127 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.272112 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.272205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.272151 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:37.272820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.272805 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:37.272889 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.272829 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:37.272889 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.272848 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:37.292255 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.292234 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.299543 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.299523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3dd9e1f9d302bce07c5188b8e6745902-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal\" (UID: \"3dd9e1f9d302bce07c5188b8e6745902\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.299624 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.299556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd9e1f9d302bce07c5188b8e6745902-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal\" (UID: \"3dd9e1f9d302bce07c5188b8e6745902\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.299624 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.299579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ecacabbf6c7581c4fa7099252af4d71e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-15.ec2.internal\" (UID: \"ecacabbf6c7581c4fa7099252af4d71e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.305988 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.305968 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-15.ec2.internal\" not found" node="ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.310183 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.310169 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-15.ec2.internal\" not found" node="ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.392529 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.392509 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.399713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.399694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ecacabbf6c7581c4fa7099252af4d71e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-15.ec2.internal\" (UID: \"ecacabbf6c7581c4fa7099252af4d71e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.399767 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.399718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3dd9e1f9d302bce07c5188b8e6745902-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal\" (UID: \"3dd9e1f9d302bce07c5188b8e6745902\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.399767 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.399736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd9e1f9d302bce07c5188b8e6745902-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal\" (UID: \"3dd9e1f9d302bce07c5188b8e6745902\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.399848 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.399766 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3dd9e1f9d302bce07c5188b8e6745902-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal\" (UID: \"3dd9e1f9d302bce07c5188b8e6745902\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.399848 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.399788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ecacabbf6c7581c4fa7099252af4d71e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-15.ec2.internal\" (UID: \"ecacabbf6c7581c4fa7099252af4d71e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.399848 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.399817 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3dd9e1f9d302bce07c5188b8e6745902-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal\" (UID: \"3dd9e1f9d302bce07c5188b8e6745902\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.493400 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.493367 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.594244 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.594175 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.608667 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.608652 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.612014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:37.611999 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" Jul 01 16:38:37.694312 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.694276 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.794811 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.794774 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.895291 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.895231 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:37.995790 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:37.995757 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:38.043205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.043178 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:38:38.043599 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.043315 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:38:38.096170 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:38.096151 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:38.143485 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.143435 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:33:37 +0000 UTC" deadline="2028-03-18 12:31:52.07301581 +0000 UTC" Jul 01 16:38:38.143485 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.143480 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15019h53m13.929539675s" Jul 01 16:38:38.157732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.157682 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:38.158715 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.158703 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:38.158777 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.158731 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:38.158777 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.158744 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:38.169379 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.169365 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:38.196954 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:38.196931 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:38.220138 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.220119 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:38.297867 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:38.297846 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:38.398263 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:38.398232 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-15.ec2.internal\" not found" Jul 01 16:38:38.426398 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:38.426356 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd9e1f9d302bce07c5188b8e6745902.slice/crio-4d8d376e19740924e8931f913d2a45d0928aa4853eb64dfe75605ec640b0466f WatchSource:0}: Error finding container 4d8d376e19740924e8931f913d2a45d0928aa4853eb64dfe75605ec640b0466f: Status 404 returned error can't find the container with id 4d8d376e19740924e8931f913d2a45d0928aa4853eb64dfe75605ec640b0466f Jul 01 16:38:38.426757 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:38.426738 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecacabbf6c7581c4fa7099252af4d71e.slice/crio-a937e5e99a5debc0f389644d8d7790c003ffbc43a6ef94b5ceaff4a04fc0fb7c WatchSource:0}: Error finding container a937e5e99a5debc0f389644d8d7790c003ffbc43a6ef94b5ceaff4a04fc0fb7c: Status 404 returned error can't find the container with id a937e5e99a5debc0f389644d8d7790c003ffbc43a6ef94b5ceaff4a04fc0fb7c Jul 01 16:38:38.431096 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.431081 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:38:38.459876 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.459859 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:38.497422 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.497403 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" Jul 01 16:38:38.510013 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.509994 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:38:38.511276 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.511265 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" Jul 01 16:38:38.530123 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:38.530106 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:38:39.082008 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.081745 2575 apiserver.go:52] "Watching apiserver" Jul 01 16:38:39.091556 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.090640 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:38:39.091556 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.091156 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-rcbfd","openshift-multus/multus-additional-cni-plugins-r5z6q","openshift-multus/multus-mj2kx","openshift-multus/network-metrics-daemon-4tkdg","openshift-network-diagnostics/network-check-target-ngrc2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9","openshift-cluster-node-tuning-operator/tuned-dzkfz","openshift-dns/node-resolver-8mz4h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal","openshift-network-operator/iptables-alerter-xgwmk","openshift-ovn-kubernetes/ovnkube-node-d8vw7","kube-system/global-pull-secret-syncer-7s446","kube-system/konnectivity-agent-86n6c","kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal"] Jul 01 16:38:39.094591 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.094100 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.096348 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.096306 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.097211 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.097172 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rw9v9\"" Jul 01 16:38:39.097493 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.097476 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:38:39.098522 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.098508 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.099587 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.099567 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.099895 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.099877 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.100612 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.100595 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:39.100696 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.100667 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:39.105237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.104811 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:38:39.105237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.105036 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:38:39.105358 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.105260 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:38:39.105619 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.105530 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2ppc2\"" Jul 01 16:38:39.106078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.105786 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:38:39.106078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.106006 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.106301 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.106223 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.106442 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.106421 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4kx55\"" Jul 01 16:38:39.106556 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.106467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:39.106556 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.106543 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:39.107199 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.107181 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.108026 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.107361 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.109273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.109254 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.111712 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.111898 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.112054 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.112210 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.112405 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttrbl\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.113227 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.113403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ns9zx\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.113948 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.114118 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.114299 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b6866\"" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.114397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.114971 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.114496 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.116728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysctl-conf\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.116780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-system-cni-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.116816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-k8s-cni-cncf-io\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.116842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-kubelet\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.116879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-host\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.116904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.116909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-netns\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysconfig\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/601d2af6-79e1-4877-b8b3-4ed0ac816d76-tmp\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngdx\" (UniqueName: \"kubernetes.io/projected/601d2af6-79e1-4877-b8b3-4ed0ac816d76-kube-api-access-mngdx\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-cni-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-cni-bin\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-hostroot\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqlfv\" (UniqueName: \"kubernetes.io/projected/632c8f38-f52d-415b-8024-6694e28d38e3-kube-api-access-vqlfv\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysctl-d\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.117854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-lib-modules\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.118285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.118086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-var-lib-kubelet\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.119603 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119435 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-cnibin\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.119603 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119488 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:38:39.119603 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-kubernetes\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.119789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119612 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.119789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-socket-dir-parent\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.119789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119733 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-etc-kubernetes\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.119789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-modprobe-d\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-run\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119832 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-sys\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-tuned\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632c8f38-f52d-415b-8024-6694e28d38e3-cni-binary-copy\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.119990 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/632c8f38-f52d-415b-8024-6694e28d38e3-multus-daemon-config\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-systemd\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3941034-4536-4110-92dc-9604beaadb93-agent-certs\") pod \"konnectivity-agent-86n6c\" (UID: \"d3941034-4536-4110-92dc-9604beaadb93\") " pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.120110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-os-release\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.120636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-conf-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.120636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120199 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3941034-4536-4110-92dc-9604beaadb93-konnectivity-ca\") pod \"konnectivity-agent-86n6c\" (UID: \"d3941034-4536-4110-92dc-9604beaadb93\") " pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.120636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-cni-multus\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.120636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.120255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-multus-certs\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.122896 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.122545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.124445 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.123389 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:38:39.124445 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.123876 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:38:39.124445 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.123915 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:38:39.124445 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.124026 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.124445 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.124304 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:38:39.124764 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.124555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.124764 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.124676 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.124764 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.124714 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:39.124912 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.124561 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:38:39.127919 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.127896 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7hx2k\"" Jul 01 16:38:39.128008 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.127995 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kmpgg\"" Jul 01 16:38:39.132831 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.132812 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:38:39.133101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.133083 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:38:39.133375 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.133212 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-28vs7\"" Jul 01 16:38:39.140221 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.140199 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2fbjw" Jul 01 16:38:39.148194 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.148174 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2fbjw" Jul 01 16:38:39.170364 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.170321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" event={"ID":"3dd9e1f9d302bce07c5188b8e6745902","Type":"ContainerStarted","Data":"4d8d376e19740924e8931f913d2a45d0928aa4853eb64dfe75605ec640b0466f"} Jul 01 16:38:39.171934 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.171823 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" event={"ID":"ecacabbf6c7581c4fa7099252af4d71e","Type":"ContainerStarted","Data":"a937e5e99a5debc0f389644d8d7790c003ffbc43a6ef94b5ceaff4a04fc0fb7c"} Jul 01 16:38:39.198838 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.198818 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:38:39.220385 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220360 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-hostroot\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.220509 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:39.220509 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.220509 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.220509 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220506 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4sc\" (UniqueName: \"kubernetes.io/projected/62766743-c21d-4665-81c0-3ce948906ee4-kube-api-access-4d4sc\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220518 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-hostroot\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-etc-selinux\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-hosts-file\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-lib-modules\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220584 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-var-lib-kubelet\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/533e899c-b8a1-430f-b439-82348701874e-serviceca\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-slash\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-var-lib-kubelet\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-ovn\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.220719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-kubernetes\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220728 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-lib-modules\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-system-cni-dir\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220789 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-kubernetes\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-iptables-alerter-script\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-ovnkube-script-lib\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-run\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-sys\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220924 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-ovnkube-config\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3941034-4536-4110-92dc-9604beaadb93-agent-certs\") pod \"konnectivity-agent-86n6c\" (UID: \"d3941034-4536-4110-92dc-9604beaadb93\") " pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220965 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-run\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.220969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-os-release\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-conf-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221019 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-os-release\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221032 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-systemd\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.221158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221067 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-sys\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-node-log\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3941034-4536-4110-92dc-9604beaadb93-konnectivity-ca\") pod \"konnectivity-agent-86n6c\" (UID: \"d3941034-4536-4110-92dc-9604beaadb93\") " pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221158 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-conf-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-cni-bin\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-system-cni-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-kubelet\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgtm7\" (UniqueName: \"kubernetes.io/projected/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-kube-api-access-rgtm7\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-host\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-netns\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221447 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221508 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-netns\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221556 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-system-cni-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221597 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-kubelet\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221651 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-host\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221671 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3941034-4536-4110-92dc-9604beaadb93-konnectivity-ca\") pod \"konnectivity-agent-86n6c\" (UID: \"d3941034-4536-4110-92dc-9604beaadb93\") " pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.221826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-cnibin\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71d69444-0428-4688-9001-3b5697c4fd16-kubelet-config\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-socket-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-device-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/601d2af6-79e1-4877-b8b3-4ed0ac816d76-tmp\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.221978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngdx\" (UniqueName: \"kubernetes.io/projected/601d2af6-79e1-4877-b8b3-4ed0ac816d76-kube-api-access-mngdx\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-cni-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-cni-bin\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqlfv\" (UniqueName: \"kubernetes.io/projected/632c8f38-f52d-415b-8024-6694e28d38e3-kube-api-access-vqlfv\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-sys-fs\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222436 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-cni-dir\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-host-slash\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysctl-d\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.222511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-cnibin\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-os-release\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-log-socket\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-cni-netd\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-socket-dir-parent\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-etc-kubernetes\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71d69444-0428-4688-9001-3b5697c4fd16-dbus\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222681 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-cni-bin\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsdzt\" (UniqueName: \"kubernetes.io/projected/7c472a26-4f40-44d5-a402-20c081f11250-kube-api-access-gsdzt\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222709 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-cnibin\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-multus-socket-dir-parent\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-modprobe-d\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222818 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-etc-kubernetes\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-tuned\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632c8f38-f52d-415b-8024-6694e28d38e3-cni-binary-copy\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222854 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysctl-d\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.223186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/632c8f38-f52d-415b-8024-6694e28d38e3-multus-daemon-config\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-registration-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222924 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-systemd-units\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-var-lib-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.222993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-systemd\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhlrc\" (UniqueName: \"kubernetes.io/projected/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-kube-api-access-xhlrc\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab81a402-ca3f-417c-8127-f3f7291fd491-ovn-node-metrics-cert\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-cni-multus\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-multus-certs\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-tmp-dir\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljzl\" (UniqueName: \"kubernetes.io/projected/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-kube-api-access-8ljzl\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-kubelet\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-etc-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-env-overrides\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcz9q\" (UniqueName: \"kubernetes.io/projected/ab81a402-ca3f-417c-8127-f3f7291fd491-kube-api-access-bcz9q\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.224002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysctl-conf\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223305 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-k8s-cni-cncf-io\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmvgw\" (UniqueName: \"kubernetes.io/projected/533e899c-b8a1-430f-b439-82348701874e-kube-api-access-jmvgw\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-run-ovn-kubernetes\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/533e899c-b8a1-430f-b439-82348701874e-host\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-run-netns\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632c8f38-f52d-415b-8024-6694e28d38e3-cni-binary-copy\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-modprobe-d\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysconfig\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysconfig\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223691 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-systemd\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-var-lib-cni-multus\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-multus-certs\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223887 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/632c8f38-f52d-415b-8024-6694e28d38e3-multus-daemon-config\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223898 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-sysctl-conf\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.223950 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/632c8f38-f52d-415b-8024-6694e28d38e3-host-run-k8s-cni-cncf-io\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.225268 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/601d2af6-79e1-4877-b8b3-4ed0ac816d76-tmp\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.225633 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.225394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3941034-4536-4110-92dc-9604beaadb93-agent-certs\") pod \"konnectivity-agent-86n6c\" (UID: \"d3941034-4536-4110-92dc-9604beaadb93\") " pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.226538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.226515 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/601d2af6-79e1-4877-b8b3-4ed0ac816d76-etc-tuned\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.232970 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.232919 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngdx\" (UniqueName: \"kubernetes.io/projected/601d2af6-79e1-4877-b8b3-4ed0ac816d76-kube-api-access-mngdx\") pod \"tuned-dzkfz\" (UID: \"601d2af6-79e1-4877-b8b3-4ed0ac816d76\") " pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.237039 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.237014 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqlfv\" (UniqueName: \"kubernetes.io/projected/632c8f38-f52d-415b-8024-6694e28d38e3-kube-api-access-vqlfv\") pod \"multus-mj2kx\" (UID: \"632c8f38-f52d-415b-8024-6694e28d38e3\") " pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.324031 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.324160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-systemd\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.324160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-node-log\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.324160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.324160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-cni-bin\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.324160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324130 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgtm7\" (UniqueName: \"kubernetes.io/projected/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-kube-api-access-rgtm7\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.324160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-cnibin\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71d69444-0428-4688-9001-3b5697c4fd16-kubelet-config\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-socket-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-device-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-sys-fs\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-host-slash\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-os-release\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-log-socket\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324320 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-cni-netd\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71d69444-0428-4688-9001-3b5697c4fd16-dbus\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsdzt\" (UniqueName: \"kubernetes.io/projected/7c472a26-4f40-44d5-a402-20c081f11250-kube-api-access-gsdzt\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-registration-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-systemd-units\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-var-lib-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.324436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324447 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhlrc\" (UniqueName: \"kubernetes.io/projected/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-kube-api-access-xhlrc\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab81a402-ca3f-417c-8127-f3f7291fd491-ovn-node-metrics-cert\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-tmp-dir\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljzl\" (UniqueName: \"kubernetes.io/projected/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-kube-api-access-8ljzl\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-kubelet\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324578 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-etc-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-env-overrides\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcz9q\" (UniqueName: \"kubernetes.io/projected/ab81a402-ca3f-417c-8127-f3f7291fd491-kube-api-access-bcz9q\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmvgw\" (UniqueName: \"kubernetes.io/projected/533e899c-b8a1-430f-b439-82348701874e-kube-api-access-jmvgw\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-run-ovn-kubernetes\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/533e899c-b8a1-430f-b439-82348701874e-host\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-run-netns\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4sc\" (UniqueName: \"kubernetes.io/projected/62766743-c21d-4665-81c0-3ce948906ee4-kube-api-access-4d4sc\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.325231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-etc-selinux\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-hosts-file\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/533e899c-b8a1-430f-b439-82348701874e-serviceca\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-slash\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-ovn\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-system-cni-dir\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-iptables-alerter-script\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-ovnkube-script-lib\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.324989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.325015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-ovnkube-config\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.325570 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-ovnkube-config\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.325657 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.325701 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret podName:71d69444-0428-4688-9001-3b5697c4fd16 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:39.825685244 +0000 UTC m=+3.300753255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret") pod "global-pull-secret-syncer-7s446" (UID: "71d69444-0428-4688-9001-3b5697c4fd16") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.325857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-systemd\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.325899 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-node-log\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326005 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.326092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326047 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-cni-bin\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326216 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-cnibin\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326417 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-kubelet\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326559 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71d69444-0428-4688-9001-3b5697c4fd16-kubelet-config\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326673 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-socket-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-sys-fs\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.326802 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-host-slash\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.326859 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.326845 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs podName:7c472a26-4f40-44d5-a402-20c081f11250 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:39.826831434 +0000 UTC m=+3.301899448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs") pod "network-metrics-daemon-4tkdg" (UID: "7c472a26-4f40-44d5-a402-20c081f11250") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:39.327287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326871 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-os-release\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.327287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-etc-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326912 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-log-socket\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326951 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-cni-netd\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71d69444-0428-4688-9001-3b5697c4fd16-dbus\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.327287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327221 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.327287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327240 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-env-overrides\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327561 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327290 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-registration-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.327561 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327329 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-systemd-units\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327561 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327354 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-var-lib-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327561 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327396 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-openvswitch\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327727 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327626 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-run-ovn-kubernetes\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327727 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327666 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/533e899c-b8a1-430f-b439-82348701874e-host\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.327727 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327703 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-run-ovn\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327875 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327729 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-slash\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.327875 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327749 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62766743-c21d-4665-81c0-3ce948906ee4-system-cni-dir\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.327875 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327784 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-run-netns\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.328026 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.327969 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-tmp-dir\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.328251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.328333 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328261 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-iptables-alerter-script\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.328333 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-hosts-file\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.328427 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328365 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-etc-selinux\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.328427 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.326724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-device-dir\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.328554 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328536 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62766743-c21d-4665-81c0-3ce948906ee4-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.328630 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328603 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab81a402-ca3f-417c-8127-f3f7291fd491-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.328867 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328840 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/533e899c-b8a1-430f-b439-82348701874e-serviceca\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.328956 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.328942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab81a402-ca3f-417c-8127-f3f7291fd491-ovnkube-script-lib\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.330055 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.330031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab81a402-ca3f-417c-8127-f3f7291fd491-ovn-node-metrics-cert\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.337585 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.337537 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgtm7\" (UniqueName: \"kubernetes.io/projected/e8ada3c4-84d1-4275-8883-b4d660ca7a6c-kube-api-access-rgtm7\") pod \"iptables-alerter-xgwmk\" (UID: \"e8ada3c4-84d1-4275-8883-b4d660ca7a6c\") " pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.337956 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.337809 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:39.337956 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.337833 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:39.337956 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.337847 2575 projected.go:196] Error preparing data for projected volume kube-api-access-x9mtl for pod openshift-network-diagnostics/network-check-target-ngrc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:39.337956 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.337915 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl podName:5feba9b7-482f-4723-8209-a34f3f3a066a nodeName:}" failed. No retries permitted until 2026-07-01 16:38:39.837900382 +0000 UTC m=+3.312968410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mtl" (UniqueName: "kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl") pod "network-check-target-ngrc2" (UID: "5feba9b7-482f-4723-8209-a34f3f3a066a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:39.340444 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.340400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmvgw\" (UniqueName: \"kubernetes.io/projected/533e899c-b8a1-430f-b439-82348701874e-kube-api-access-jmvgw\") pod \"node-ca-rcbfd\" (UID: \"533e899c-b8a1-430f-b439-82348701874e\") " pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.340548 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.340528 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhlrc\" (UniqueName: \"kubernetes.io/projected/d1fd702a-8ef6-46e1-b4e0-ce8778bff815-kube-api-access-xhlrc\") pod \"aws-ebs-csi-driver-node-d95t9\" (UID: \"d1fd702a-8ef6-46e1-b4e0-ce8778bff815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.340602 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.340560 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcz9q\" (UniqueName: \"kubernetes.io/projected/ab81a402-ca3f-417c-8127-f3f7291fd491-kube-api-access-bcz9q\") pod \"ovnkube-node-d8vw7\" (UID: \"ab81a402-ca3f-417c-8127-f3f7291fd491\") " pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.342591 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.342556 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsdzt\" (UniqueName: \"kubernetes.io/projected/7c472a26-4f40-44d5-a402-20c081f11250-kube-api-access-gsdzt\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:39.342738 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.342718 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljzl\" (UniqueName: \"kubernetes.io/projected/0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7-kube-api-access-8ljzl\") pod \"node-resolver-8mz4h\" (UID: \"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7\") " pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.345420 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.345398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4sc\" (UniqueName: \"kubernetes.io/projected/62766743-c21d-4665-81c0-3ce948906ee4-kube-api-access-4d4sc\") pod \"multus-additional-cni-plugins-r5z6q\" (UID: \"62766743-c21d-4665-81c0-3ce948906ee4\") " pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.410511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.410491 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" Jul 01 16:38:39.420897 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.420875 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601d2af6_79e1_4877_b8b3_4ed0ac816d76.slice/crio-e9d933165b2e7b120ee7eb7be7f0d045277918df2f3e3699e67283b641cf7d41 WatchSource:0}: Error finding container e9d933165b2e7b120ee7eb7be7f0d045277918df2f3e3699e67283b641cf7d41: Status 404 returned error can't find the container with id e9d933165b2e7b120ee7eb7be7f0d045277918df2f3e3699e67283b641cf7d41 Jul 01 16:38:39.424064 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.424046 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:38:39.432693 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.432673 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3941034_4536_4110_92dc_9604beaadb93.slice/crio-db2202a9746ca4c3db8558a1e9c7399a12e053aea4c4fbc4ca08b6986a39e26e WatchSource:0}: Error finding container db2202a9746ca4c3db8558a1e9c7399a12e053aea4c4fbc4ca08b6986a39e26e: Status 404 returned error can't find the container with id db2202a9746ca4c3db8558a1e9c7399a12e053aea4c4fbc4ca08b6986a39e26e Jul 01 16:38:39.438783 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.438762 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mj2kx" Jul 01 16:38:39.443554 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.443537 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" Jul 01 16:38:39.446318 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.446300 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632c8f38_f52d_415b_8024_6694e28d38e3.slice/crio-bfcd5aafc6e2024065d9c64a1f24af347bfb4d1d002b1c7b8cc85330b38edca8 WatchSource:0}: Error finding container bfcd5aafc6e2024065d9c64a1f24af347bfb4d1d002b1c7b8cc85330b38edca8: Status 404 returned error can't find the container with id bfcd5aafc6e2024065d9c64a1f24af347bfb4d1d002b1c7b8cc85330b38edca8 Jul 01 16:38:39.451983 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.451961 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8mz4h" Jul 01 16:38:39.452329 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.452307 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fd702a_8ef6_46e1_b4e0_ce8778bff815.slice/crio-3196d3c5a522066fe4df6b7d6bc6c737a22d069e007a6baa5827eee8fe783035 WatchSource:0}: Error finding container 3196d3c5a522066fe4df6b7d6bc6c737a22d069e007a6baa5827eee8fe783035: Status 404 returned error can't find the container with id 3196d3c5a522066fe4df6b7d6bc6c737a22d069e007a6baa5827eee8fe783035 Jul 01 16:38:39.459599 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.459577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rcbfd" Jul 01 16:38:39.460807 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.460785 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0befff_cf3a_4d24_ac5f_42a2fc40d8f7.slice/crio-7f7bf97e9134c3ea60ffc21cb2922c466142a9a2dea334ec4920906eb28babe9 WatchSource:0}: Error finding container 7f7bf97e9134c3ea60ffc21cb2922c466142a9a2dea334ec4920906eb28babe9: Status 404 returned error can't find the container with id 7f7bf97e9134c3ea60ffc21cb2922c466142a9a2dea334ec4920906eb28babe9 Jul 01 16:38:39.467760 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.467741 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xgwmk" Jul 01 16:38:39.468466 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.468430 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533e899c_b8a1_430f_b439_82348701874e.slice/crio-243e70cc97cc755a78fe525392136568491e34480cafee9c3b10621bedf5ef37 WatchSource:0}: Error finding container 243e70cc97cc755a78fe525392136568491e34480cafee9c3b10621bedf5ef37: Status 404 returned error can't find the container with id 243e70cc97cc755a78fe525392136568491e34480cafee9c3b10621bedf5ef37 Jul 01 16:38:39.475574 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.475555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:38:39.475915 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.475895 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ada3c4_84d1_4275_8883_b4d660ca7a6c.slice/crio-338ec549c23709b2860a177a181043a799f070968e146ac5117eacc693c8583b WatchSource:0}: Error finding container 338ec549c23709b2860a177a181043a799f070968e146ac5117eacc693c8583b: Status 404 returned error can't find the container with id 338ec549c23709b2860a177a181043a799f070968e146ac5117eacc693c8583b Jul 01 16:38:39.481766 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.481742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" Jul 01 16:38:39.484267 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.484246 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab81a402_ca3f_417c_8127_f3f7291fd491.slice/crio-dc1fab850ad47e93d6e6fb0b9f9da9626c2b52ad821d1dbcf90fe00f5767c040 WatchSource:0}: Error finding container dc1fab850ad47e93d6e6fb0b9f9da9626c2b52ad821d1dbcf90fe00f5767c040: Status 404 returned error can't find the container with id dc1fab850ad47e93d6e6fb0b9f9da9626c2b52ad821d1dbcf90fe00f5767c040 Jul 01 16:38:39.646956 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.646889 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:39.808884 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:38:39.808853 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62766743_c21d_4665_81c0_3ce948906ee4.slice/crio-231c1b94a71fe3aba628fa4c6965a1cad5db546280a9c86c82c339a581964544 WatchSource:0}: Error finding container 231c1b94a71fe3aba628fa4c6965a1cad5db546280a9c86c82c339a581964544: Status 404 returned error can't find the container with id 231c1b94a71fe3aba628fa4c6965a1cad5db546280a9c86c82c339a581964544 Jul 01 16:38:39.829280 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.829256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:39.829385 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.829292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:39.829439 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.829396 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:39.829514 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.829468 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret podName:71d69444-0428-4688-9001-3b5697c4fd16 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:40.829438361 +0000 UTC m=+4.304506376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret") pod "global-pull-secret-syncer-7s446" (UID: "71d69444-0428-4688-9001-3b5697c4fd16") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:39.829514 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.829396 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:39.829632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.829528 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs podName:7c472a26-4f40-44d5-a402-20c081f11250 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:40.82951629 +0000 UTC m=+4.304584314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs") pod "network-metrics-daemon-4tkdg" (UID: "7c472a26-4f40-44d5-a402-20c081f11250") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:39.930063 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:39.929982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:39.930194 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.930165 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:39.930194 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.930188 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:39.930318 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.930201 2575 projected.go:196] Error preparing data for projected volume kube-api-access-x9mtl for pod openshift-network-diagnostics/network-check-target-ngrc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:39.930318 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:39.930259 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl podName:5feba9b7-482f-4723-8209-a34f3f3a066a nodeName:}" failed. No retries permitted until 2026-07-01 16:38:40.930240076 +0000 UTC m=+4.405308104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mtl" (UniqueName: "kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl") pod "network-check-target-ngrc2" (UID: "5feba9b7-482f-4723-8209-a34f3f3a066a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:40.151920 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.151883 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:33:39 +0000 UTC" deadline="2027-12-31 10:45:19.355690635 +0000 UTC" Jul 01 16:38:40.151920 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.151917 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13146h6m39.203778301s" Jul 01 16:38:40.175518 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.175485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerStarted","Data":"231c1b94a71fe3aba628fa4c6965a1cad5db546280a9c86c82c339a581964544"} Jul 01 16:38:40.177019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.176990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgwmk" event={"ID":"e8ada3c4-84d1-4275-8883-b4d660ca7a6c","Type":"ContainerStarted","Data":"338ec549c23709b2860a177a181043a799f070968e146ac5117eacc693c8583b"} Jul 01 16:38:40.179015 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.178948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8mz4h" event={"ID":"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7","Type":"ContainerStarted","Data":"7f7bf97e9134c3ea60ffc21cb2922c466142a9a2dea334ec4920906eb28babe9"} Jul 01 16:38:40.181252 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.181163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mj2kx" event={"ID":"632c8f38-f52d-415b-8024-6694e28d38e3","Type":"ContainerStarted","Data":"bfcd5aafc6e2024065d9c64a1f24af347bfb4d1d002b1c7b8cc85330b38edca8"} Jul 01 16:38:40.182825 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.182802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-86n6c" event={"ID":"d3941034-4536-4110-92dc-9604beaadb93","Type":"ContainerStarted","Data":"db2202a9746ca4c3db8558a1e9c7399a12e053aea4c4fbc4ca08b6986a39e26e"} Jul 01 16:38:40.184200 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.184179 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"dc1fab850ad47e93d6e6fb0b9f9da9626c2b52ad821d1dbcf90fe00f5767c040"} Jul 01 16:38:40.187012 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.186988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rcbfd" event={"ID":"533e899c-b8a1-430f-b439-82348701874e","Type":"ContainerStarted","Data":"243e70cc97cc755a78fe525392136568491e34480cafee9c3b10621bedf5ef37"} Jul 01 16:38:40.188190 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.188168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" event={"ID":"d1fd702a-8ef6-46e1-b4e0-ce8778bff815","Type":"ContainerStarted","Data":"3196d3c5a522066fe4df6b7d6bc6c737a22d069e007a6baa5827eee8fe783035"} Jul 01 16:38:40.190340 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.190285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" event={"ID":"601d2af6-79e1-4877-b8b3-4ed0ac816d76","Type":"ContainerStarted","Data":"e9d933165b2e7b120ee7eb7be7f0d045277918df2f3e3699e67283b641cf7d41"} Jul 01 16:38:40.838472 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.838422 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:40.838660 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.838556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:40.838731 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.838682 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:40.838784 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.838741 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret podName:71d69444-0428-4688-9001-3b5697c4fd16 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:42.838722631 +0000 UTC m=+6.313790646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret") pod "global-pull-secret-syncer-7s446" (UID: "71d69444-0428-4688-9001-3b5697c4fd16") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:40.839264 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.839244 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:40.839338 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.839332 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs podName:7c472a26-4f40-44d5-a402-20c081f11250 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:42.839288029 +0000 UTC m=+6.314356044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs") pod "network-metrics-daemon-4tkdg" (UID: "7c472a26-4f40-44d5-a402-20c081f11250") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:40.939807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:40.939776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:40.939963 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.939947 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:40.940026 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.939976 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:40.940026 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.939989 2575 projected.go:196] Error preparing data for projected volume kube-api-access-x9mtl for pod openshift-network-diagnostics/network-check-target-ngrc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:40.940133 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:40.940043 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl podName:5feba9b7-482f-4723-8209-a34f3f3a066a nodeName:}" failed. No retries permitted until 2026-07-01 16:38:42.940025119 +0000 UTC m=+6.415093147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mtl" (UniqueName: "kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl") pod "network-check-target-ngrc2" (UID: "5feba9b7-482f-4723-8209-a34f3f3a066a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:41.152342 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:41.152039 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:33:39 +0000 UTC" deadline="2028-03-11 05:12:45.87704634 +0000 UTC" Jul 01 16:38:41.152342 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:41.152281 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14844h34m4.724769762s" Jul 01 16:38:41.170059 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:41.170033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:41.170190 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:41.170167 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:41.170266 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:41.170251 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:41.170346 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:41.170329 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:41.170404 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:41.170385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:41.170488 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:41.170470 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:41.197033 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:41.196413 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" event={"ID":"ecacabbf6c7581c4fa7099252af4d71e","Type":"ContainerStarted","Data":"65b71255ecbd26256f4c6a07b73110fac8f2259699cb515fa2397364b7b482d6"} Jul 01 16:38:41.236541 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:41.235687 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-15.ec2.internal" podStartSLOduration=3.235667842 podStartE2EDuration="3.235667842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:41.235169058 +0000 UTC m=+4.710237091" watchObservedRunningTime="2026-07-01 16:38:41.235667842 +0000 UTC m=+4.710735876" Jul 01 16:38:42.227481 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:42.227164 2575 generic.go:356] "Generic (PLEG): container finished" podID="3dd9e1f9d302bce07c5188b8e6745902" containerID="518016bcabecb34d192254303c04e04fdec8a2dab3cce4054d7534f367d626fa" exitCode=0 Jul 01 16:38:42.228514 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:42.228027 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" event={"ID":"3dd9e1f9d302bce07c5188b8e6745902","Type":"ContainerDied","Data":"518016bcabecb34d192254303c04e04fdec8a2dab3cce4054d7534f367d626fa"} Jul 01 16:38:42.857531 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:42.856732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:42.857531 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:42.856786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:42.857531 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.856945 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:42.857531 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.857002 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs podName:7c472a26-4f40-44d5-a402-20c081f11250 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:46.856983424 +0000 UTC m=+10.332051436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs") pod "network-metrics-daemon-4tkdg" (UID: "7c472a26-4f40-44d5-a402-20c081f11250") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:42.857531 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.857063 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:42.857531 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.857110 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret podName:71d69444-0428-4688-9001-3b5697c4fd16 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:46.857083426 +0000 UTC m=+10.332151442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret") pod "global-pull-secret-syncer-7s446" (UID: "71d69444-0428-4688-9001-3b5697c4fd16") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:42.958109 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:42.957445 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:42.958109 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.957688 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:42.958109 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.957707 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:42.958109 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.957720 2575 projected.go:196] Error preparing data for projected volume kube-api-access-x9mtl for pod openshift-network-diagnostics/network-check-target-ngrc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:42.958109 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:42.957777 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl podName:5feba9b7-482f-4723-8209-a34f3f3a066a nodeName:}" failed. No retries permitted until 2026-07-01 16:38:46.957760335 +0000 UTC m=+10.432828351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mtl" (UniqueName: "kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl") pod "network-check-target-ngrc2" (UID: "5feba9b7-482f-4723-8209-a34f3f3a066a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:43.165899 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:43.165766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:43.165899 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:43.165882 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:43.166120 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:43.165779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:43.166120 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:43.165935 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:43.166120 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:43.166013 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:43.166378 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:43.166334 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:45.167072 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:45.166395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:45.167072 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:45.166541 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:45.167072 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:45.166930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:45.167072 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:45.167026 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:45.167696 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:45.167391 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:45.167696 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:45.167507 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:46.890001 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:46.889287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:46.890001 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:46.889350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:46.890001 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.889533 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:46.890001 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.889591 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs podName:7c472a26-4f40-44d5-a402-20c081f11250 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:54.889573074 +0000 UTC m=+18.364641088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs") pod "network-metrics-daemon-4tkdg" (UID: "7c472a26-4f40-44d5-a402-20c081f11250") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:46.890001 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.889968 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:46.890690 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.890024 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret podName:71d69444-0428-4688-9001-3b5697c4fd16 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:54.890009478 +0000 UTC m=+18.365077488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret") pod "global-pull-secret-syncer-7s446" (UID: "71d69444-0428-4688-9001-3b5697c4fd16") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:46.990476 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:46.990426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:46.990647 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.990590 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:46.990647 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.990604 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:46.990647 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.990612 2575 projected.go:196] Error preparing data for projected volume kube-api-access-x9mtl for pod openshift-network-diagnostics/network-check-target-ngrc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:46.990806 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:46.990657 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl podName:5feba9b7-482f-4723-8209-a34f3f3a066a nodeName:}" failed. No retries permitted until 2026-07-01 16:38:54.990644972 +0000 UTC m=+18.465712983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mtl" (UniqueName: "kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl") pod "network-check-target-ngrc2" (UID: "5feba9b7-482f-4723-8209-a34f3f3a066a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:47.166428 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:47.166324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:47.166813 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:47.166783 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:47.169511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:47.168562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:47.169511 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:47.168690 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:47.169511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:47.168771 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:47.169511 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:47.168898 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:49.165372 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:49.165336 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:49.165372 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:49.165373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:49.165907 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:49.165471 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:49.165907 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:49.165524 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:49.165907 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:49.165629 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:49.165907 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:49.165710 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:51.166382 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:51.166346 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:51.166829 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:51.166393 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:51.166829 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:51.166348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:51.166829 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:51.166470 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:51.166829 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:51.166549 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:51.166829 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:51.166666 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:53.165666 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:53.165633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:53.166106 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:53.165644 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:53.166106 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:53.165764 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:53.166106 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:53.165786 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:53.166106 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:53.165887 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:53.166106 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:53.165970 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:54.952197 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:54.952161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:54.952636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:54.952240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:54.952636 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:54.952318 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:54.952636 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:54.952366 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret podName:71d69444-0428-4688-9001-3b5697c4fd16 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:10.952352298 +0000 UTC m=+34.427420309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret") pod "global-pull-secret-syncer-7s446" (UID: "71d69444-0428-4688-9001-3b5697c4fd16") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:54.952636 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:54.952316 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:54.952636 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:54.952403 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs podName:7c472a26-4f40-44d5-a402-20c081f11250 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:10.952392401 +0000 UTC m=+34.427460412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs") pod "network-metrics-daemon-4tkdg" (UID: "7c472a26-4f40-44d5-a402-20c081f11250") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:55.052969 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:55.052940 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:55.053159 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:55.053100 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:55.053159 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:55.053122 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:55.053159 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:55.053133 2575 projected.go:196] Error preparing data for projected volume kube-api-access-x9mtl for pod openshift-network-diagnostics/network-check-target-ngrc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:55.053319 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:55.053179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl podName:5feba9b7-482f-4723-8209-a34f3f3a066a nodeName:}" failed. No retries permitted until 2026-07-01 16:39:11.053164968 +0000 UTC m=+34.528232985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mtl" (UniqueName: "kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl") pod "network-check-target-ngrc2" (UID: "5feba9b7-482f-4723-8209-a34f3f3a066a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:55.165882 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:55.165837 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:55.165882 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:55.165858 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:55.165882 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:55.165873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:55.166143 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:55.165957 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:55.166143 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:55.166039 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:55.166143 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:55.166120 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:57.166123 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:57.166090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:57.166635 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:57.166196 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:57.166635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:57.166254 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:57.166635 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:57.166334 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:57.166635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:57.166363 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:57.166635 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:57.166429 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:59.166149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.165742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:38:59.166890 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.165796 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:38:59.166890 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:59.166257 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:38:59.166890 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.165817 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:38:59.166890 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:59.166329 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:38:59.166890 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:38:59.166397 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:38:59.258886 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.258857 2575 generic.go:356] "Generic (PLEG): container finished" podID="62766743-c21d-4665-81c0-3ce948906ee4" containerID="26626e20ca3dde2ed93b225d70462f6a4044b4d8b9c2708a97b9be35233d0843" exitCode=0 Jul 01 16:38:59.259033 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.258936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerDied","Data":"26626e20ca3dde2ed93b225d70462f6a4044b4d8b9c2708a97b9be35233d0843"} Jul 01 16:38:59.260331 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.260227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8mz4h" event={"ID":"0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7","Type":"ContainerStarted","Data":"9a70d8b09802520f98cc0e198ef21b21bad6313c9098fd5efc3024c1fc2ac39e"} Jul 01 16:38:59.261704 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.261683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mj2kx" event={"ID":"632c8f38-f52d-415b-8024-6694e28d38e3","Type":"ContainerStarted","Data":"f0b3e41fa1845ada742f05c4040cc719ab81216e20bfddb6062528ac66b6e518"} Jul 01 16:38:59.265721 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.265698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-86n6c" event={"ID":"d3941034-4536-4110-92dc-9604beaadb93","Type":"ContainerStarted","Data":"a46615e4a1bf240a93f8a65a78d082259362adf70a98d537aad9f938e8907b5e"} Jul 01 16:38:59.268260 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268239 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:38:59.268567 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268551 2575 generic.go:356] "Generic (PLEG): container finished" podID="ab81a402-ca3f-417c-8127-f3f7291fd491" containerID="30ded3b032f97f5d4ad4bf579a0f8f5524791ccfa07829bfa5dd95c5b970a2d0" exitCode=1 Jul 01 16:38:59.268631 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268608 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"dc2ff22e9d620d1115e56742fc6868355baf0489d2338ed3823cbc94b79f8bdb"} Jul 01 16:38:59.268676 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"cb3e9a64f32413ddbd10ee154b9451e540c2eb6a52fd24c0d960156d2490a6c4"} Jul 01 16:38:59.268716 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"016f5cb5aa04a78399a40406c522ed00f87df5bc4f01624b2047e7c86aabe56e"} Jul 01 16:38:59.268763 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268734 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"e017220a3f3f186fbf8b86c6dad16064cc72e707f94135f58024647d2f1dc794"} Jul 01 16:38:59.268801 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerDied","Data":"30ded3b032f97f5d4ad4bf579a0f8f5524791ccfa07829bfa5dd95c5b970a2d0"} Jul 01 16:38:59.268841 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.268802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"27e9c93d92a356d016f939831c76660094062fb5490fe05d5d774fd847f7f73d"} Jul 01 16:38:59.269860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.269839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rcbfd" event={"ID":"533e899c-b8a1-430f-b439-82348701874e","Type":"ContainerStarted","Data":"f28762cc4ec89c7effe6b00192e915efbc023a04bb84c08a322b4b1f1b05524c"} Jul 01 16:38:59.271291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.271247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" event={"ID":"d1fd702a-8ef6-46e1-b4e0-ce8778bff815","Type":"ContainerStarted","Data":"84cdffdb5aae76d0cc8a91430807a9975ea2891827c32e85025be0d1041065bf"} Jul 01 16:38:59.272578 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.272556 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" event={"ID":"601d2af6-79e1-4877-b8b3-4ed0ac816d76","Type":"ContainerStarted","Data":"39171065282af94ac3cfe0d8766ff40fc35b70dcab7e9c7a6bdf0df62a82fc3c"} Jul 01 16:38:59.274192 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.274174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" event={"ID":"3dd9e1f9d302bce07c5188b8e6745902","Type":"ContainerStarted","Data":"af8e6d9cb25a20c6c7078b07d964c83c3047921c85efd5498630ef95ce263259"} Jul 01 16:38:59.333277 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.333236 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dzkfz" podStartSLOduration=3.430675049 podStartE2EDuration="22.33321843s" totalImagesPullingTime="18.902543381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:59.332814414 +0000 UTC m=+22.807882450" watchObservedRunningTime="2026-07-01 16:38:59.33321843 +0000 UTC m=+22.808286465" Jul 01 16:38:59.333394 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.333327 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8mz4h" podStartSLOduration=3.47016434 podStartE2EDuration="22.333323108s" totalImagesPullingTime="18.863158768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:59.308612404 +0000 UTC m=+22.783680436" watchObservedRunningTime="2026-07-01 16:38:59.333323108 +0000 UTC m=+22.808391138" Jul 01 16:38:59.359414 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.359369 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-86n6c" podStartSLOduration=3.468441058 podStartE2EDuration="22.359355383s" totalImagesPullingTime="18.890914325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:59.35871584 +0000 UTC m=+22.833783884" watchObservedRunningTime="2026-07-01 16:38:59.359355383 +0000 UTC m=+22.834423416" Jul 01 16:38:59.419397 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.419335 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rcbfd" podStartSLOduration=3.544647649 podStartE2EDuration="22.419317983s" totalImagesPullingTime="18.874670334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:59.391281714 +0000 UTC m=+22.866349746" watchObservedRunningTime="2026-07-01 16:38:59.419317983 +0000 UTC m=+22.894386019" Jul 01 16:38:59.442639 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.442588 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mj2kx" podStartSLOduration=3.5282350449999997 podStartE2EDuration="22.442570038s" totalImagesPullingTime="18.914334993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:59.442475051 +0000 UTC m=+22.917543077" watchObservedRunningTime="2026-07-01 16:38:59.442570038 +0000 UTC m=+22.917638108" Jul 01 16:38:59.442991 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.442961 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-15.ec2.internal" podStartSLOduration=21.442950641 podStartE2EDuration="21.442950641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:59.419293413 +0000 UTC m=+22.894361447" watchObservedRunningTime="2026-07-01 16:38:59.442950641 +0000 UTC m=+22.918018676" Jul 01 16:38:59.911541 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:38:59.911521 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:39:00.163017 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.162927 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:38:59.911536515Z","UUID":"2cb6d878-1646-4457-beb8-6a7c5d3973f6","Handler":null,"Name":"","Endpoint":""} Jul 01 16:39:00.164241 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.164221 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:39:00.164342 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.164253 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:39:00.278526 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.278340 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xgwmk" event={"ID":"e8ada3c4-84d1-4275-8883-b4d660ca7a6c","Type":"ContainerStarted","Data":"4b9c8c0a3758ae8c0a5a2b999603f18ec2633156d4d4821c18a4e0f4f1ba36f7"} Jul 01 16:39:00.280659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.280631 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" event={"ID":"d1fd702a-8ef6-46e1-b4e0-ce8778bff815","Type":"ContainerStarted","Data":"e1266b2917750223135ee74aa7678eaabdf403fe1e9083b5070f2c3ac1be390a"} Jul 01 16:39:00.702669 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.702634 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:39:00.703548 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.703517 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:39:00.721901 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:00.721860 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xgwmk" podStartSLOduration=4.853639189 podStartE2EDuration="23.721847409s" totalImagesPullingTime="18.86820822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:00.304334929 +0000 UTC m=+23.779402963" watchObservedRunningTime="2026-07-01 16:39:00.721847409 +0000 UTC m=+24.196915441" Jul 01 16:39:01.166156 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.166127 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:01.166273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.166130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:01.166273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.166230 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:01.166273 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:01.166251 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:39:01.166438 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:01.166300 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:39:01.166438 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:01.166366 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:39:01.286317 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.286287 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:39:01.286702 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.286679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"2e0a1ecb743f824d42a3bd16a07ea4eb4c5ad590f3cb60ea976b6c89c6db8b63"} Jul 01 16:39:01.288593 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.288568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" event={"ID":"d1fd702a-8ef6-46e1-b4e0-ce8778bff815","Type":"ContainerStarted","Data":"2ea389ca0140bc482105cb1fc00d6c87195a8a6d6d55d5df1ff50c179560d571"} Jul 01 16:39:01.288848 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.288822 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:39:01.289228 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.289209 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-86n6c" Jul 01 16:39:01.311044 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:01.310984 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d95t9" podStartSLOduration=3.362848797 podStartE2EDuration="24.310966906s" totalImagesPullingTime="20.948118109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:01.310532653 +0000 UTC m=+24.785600686" watchObservedRunningTime="2026-07-01 16:39:01.310966906 +0000 UTC m=+24.786034940" Jul 01 16:39:03.165811 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:03.165586 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:03.166305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:03.165601 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:03.166305 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:03.165907 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:39:03.166305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:03.165601 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:03.166305 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:03.165990 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:39:03.166305 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:03.166076 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:39:04.297904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:04.297881 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:39:04.298479 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:04.298203 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"9eae64eaefb9f5ba7629179c0722adae9817923945d6991d1391526dc1b82406"} Jul 01 16:39:04.298550 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:04.298481 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:39:04.298663 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:04.298646 2575 scope.go:117] "RemoveContainer" containerID="30ded3b032f97f5d4ad4bf579a0f8f5524791ccfa07829bfa5dd95c5b970a2d0" Jul 01 16:39:04.312685 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:04.312668 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:39:05.166199 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.166015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:05.166342 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.166025 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:05.166342 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:05.166283 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:39:05.166342 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:05.166335 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:39:05.166532 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.166033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:05.166532 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:05.166432 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:39:05.304137 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.304111 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:39:05.304711 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.304688 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" event={"ID":"ab81a402-ca3f-417c-8127-f3f7291fd491","Type":"ContainerStarted","Data":"dcb4f879fb6a1d97caaa00b33dbb084b8e88f10b92cedf3f3fac0102fa33b3d5"} Jul 01 16:39:05.304916 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.304899 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:39:05.305014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.304961 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:39:05.306666 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.306640 2575 generic.go:356] "Generic (PLEG): container finished" podID="62766743-c21d-4665-81c0-3ce948906ee4" containerID="db22765b3f9c262b1c9cedf8a7eeaef59e4852051ba669d696100f46164f4ed7" exitCode=0 Jul 01 16:39:05.306779 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.306678 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerDied","Data":"db22765b3f9c262b1c9cedf8a7eeaef59e4852051ba669d696100f46164f4ed7"} Jul 01 16:39:05.320666 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.320644 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:39:05.341831 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:05.341788 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" podStartSLOduration=9.308760637 podStartE2EDuration="28.341774293s" totalImagesPullingTime="19.033013656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:05.34082499 +0000 UTC m=+28.815893024" watchObservedRunningTime="2026-07-01 16:39:05.341774293 +0000 UTC m=+28.816842363" Jul 01 16:39:06.594328 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:06.594243 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s446"] Jul 01 16:39:06.594775 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:06.594404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:06.594775 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:06.594528 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:39:06.597192 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:06.597169 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ngrc2"] Jul 01 16:39:06.597309 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:06.597248 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:06.597353 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:06.597311 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:39:06.607419 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:06.607400 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4tkdg"] Jul 01 16:39:06.607519 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:06.607500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:06.607585 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:06.607570 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:39:07.312895 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:07.312867 2575 generic.go:356] "Generic (PLEG): container finished" podID="62766743-c21d-4665-81c0-3ce948906ee4" containerID="b75684e275ade8d65e5346ad7afa33769fc9c434b26c25d1fb4e1216f16047ec" exitCode=0 Jul 01 16:39:07.313039 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:07.312955 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerDied","Data":"b75684e275ade8d65e5346ad7afa33769fc9c434b26c25d1fb4e1216f16047ec"} Jul 01 16:39:08.166271 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:08.166104 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:08.166655 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:08.166154 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:08.166655 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:08.166334 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:39:08.166655 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:08.166422 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:39:08.166655 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:08.166161 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:08.166655 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:08.166516 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:39:09.319171 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:09.319139 2575 generic.go:356] "Generic (PLEG): container finished" podID="62766743-c21d-4665-81c0-3ce948906ee4" containerID="f0e0c9e62deae9cbaae7a7f9e735cc36bc238fed71c14a152a1b800ab71b7210" exitCode=0 Jul 01 16:39:09.319648 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:09.319181 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerDied","Data":"f0e0c9e62deae9cbaae7a7f9e735cc36bc238fed71c14a152a1b800ab71b7210"} Jul 01 16:39:10.166138 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:10.166101 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:10.166315 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:10.166152 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:10.166315 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:10.166231 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:10.166315 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:10.166247 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4tkdg" podUID="7c472a26-4f40-44d5-a402-20c081f11250" Jul 01 16:39:10.166550 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:10.166326 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s446" podUID="71d69444-0428-4688-9001-3b5697c4fd16" Jul 01 16:39:10.166550 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:10.166406 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ngrc2" podUID="5feba9b7-482f-4723-8209-a34f3f3a066a" Jul 01 16:39:10.979108 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:10.979066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:10.979579 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:10.979118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:10.979579 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:10.979235 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:39:10.979579 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:10.979301 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs podName:7c472a26-4f40-44d5-a402-20c081f11250 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:42.979286364 +0000 UTC m=+66.454354374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs") pod "network-metrics-daemon-4tkdg" (UID: "7c472a26-4f40-44d5-a402-20c081f11250") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:39:10.979579 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:10.979235 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:39:10.979579 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:10.979376 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret podName:71d69444-0428-4688-9001-3b5697c4fd16 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:42.979364309 +0000 UTC m=+66.454432328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret") pod "global-pull-secret-syncer-7s446" (UID: "71d69444-0428-4688-9001-3b5697c4fd16") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:39:11.080405 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.080365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:11.080566 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.080547 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:39:11.080635 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.080568 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:39:11.080635 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.080577 2575 projected.go:196] Error preparing data for projected volume kube-api-access-x9mtl for pod openshift-network-diagnostics/network-check-target-ngrc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:39:11.080635 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.080629 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl podName:5feba9b7-482f-4723-8209-a34f3f3a066a nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.080612693 +0000 UTC m=+66.555680705 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mtl" (UniqueName: "kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl") pod "network-check-target-ngrc2" (UID: "5feba9b7-482f-4723-8209-a34f3f3a066a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:39:11.297164 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.297096 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-15.ec2.internal" event="NodeReady" Jul 01 16:39:11.297285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.297217 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:39:11.373079 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.373055 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cd758cbf9-hhr8h"] Jul 01 16:39:11.377007 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.376986 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.377932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.377910 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89"] Jul 01 16:39:11.379728 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.379705 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 16:39:11.380770 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.380754 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 16:39:11.381121 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.381090 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzznc\"" Jul 01 16:39:11.381632 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.381609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-q97x2"] Jul 01 16:39:11.383208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.381734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:11.383208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-installation-pull-secrets\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddvwg\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-kube-api-access-ddvwg\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-trusted-ca\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-certificates\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsjlk\" (UniqueName: \"kubernetes.io/projected/70382e84-95d1-4d59-b53f-88721cea8bfe-kube-api-access-vsjlk\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:11.383474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1b95ead-65f6-4561-97fa-d74b717fc2ba-ca-trust-extracted\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-bound-sa-token\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-image-registry-private-configuration\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.383474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.383407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:11.384259 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.384232 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 16:39:11.385377 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.385355 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5vwqr\"" Jul 01 16:39:11.385482 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.385360 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.385533 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.385505 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-ngb6g"] Jul 01 16:39:11.385673 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.385658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.389084 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.389057 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-rtl6m"] Jul 01 16:39:11.389186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.389170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.389252 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.389229 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 16:39:11.390018 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.390000 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 16:39:11.390234 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.390217 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.390690 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.390663 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 16:39:11.390816 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.390797 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-twzjh\"" Jul 01 16:39:11.392558 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.392538 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz"] Jul 01 16:39:11.392687 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.392665 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" Jul 01 16:39:11.395936 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.395917 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.396014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.395972 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.396258 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.395917 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc"] Jul 01 16:39:11.396779 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.396752 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 16:39:11.397525 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.397508 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 16:39:11.397919 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.397903 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.398368 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.398352 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.399566 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.399540 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.400171 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.400149 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-x4dhm\"" Jul 01 16:39:11.401223 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.400665 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.401223 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.400908 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.401695 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.401414 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zc4rt\"" Jul 01 16:39:11.403193 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.403167 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5"] Jul 01 16:39:11.403553 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.403532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.404601 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.404581 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 16:39:11.404818 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.404802 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.406679 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.406663 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59b55764c-6x7db"] Jul 01 16:39:11.406800 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.406785 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" Jul 01 16:39:11.410217 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.410198 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk"] Jul 01 16:39:11.410400 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.410383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.413881 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.413819 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x5lf2"] Jul 01 16:39:11.414564 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.414332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.415050 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.415009 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4wlxv\"" Jul 01 16:39:11.415236 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.415219 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 16:39:11.415884 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.415782 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.416406 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.416373 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 16:39:11.416618 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.416586 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.416800 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.416779 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.416883 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.416843 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 16:39:11.416883 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.416789 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.417190 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.417170 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7csvz"] Jul 01 16:39:11.417373 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.417358 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.420740 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.418609 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 16:39:11.420740 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.418921 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tpbbc\"" Jul 01 16:39:11.420740 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.419642 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 16:39:11.420740 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.420443 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wgm5h\"" Jul 01 16:39:11.422391 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.422367 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cd758cbf9-hhr8h"] Jul 01 16:39:11.422512 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.422399 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89"] Jul 01 16:39:11.422512 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.422425 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-rtl6m"] Jul 01 16:39:11.422632 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.422523 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.430014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.429969 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.430482 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.430028 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 16:39:11.430636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.430055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 16:39:11.430755 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.430133 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 16:39:11.430820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.430155 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 16:39:11.430876 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.430175 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.430930 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.430217 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.431521 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.431390 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 16:39:11.431521 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.431423 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.431765 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.431741 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.431841 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.431742 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 16:39:11.431975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.431959 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hml4p\"" Jul 01 16:39:11.432076 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.431985 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-66hzb\"" Jul 01 16:39:11.432076 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.432071 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:39:11.432183 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.432032 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:39:11.432183 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.431992 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:39:11.432291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.432239 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz"] Jul 01 16:39:11.432517 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.432498 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:39:11.432689 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.432669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5tj8\"" Jul 01 16:39:11.432916 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.432900 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qw5lg\"" Jul 01 16:39:11.433372 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.433347 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:39:11.433625 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.433605 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-q97x2"] Jul 01 16:39:11.434899 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.434880 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x5lf2"] Jul 01 16:39:11.435791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.435763 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc"] Jul 01 16:39:11.442562 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.442542 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5"] Jul 01 16:39:11.443890 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.443864 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 16:39:11.450932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.449813 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-ngb6g"] Jul 01 16:39:11.450932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.450798 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk"] Jul 01 16:39:11.452406 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.452387 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7csvz"] Jul 01 16:39:11.453141 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.453125 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59b55764c-6x7db"] Jul 01 16:39:11.484106 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.484189 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-installation-pull-secrets\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.484189 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.484269 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d7f59688-84f5-4e0e-93a5-df9a3353ced0-snapshots\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.484318 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.484366 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mft6\" (UniqueName: \"kubernetes.io/projected/6e397899-feda-4353-bf08-af42ffa8814d-kube-api-access-9mft6\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.484401 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-trusted-ca\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.484464 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484435 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5229590-685f-4e84-a11c-cab27a0f4728-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.484511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5229590-685f-4e84-a11c-cab27a0f4728-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.484564 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-stats-auth\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.484564 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.484659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qkq\" (UniqueName: \"kubernetes.io/projected/56acd41c-facb-493d-8eac-8cff2fac85ec-kube-api-access-t5qkq\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.484659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484599 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-default-certificate\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.484659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sqnf\" (UniqueName: \"kubernetes.io/projected/dedd0bef-bd30-4e3a-8b98-201a6210b591-kube-api-access-4sqnf\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.484798 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.484657 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:11.484798 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7f59688-84f5-4e0e-93a5-df9a3353ced0-tmp\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.484798 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.484674 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd758cbf9-hhr8h: secret "image-registry-tls" not found Jul 01 16:39:11.484798 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e397899-feda-4353-bf08-af42ffa8814d-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.484798 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.484755 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls podName:b1b95ead-65f6-4561-97fa-d74b717fc2ba nodeName:}" failed. No retries permitted until 2026-07-01 16:39:11.984734641 +0000 UTC m=+35.459802666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls") pod "image-registry-cd758cbf9-hhr8h" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba") : secret "image-registry-tls" not found Jul 01 16:39:11.485029 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-image-registry-private-configuration\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.485029 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80894daf-00f6-4e9d-8175-82e07decf98b-serving-cert\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.485029 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dedd0bef-bd30-4e3a-8b98-201a6210b591-tmp-dir\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.485029 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.484971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f59688-84f5-4e0e-93a5-df9a3353ced0-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.485029 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80894daf-00f6-4e9d-8175-82e07decf98b-config\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.485239 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f59688-84f5-4e0e-93a5-df9a3353ced0-serving-cert\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.485239 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddvwg\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-kube-api-access-ddvwg\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.485239 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485117 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.485239 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97rzm\" (UniqueName: \"kubernetes.io/projected/88b9dce7-4158-4086-8894-e3ecb1d642fa-kube-api-access-97rzm\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.485239 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh82w\" (UniqueName: \"kubernetes.io/projected/d7f59688-84f5-4e0e-93a5-df9a3353ced0-kube-api-access-zh82w\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.485239 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dedd0bef-bd30-4e3a-8b98-201a6210b591-config-volume\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.485239 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00f88e95-65b6-475c-a2bd-3aaf91fd734b-cert\") pod \"ingress-canary-x5lf2\" (UID: \"00f88e95-65b6-475c-a2bd-3aaf91fd734b\") " pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56acd41c-facb-493d-8eac-8cff2fac85ec-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485290 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-certificates\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tq6l\" (UniqueName: \"kubernetes.io/projected/c5229590-685f-4e84-a11c-cab27a0f4728-kube-api-access-7tq6l\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58gdt\" (UniqueName: \"kubernetes.io/projected/80894daf-00f6-4e9d-8175-82e07decf98b-kube-api-access-58gdt\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjlk\" (UniqueName: \"kubernetes.io/projected/70382e84-95d1-4d59-b53f-88721cea8bfe-kube-api-access-vsjlk\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1b95ead-65f6-4561-97fa-d74b717fc2ba-ca-trust-extracted\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-bound-sa-token\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80894daf-00f6-4e9d-8175-82e07decf98b-trusted-ca\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bnlm\" (UniqueName: \"kubernetes.io/projected/527b92bd-759b-4173-ad57-0c1c2319033d-kube-api-access-2bnlm\") pod \"network-check-source-56499946bc-rtl6m\" (UID: \"527b92bd-759b-4173-ad57-0c1c2319033d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f59688-84f5-4e0e-93a5-df9a3353ced0-service-ca-bundle\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.485576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485577 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f99nn\" (UniqueName: \"kubernetes.io/projected/89614adb-1dea-4074-96d9-d57bf1b2a851-kube-api-access-f99nn\") pod \"volume-data-source-validator-69d9f679db-pl8w5\" (UID: \"89614adb-1dea-4074-96d9-d57bf1b2a851\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" Jul 01 16:39:11.486153 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjmv\" (UniqueName: \"kubernetes.io/projected/00f88e95-65b6-475c-a2bd-3aaf91fd734b-kube-api-access-zdjmv\") pod \"ingress-canary-x5lf2\" (UID: \"00f88e95-65b6-475c-a2bd-3aaf91fd734b\") " pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.486153 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:11.486153 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e397899-feda-4353-bf08-af42ffa8814d-config\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.486153 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.485806 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:39:11.486153 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485820 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-certificates\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.486153 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.485869 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls podName:70382e84-95d1-4d59-b53f-88721cea8bfe nodeName:}" failed. No retries permitted until 2026-07-01 16:39:11.985854714 +0000 UTC m=+35.460922729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-q2z89" (UID: "70382e84-95d1-4d59-b53f-88721cea8bfe") : secret "samples-operator-tls" not found Jul 01 16:39:11.486153 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.485956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1b95ead-65f6-4561-97fa-d74b717fc2ba-ca-trust-extracted\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.486646 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.486600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-trusted-ca\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.489250 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.489231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-installation-pull-secrets\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.489497 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.489476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-image-registry-private-configuration\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.525416 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.525393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddvwg\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-kube-api-access-ddvwg\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.543303 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.543274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsjlk\" (UniqueName: \"kubernetes.io/projected/70382e84-95d1-4d59-b53f-88721cea8bfe-kube-api-access-vsjlk\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:11.551512 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.551444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-bound-sa-token\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.586050 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f59688-84f5-4e0e-93a5-df9a3353ced0-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.586050 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80894daf-00f6-4e9d-8175-82e07decf98b-config\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f59688-84f5-4e0e-93a5-df9a3353ced0-serving-cert\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97rzm\" (UniqueName: \"kubernetes.io/projected/88b9dce7-4158-4086-8894-e3ecb1d642fa-kube-api-access-97rzm\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh82w\" (UniqueName: \"kubernetes.io/projected/d7f59688-84f5-4e0e-93a5-df9a3353ced0-kube-api-access-zh82w\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dedd0bef-bd30-4e3a-8b98-201a6210b591-config-volume\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00f88e95-65b6-475c-a2bd-3aaf91fd734b-cert\") pod \"ingress-canary-x5lf2\" (UID: \"00f88e95-65b6-475c-a2bd-3aaf91fd734b\") " pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56acd41c-facb-493d-8eac-8cff2fac85ec-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.586273 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tq6l\" (UniqueName: \"kubernetes.io/projected/c5229590-685f-4e84-a11c-cab27a0f4728-kube-api-access-7tq6l\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58gdt\" (UniqueName: \"kubernetes.io/projected/80894daf-00f6-4e9d-8175-82e07decf98b-kube-api-access-58gdt\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80894daf-00f6-4e9d-8175-82e07decf98b-trusted-ca\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bnlm\" (UniqueName: \"kubernetes.io/projected/527b92bd-759b-4173-ad57-0c1c2319033d-kube-api-access-2bnlm\") pod \"network-check-source-56499946bc-rtl6m\" (UID: \"527b92bd-759b-4173-ad57-0c1c2319033d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f59688-84f5-4e0e-93a5-df9a3353ced0-service-ca-bundle\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f99nn\" (UniqueName: \"kubernetes.io/projected/89614adb-1dea-4074-96d9-d57bf1b2a851-kube-api-access-f99nn\") pod \"volume-data-source-validator-69d9f679db-pl8w5\" (UID: \"89614adb-1dea-4074-96d9-d57bf1b2a851\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjmv\" (UniqueName: \"kubernetes.io/projected/00f88e95-65b6-475c-a2bd-3aaf91fd734b-kube-api-access-zdjmv\") pod \"ingress-canary-x5lf2\" (UID: \"00f88e95-65b6-475c-a2bd-3aaf91fd734b\") " pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e397899-feda-4353-bf08-af42ffa8814d-config\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.586532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.586585 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:12.086566482 +0000 UTC m=+35.561634496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : configmap references non-existent config key: service-ca.crt Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.586621 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.586669 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:12.086657488 +0000 UTC m=+35.561725509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : secret "router-metrics-certs-default" not found Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.587056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f59688-84f5-4e0e-93a5-df9a3353ced0-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.587095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80894daf-00f6-4e9d-8175-82e07decf98b-config\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.587104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.587150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d7f59688-84f5-4e0e-93a5-df9a3353ced0-snapshots\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.589988 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.587176 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.587216 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dedd0bef-bd30-4e3a-8b98-201a6210b591-config-volume\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.587232 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls podName:56acd41c-facb-493d-8eac-8cff2fac85ec nodeName:}" failed. No retries permitted until 2026-07-01 16:39:12.087215932 +0000 UTC m=+35.562283946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-sksmc" (UID: "56acd41c-facb-493d-8eac-8cff2fac85ec") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.587234 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.587340 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls podName:dedd0bef-bd30-4e3a-8b98-201a6210b591 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:12.087325107 +0000 UTC m=+35.562393129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls") pod "dns-default-7csvz" (UID: "dedd0bef-bd30-4e3a-8b98-201a6210b591") : secret "dns-default-metrics-tls" not found Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.587604 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80894daf-00f6-4e9d-8175-82e07decf98b-trusted-ca\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7f59688-84f5-4e0e-93a5-df9a3353ced0-service-ca-bundle\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.587177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588080 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d7f59688-84f5-4e0e-93a5-df9a3353ced0-snapshots\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mft6\" (UniqueName: \"kubernetes.io/projected/6e397899-feda-4353-bf08-af42ffa8814d-kube-api-access-9mft6\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5229590-685f-4e84-a11c-cab27a0f4728-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5229590-685f-4e84-a11c-cab27a0f4728-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-stats-auth\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588445 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56acd41c-facb-493d-8eac-8cff2fac85ec-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qkq\" (UniqueName: \"kubernetes.io/projected/56acd41c-facb-493d-8eac-8cff2fac85ec-kube-api-access-t5qkq\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.590737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-default-certificate\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sqnf\" (UniqueName: \"kubernetes.io/projected/dedd0bef-bd30-4e3a-8b98-201a6210b591-kube-api-access-4sqnf\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7f59688-84f5-4e0e-93a5-df9a3353ced0-tmp\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e397899-feda-4353-bf08-af42ffa8814d-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80894daf-00f6-4e9d-8175-82e07decf98b-serving-cert\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dedd0bef-bd30-4e3a-8b98-201a6210b591-tmp-dir\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.588790 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e397899-feda-4353-bf08-af42ffa8814d-config\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.589090 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5229590-685f-4e84-a11c-cab27a0f4728-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.589241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7f59688-84f5-4e0e-93a5-df9a3353ced0-tmp\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.589415 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dedd0bef-bd30-4e3a-8b98-201a6210b591-tmp-dir\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.591263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.590323 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7f59688-84f5-4e0e-93a5-df9a3353ced0-serving-cert\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.592160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.591995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e397899-feda-4353-bf08-af42ffa8814d-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.592160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.592006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5229590-685f-4e84-a11c-cab27a0f4728-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.592160 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.592101 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80894daf-00f6-4e9d-8175-82e07decf98b-serving-cert\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.592477 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.592432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00f88e95-65b6-475c-a2bd-3aaf91fd734b-cert\") pod \"ingress-canary-x5lf2\" (UID: \"00f88e95-65b6-475c-a2bd-3aaf91fd734b\") " pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.593662 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.593618 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-stats-auth\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.594137 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.594117 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-default-certificate\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.599127 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.599107 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58gdt\" (UniqueName: \"kubernetes.io/projected/80894daf-00f6-4e9d-8175-82e07decf98b-kube-api-access-58gdt\") pod \"console-operator-7fdbdf9c99-ngb6g\" (UID: \"80894daf-00f6-4e9d-8175-82e07decf98b\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.599820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.599798 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tq6l\" (UniqueName: \"kubernetes.io/projected/c5229590-685f-4e84-a11c-cab27a0f4728-kube-api-access-7tq6l\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vg9pz\" (UID: \"c5229590-685f-4e84-a11c-cab27a0f4728\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.609500 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.609474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97rzm\" (UniqueName: \"kubernetes.io/projected/88b9dce7-4158-4086-8894-e3ecb1d642fa-kube-api-access-97rzm\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:11.609715 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.609690 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjmv\" (UniqueName: \"kubernetes.io/projected/00f88e95-65b6-475c-a2bd-3aaf91fd734b-kube-api-access-zdjmv\") pod \"ingress-canary-x5lf2\" (UID: \"00f88e95-65b6-475c-a2bd-3aaf91fd734b\") " pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.609857 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.609841 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qkq\" (UniqueName: \"kubernetes.io/projected/56acd41c-facb-493d-8eac-8cff2fac85ec-kube-api-access-t5qkq\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:11.612928 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.612903 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sqnf\" (UniqueName: \"kubernetes.io/projected/dedd0bef-bd30-4e3a-8b98-201a6210b591-kube-api-access-4sqnf\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:11.613516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.613495 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh82w\" (UniqueName: \"kubernetes.io/projected/d7f59688-84f5-4e0e-93a5-df9a3353ced0-kube-api-access-zh82w\") pod \"insights-operator-5f67b55555-q97x2\" (UID: \"d7f59688-84f5-4e0e-93a5-df9a3353ced0\") " pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.614664 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.614642 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bnlm\" (UniqueName: \"kubernetes.io/projected/527b92bd-759b-4173-ad57-0c1c2319033d-kube-api-access-2bnlm\") pod \"network-check-source-56499946bc-rtl6m\" (UID: \"527b92bd-759b-4173-ad57-0c1c2319033d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" Jul 01 16:39:11.619799 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.619775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f99nn\" (UniqueName: \"kubernetes.io/projected/89614adb-1dea-4074-96d9-d57bf1b2a851-kube-api-access-f99nn\") pod \"volume-data-source-validator-69d9f679db-pl8w5\" (UID: \"89614adb-1dea-4074-96d9-d57bf1b2a851\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" Jul 01 16:39:11.626668 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.626643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mft6\" (UniqueName: \"kubernetes.io/projected/6e397899-feda-4353-bf08-af42ffa8814d-kube-api-access-9mft6\") pod \"service-ca-operator-5d7b7dc95c-w56hk\" (UID: \"6e397899-feda-4353-bf08-af42ffa8814d\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.707614 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.707581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-q97x2" Jul 01 16:39:11.716623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.716606 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:11.725480 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.725441 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" Jul 01 16:39:11.735251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.735229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" Jul 01 16:39:11.753851 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.753660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" Jul 01 16:39:11.768837 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.768766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" Jul 01 16:39:11.775524 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.775318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x5lf2" Jul 01 16:39:11.984535 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.983662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-rtl6m"] Jul 01 16:39:11.988781 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:11.988749 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527b92bd_759b_4173_ad57_0c1c2319033d.slice/crio-3361c1586616001474e4f5367c16c388e358f24126b6df09379335bb69c17187 WatchSource:0}: Error finding container 3361c1586616001474e4f5367c16c388e358f24126b6df09379335bb69c17187: Status 404 returned error can't find the container with id 3361c1586616001474e4f5367c16c388e358f24126b6df09379335bb69c17187 Jul 01 16:39:11.989041 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.989012 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-q97x2"] Jul 01 16:39:11.993103 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.991998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:11.993103 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.992100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:11.993103 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.992277 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:11.993103 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.992291 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd758cbf9-hhr8h: secret "image-registry-tls" not found Jul 01 16:39:11.993103 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.992342 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:39:11.993103 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.992358 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls podName:b1b95ead-65f6-4561-97fa-d74b717fc2ba nodeName:}" failed. No retries permitted until 2026-07-01 16:39:12.99233937 +0000 UTC m=+36.467407386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls") pod "image-registry-cd758cbf9-hhr8h" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba") : secret "image-registry-tls" not found Jul 01 16:39:11.993103 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:11.992414 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls podName:70382e84-95d1-4d59-b53f-88721cea8bfe nodeName:}" failed. No retries permitted until 2026-07-01 16:39:12.99238429 +0000 UTC m=+36.467452323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-q2z89" (UID: "70382e84-95d1-4d59-b53f-88721cea8bfe") : secret "samples-operator-tls" not found Jul 01 16:39:11.997215 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:11.997190 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz"] Jul 01 16:39:12.001171 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.001136 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-ngb6g"] Jul 01 16:39:12.002888 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:12.002773 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5229590_685f_4e84_a11c_cab27a0f4728.slice/crio-4b7e7663e0d09d0140f19a5581950386b51385a3f20895a6d7e8b5d5681d71f6 WatchSource:0}: Error finding container 4b7e7663e0d09d0140f19a5581950386b51385a3f20895a6d7e8b5d5681d71f6: Status 404 returned error can't find the container with id 4b7e7663e0d09d0140f19a5581950386b51385a3f20895a6d7e8b5d5681d71f6 Jul 01 16:39:12.007910 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:12.007884 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80894daf_00f6_4e9d_8175_82e07decf98b.slice/crio-1394e8a8a7521051caf59a91ba4643f5e62d1ecf5d7b39c4f40e9c1477191891 WatchSource:0}: Error finding container 1394e8a8a7521051caf59a91ba4643f5e62d1ecf5d7b39c4f40e9c1477191891: Status 404 returned error can't find the container with id 1394e8a8a7521051caf59a91ba4643f5e62d1ecf5d7b39c4f40e9c1477191891 Jul 01 16:39:12.029269 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.029251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk"] Jul 01 16:39:12.032770 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:12.032749 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e397899_feda_4353_bf08_af42ffa8814d.slice/crio-24d436bcf7288558592b936dfee568d264202d07dc1f53c5b35e800c28538e83 WatchSource:0}: Error finding container 24d436bcf7288558592b936dfee568d264202d07dc1f53c5b35e800c28538e83: Status 404 returned error can't find the container with id 24d436bcf7288558592b936dfee568d264202d07dc1f53c5b35e800c28538e83 Jul 01 16:39:12.045981 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.045965 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5"] Jul 01 16:39:12.046686 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.046663 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x5lf2"] Jul 01 16:39:12.093471 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.093392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:12.093471 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.093436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:12.093632 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.093479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:12.093632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:12.093547 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:39:12.093632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:12.093565 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:12.093632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:12.093575 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:12.093632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:12.093614 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:13.093587372 +0000 UTC m=+36.568655394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : secret "router-metrics-certs-default" not found Jul 01 16:39:12.093867 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:12.093637 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls podName:dedd0bef-bd30-4e3a-8b98-201a6210b591 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:13.093626932 +0000 UTC m=+36.568694951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls") pod "dns-default-7csvz" (UID: "dedd0bef-bd30-4e3a-8b98-201a6210b591") : secret "dns-default-metrics-tls" not found Jul 01 16:39:12.093867 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:12.093657 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls podName:56acd41c-facb-493d-8eac-8cff2fac85ec nodeName:}" failed. No retries permitted until 2026-07-01 16:39:13.093649074 +0000 UTC m=+36.568717089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-sksmc" (UID: "56acd41c-facb-493d-8eac-8cff2fac85ec") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:12.093867 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.093716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:12.093867 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:12.093832 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:13.093815218 +0000 UTC m=+36.568883232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : configmap references non-existent config key: service-ca.crt Jul 01 16:39:12.165496 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.165445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:12.165676 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.165585 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:12.165676 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.165623 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:12.169136 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.169113 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:39:12.169716 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.169691 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d6vzb\"" Jul 01 16:39:12.169831 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.169734 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:39:12.170281 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.170262 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-89cgw\"" Jul 01 16:39:12.328727 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.328693 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-q97x2" event={"ID":"d7f59688-84f5-4e0e-93a5-df9a3353ced0","Type":"ContainerStarted","Data":"5a10566a02d1f7b1b56770a5af30860a77d4714e7ea3a70c11242fe502eefcf5"} Jul 01 16:39:12.329988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.329964 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" event={"ID":"6e397899-feda-4353-bf08-af42ffa8814d","Type":"ContainerStarted","Data":"24d436bcf7288558592b936dfee568d264202d07dc1f53c5b35e800c28538e83"} Jul 01 16:39:12.331263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.331223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" event={"ID":"c5229590-685f-4e84-a11c-cab27a0f4728","Type":"ContainerStarted","Data":"4b7e7663e0d09d0140f19a5581950386b51385a3f20895a6d7e8b5d5681d71f6"} Jul 01 16:39:12.332434 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.332396 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" event={"ID":"527b92bd-759b-4173-ad57-0c1c2319033d","Type":"ContainerStarted","Data":"3361c1586616001474e4f5367c16c388e358f24126b6df09379335bb69c17187"} Jul 01 16:39:12.333560 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:12.333542 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" event={"ID":"80894daf-00f6-4e9d-8175-82e07decf98b","Type":"ContainerStarted","Data":"1394e8a8a7521051caf59a91ba4643f5e62d1ecf5d7b39c4f40e9c1477191891"} Jul 01 16:39:13.002177 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:13.002143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:13.002632 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:13.002266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:13.002632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.002282 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:13.002632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.002306 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd758cbf9-hhr8h: secret "image-registry-tls" not found Jul 01 16:39:13.002632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.002381 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls podName:b1b95ead-65f6-4561-97fa-d74b717fc2ba nodeName:}" failed. No retries permitted until 2026-07-01 16:39:15.002357846 +0000 UTC m=+38.477425880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls") pod "image-registry-cd758cbf9-hhr8h" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba") : secret "image-registry-tls" not found Jul 01 16:39:13.002632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.002410 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:39:13.002632 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.002477 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls podName:70382e84-95d1-4d59-b53f-88721cea8bfe nodeName:}" failed. No retries permitted until 2026-07-01 16:39:15.002447373 +0000 UTC m=+38.477515384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-q2z89" (UID: "70382e84-95d1-4d59-b53f-88721cea8bfe") : secret "samples-operator-tls" not found Jul 01 16:39:13.103152 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:13.103114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:13.103311 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:13.103227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:13.103311 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:13.103257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:13.103311 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:13.103285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:13.103472 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.103437 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:13.103512 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.103497 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:13.103552 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.103518 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls podName:56acd41c-facb-493d-8eac-8cff2fac85ec nodeName:}" failed. No retries permitted until 2026-07-01 16:39:15.103499875 +0000 UTC m=+38.578567886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-sksmc" (UID: "56acd41c-facb-493d-8eac-8cff2fac85ec") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:13.103552 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.103536 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls podName:dedd0bef-bd30-4e3a-8b98-201a6210b591 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:15.103527315 +0000 UTC m=+38.578595326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls") pod "dns-default-7csvz" (UID: "dedd0bef-bd30-4e3a-8b98-201a6210b591") : secret "dns-default-metrics-tls" not found Jul 01 16:39:13.103552 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.103437 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:39:13.103699 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.103569 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:15.103559429 +0000 UTC m=+38.578627442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : secret "router-metrics-certs-default" not found Jul 01 16:39:13.103699 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:13.103583 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:15.103575466 +0000 UTC m=+38.578643484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : configmap references non-existent config key: service-ca.crt Jul 01 16:39:13.537654 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:13.537611 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89614adb_1dea_4074_96d9_d57bf1b2a851.slice/crio-2abceff759e2a12f75894bad8d2cc3f0395d415840eea1b3ef911ff979bdcd15 WatchSource:0}: Error finding container 2abceff759e2a12f75894bad8d2cc3f0395d415840eea1b3ef911ff979bdcd15: Status 404 returned error can't find the container with id 2abceff759e2a12f75894bad8d2cc3f0395d415840eea1b3ef911ff979bdcd15 Jul 01 16:39:13.538597 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:13.538576 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f88e95_65b6_475c_a2bd_3aaf91fd734b.slice/crio-047e880a283d4144361c3013ace19168985b2b31e38796aad572d7f463d83db6 WatchSource:0}: Error finding container 047e880a283d4144361c3013ace19168985b2b31e38796aad572d7f463d83db6: Status 404 returned error can't find the container with id 047e880a283d4144361c3013ace19168985b2b31e38796aad572d7f463d83db6 Jul 01 16:39:14.344628 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:14.344547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" event={"ID":"89614adb-1dea-4074-96d9-d57bf1b2a851","Type":"ContainerStarted","Data":"2abceff759e2a12f75894bad8d2cc3f0395d415840eea1b3ef911ff979bdcd15"} Jul 01 16:39:14.351839 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:14.351807 2575 generic.go:356] "Generic (PLEG): container finished" podID="62766743-c21d-4665-81c0-3ce948906ee4" containerID="f2dc1553053b3846b109a7601efbc46ac642ba83b36cc406159141a9840268c9" exitCode=0 Jul 01 16:39:14.351973 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:14.351894 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerDied","Data":"f2dc1553053b3846b109a7601efbc46ac642ba83b36cc406159141a9840268c9"} Jul 01 16:39:14.354672 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:14.354646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x5lf2" event={"ID":"00f88e95-65b6-475c-a2bd-3aaf91fd734b","Type":"ContainerStarted","Data":"047e880a283d4144361c3013ace19168985b2b31e38796aad572d7f463d83db6"} Jul 01 16:39:15.023972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.022721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:15.023972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.023311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:15.023972 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.023097 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:39:15.023972 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.023544 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls podName:70382e84-95d1-4d59-b53f-88721cea8bfe nodeName:}" failed. No retries permitted until 2026-07-01 16:39:19.023525279 +0000 UTC m=+42.498593294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-q2z89" (UID: "70382e84-95d1-4d59-b53f-88721cea8bfe") : secret "samples-operator-tls" not found Jul 01 16:39:15.023972 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.023480 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:15.023972 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.023900 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd758cbf9-hhr8h: secret "image-registry-tls" not found Jul 01 16:39:15.023972 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.023948 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls podName:b1b95ead-65f6-4561-97fa-d74b717fc2ba nodeName:}" failed. No retries permitted until 2026-07-01 16:39:19.023933078 +0000 UTC m=+42.499001092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls") pod "image-registry-cd758cbf9-hhr8h" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba") : secret "image-registry-tls" not found Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.124032 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.124086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.124115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.124202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.124378 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:19.124359065 +0000 UTC m=+42.599427093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : configmap references non-existent config key: service-ca.crt Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.124831 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.124880 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:19.124865055 +0000 UTC m=+42.599933067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : secret "router-metrics-certs-default" not found Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.124934 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.124966 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls podName:56acd41c-facb-493d-8eac-8cff2fac85ec nodeName:}" failed. No retries permitted until 2026-07-01 16:39:19.124955038 +0000 UTC m=+42.600023062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-sksmc" (UID: "56acd41c-facb-493d-8eac-8cff2fac85ec") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.125015 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:15.125079 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:15.125043 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls podName:dedd0bef-bd30-4e3a-8b98-201a6210b591 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:19.125033539 +0000 UTC m=+42.600101550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls") pod "dns-default-7csvz" (UID: "dedd0bef-bd30-4e3a-8b98-201a6210b591") : secret "dns-default-metrics-tls" not found Jul 01 16:39:15.365016 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.364717 2575 generic.go:356] "Generic (PLEG): container finished" podID="62766743-c21d-4665-81c0-3ce948906ee4" containerID="35555799c0050b6203cfb1fb6534fb2b4b8c2e32b0c706207a9c980d4c2b066b" exitCode=0 Jul 01 16:39:15.365016 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:15.364859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerDied","Data":"35555799c0050b6203cfb1fb6534fb2b4b8c2e32b0c706207a9c980d4c2b066b"} Jul 01 16:39:16.715158 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:16.715122 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:16.807051 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:16.807013 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:19.059176 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.059087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:19.059617 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.059194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:19.059617 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.059244 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:39:19.059617 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.059310 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:19.059617 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.059328 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd758cbf9-hhr8h: secret "image-registry-tls" not found Jul 01 16:39:19.059617 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.059317 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls podName:70382e84-95d1-4d59-b53f-88721cea8bfe nodeName:}" failed. No retries permitted until 2026-07-01 16:39:27.059298852 +0000 UTC m=+50.534366884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-q2z89" (UID: "70382e84-95d1-4d59-b53f-88721cea8bfe") : secret "samples-operator-tls" not found Jul 01 16:39:19.059617 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.059396 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls podName:b1b95ead-65f6-4561-97fa-d74b717fc2ba nodeName:}" failed. No retries permitted until 2026-07-01 16:39:27.059380698 +0000 UTC m=+50.534448718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls") pod "image-registry-cd758cbf9-hhr8h" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba") : secret "image-registry-tls" not found Jul 01 16:39:19.160618 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.160576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:19.160618 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.160620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:19.160856 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.160656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:19.160856 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.160720 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:39:19.160856 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.160742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:19.160856 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.160785 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:27.160768284 +0000 UTC m=+50.635836318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : secret "router-metrics-certs-default" not found Jul 01 16:39:19.160856 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.160806 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:19.160856 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.160848 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:27.160837417 +0000 UTC m=+50.635905429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : configmap references non-existent config key: service-ca.crt Jul 01 16:39:19.161146 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.160869 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:19.161146 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.160873 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls podName:56acd41c-facb-493d-8eac-8cff2fac85ec nodeName:}" failed. No retries permitted until 2026-07-01 16:39:27.160854981 +0000 UTC m=+50.635923013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-sksmc" (UID: "56acd41c-facb-493d-8eac-8cff2fac85ec") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:19.161146 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:19.160938 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls podName:dedd0bef-bd30-4e3a-8b98-201a6210b591 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:27.160925367 +0000 UTC m=+50.635993377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls") pod "dns-default-7csvz" (UID: "dedd0bef-bd30-4e3a-8b98-201a6210b591") : secret "dns-default-metrics-tls" not found Jul 01 16:39:19.409339 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.409305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:19.500607 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.500563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:19.607330 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:19.607302 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:21.401057 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.401013 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" event={"ID":"6e397899-feda-4353-bf08-af42ffa8814d","Type":"ContainerStarted","Data":"c8bfde2f54e6634ed8959e7ebf000e6b5cd8aa31d5bac5a7d32df40f7721cc75"} Jul 01 16:39:21.403408 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.403381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" event={"ID":"89614adb-1dea-4074-96d9-d57bf1b2a851","Type":"ContainerStarted","Data":"7f2fdee9c8beb794d560a893040b801764ee0f89537323ae48e86d4ffca20c8b"} Jul 01 16:39:21.408421 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.408380 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" event={"ID":"62766743-c21d-4665-81c0-3ce948906ee4","Type":"ContainerStarted","Data":"5b0d34db0f5a6d3390db20620a3bf8b86f64d91406d0315785da2e41073bca45"} Jul 01 16:39:21.410096 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.410072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" event={"ID":"c5229590-685f-4e84-a11c-cab27a0f4728","Type":"ContainerStarted","Data":"a60361e9409b985cd97fbc748bd2d487446c1963023cb4ccfc1ddce2beff7fd0"} Jul 01 16:39:21.412231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.412174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" event={"ID":"527b92bd-759b-4173-ad57-0c1c2319033d","Type":"ContainerStarted","Data":"db1e5e8a59326dd181d9af1604c77c91dd0269feff80743aeceb2ac865551ed5"} Jul 01 16:39:21.413976 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.413956 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/0.log" Jul 01 16:39:21.414176 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.414158 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" event={"ID":"80894daf-00f6-4e9d-8175-82e07decf98b","Type":"ContainerDied","Data":"8bc0df549a765b9121e661415b69afe02cf55950ede9401bc9df91872b19f86f"} Jul 01 16:39:21.414259 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.414241 2575 scope.go:117] "RemoveContainer" containerID="8bc0df549a765b9121e661415b69afe02cf55950ede9401bc9df91872b19f86f" Jul 01 16:39:21.414634 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.413994 2575 generic.go:356] "Generic (PLEG): container finished" podID="80894daf-00f6-4e9d-8175-82e07decf98b" containerID="8bc0df549a765b9121e661415b69afe02cf55950ede9401bc9df91872b19f86f" exitCode=255 Jul 01 16:39:21.416467 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.416431 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x5lf2" event={"ID":"00f88e95-65b6-475c-a2bd-3aaf91fd734b","Type":"ContainerStarted","Data":"a259115f07e21caa61059ae7e17441e381d1ffd2861d32b7dd79a2eb31d04ac2"} Jul 01 16:39:21.418412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.418395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-q97x2" event={"ID":"d7f59688-84f5-4e0e-93a5-df9a3353ced0","Type":"ContainerStarted","Data":"8c88cee519b2b02c5de4b002830c442d6796a37e9b41a23a8644666c14a92008"} Jul 01 16:39:21.438699 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.438655 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" podStartSLOduration=11.449574706 podStartE2EDuration="20.43863805s" totalImagesPullingTime="8.989063344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:21.431809161 +0000 UTC m=+44.906877195" watchObservedRunningTime="2026-07-01 16:39:21.43863805 +0000 UTC m=+44.913706065" Jul 01 16:39:21.503413 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.503363 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-rtl6m" podStartSLOduration=11.460633287 podStartE2EDuration="20.503348367s" totalImagesPullingTime="9.04271508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:21.503045437 +0000 UTC m=+44.978113473" watchObservedRunningTime="2026-07-01 16:39:21.503348367 +0000 UTC m=+44.978416378" Jul 01 16:39:21.526539 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.526471 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-q97x2" podStartSLOduration=13.497032786 podStartE2EDuration="22.526423137s" totalImagesPullingTime="9.029390351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:21.524841299 +0000 UTC m=+44.999909326" watchObservedRunningTime="2026-07-01 16:39:21.526423137 +0000 UTC m=+45.001491172" Jul 01 16:39:21.553777 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.553468 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-pl8w5" podStartSLOduration=15.214266868 podStartE2EDuration="22.553435395s" totalImagesPullingTime="7.339168527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:21.553131455 +0000 UTC m=+45.028199496" watchObservedRunningTime="2026-07-01 16:39:21.553435395 +0000 UTC m=+45.028503429" Jul 01 16:39:21.612804 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.612748 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r5z6q" podStartSLOduration=14.523066423 podStartE2EDuration="44.612727365s" totalImagesPullingTime="30.089660942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:21.609800393 +0000 UTC m=+45.084868422" watchObservedRunningTime="2026-07-01 16:39:21.612727365 +0000 UTC m=+45.087795399" Jul 01 16:39:21.613301 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.613058 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x5lf2" podStartSLOduration=3.127694017 podStartE2EDuration="10.613048367s" totalImagesPullingTime="7.48535435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:21.578776644 +0000 UTC m=+45.053844677" watchObservedRunningTime="2026-07-01 16:39:21.613048367 +0000 UTC m=+45.088116401" Jul 01 16:39:21.632303 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.632266 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" podStartSLOduration=13.614683716 podStartE2EDuration="22.632251041s" totalImagesPullingTime="9.017567325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:21.631543353 +0000 UTC m=+45.106611386" watchObservedRunningTime="2026-07-01 16:39:21.632251041 +0000 UTC m=+45.107319074" Jul 01 16:39:21.677274 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.677207 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:21.717090 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.717027 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:21.717217 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.717125 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:21.768415 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.768386 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:21.838346 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:21.838312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:22.088035 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.088002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:22.150419 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.150385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:22.303483 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.303387 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6bhnz"] Jul 01 16:39:22.321520 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.321497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.325480 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.325428 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:39:22.325480 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.325470 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mj5tc\"" Jul 01 16:39:22.325669 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.325516 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:39:22.329472 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.329425 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bhnz"] Jul 01 16:39:22.335079 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.335052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:22.392632 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.392609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.392765 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.392740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp44q\" (UniqueName: \"kubernetes.io/projected/4ba56669-bfef-46f0-b85a-efc91307b482-kube-api-access-bp44q\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.392826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.392777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba56669-bfef-46f0-b85a-efc91307b482-data-volume\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.392826 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.392807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.392932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.392860 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ba56669-bfef-46f0-b85a-efc91307b482-crio-socket\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.402141 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.402097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:22.424815 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.424795 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/1.log" Jul 01 16:39:22.425206 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.425189 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/0.log" Jul 01 16:39:22.425331 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.425228 2575 generic.go:356] "Generic (PLEG): container finished" podID="80894daf-00f6-4e9d-8175-82e07decf98b" containerID="0bb89df162dd6173cd5603b22aebe0cef25e81173e4de9d563475feec5ed3ac6" exitCode=255 Jul 01 16:39:22.425388 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.425330 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" event={"ID":"80894daf-00f6-4e9d-8175-82e07decf98b","Type":"ContainerDied","Data":"0bb89df162dd6173cd5603b22aebe0cef25e81173e4de9d563475feec5ed3ac6"} Jul 01 16:39:22.425388 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.425383 2575 scope.go:117] "RemoveContainer" containerID="8bc0df549a765b9121e661415b69afe02cf55950ede9401bc9df91872b19f86f" Jul 01 16:39:22.425850 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.425625 2575 scope.go:117] "RemoveContainer" containerID="0bb89df162dd6173cd5603b22aebe0cef25e81173e4de9d563475feec5ed3ac6" Jul 01 16:39:22.425955 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.425812 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-ngb6g_openshift-console-operator(80894daf-00f6-4e9d-8175-82e07decf98b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" podUID="80894daf-00f6-4e9d-8175-82e07decf98b" Jul 01 16:39:22.493398 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.493374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ba56669-bfef-46f0-b85a-efc91307b482-crio-socket\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.493557 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.493532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.493661 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.493648 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:22.493720 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.493705 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:22.993685501 +0000 UTC m=+46.468753514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:22.493876 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.493834 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ba56669-bfef-46f0-b85a-efc91307b482-crio-socket\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.494159 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.494133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp44q\" (UniqueName: \"kubernetes.io/projected/4ba56669-bfef-46f0-b85a-efc91307b482-kube-api-access-bp44q\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.494396 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.494374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba56669-bfef-46f0-b85a-efc91307b482-data-volume\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.494564 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.494545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.494665 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.494647 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:22.494813 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.494802 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:22.994787481 +0000 UTC m=+46.469855495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : configmap "kube-rbac-proxy" not found Jul 01 16:39:22.494900 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.494672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ba56669-bfef-46f0-b85a-efc91307b482-data-volume\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.507696 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.507676 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp44q\" (UniqueName: \"kubernetes.io/projected/4ba56669-bfef-46f0-b85a-efc91307b482-kube-api-access-bp44q\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.892882 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.892854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:22.999436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.999399 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.999656 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:22.999498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:22.999656 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.999525 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:22.999656 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.999604 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:23.999585576 +0000 UTC m=+47.474653608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : configmap "kube-rbac-proxy" not found Jul 01 16:39:22.999813 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.999665 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:22.999813 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:22.999733 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:23.999714913 +0000 UTC m=+47.474782931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:23.432142 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:23.432113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/1.log" Jul 01 16:39:23.432496 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:23.432421 2575 scope.go:117] "RemoveContainer" containerID="0bb89df162dd6173cd5603b22aebe0cef25e81173e4de9d563475feec5ed3ac6" Jul 01 16:39:23.432600 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:23.432581 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-ngb6g_openshift-console-operator(80894daf-00f6-4e9d-8175-82e07decf98b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" podUID="80894daf-00f6-4e9d-8175-82e07decf98b" Jul 01 16:39:24.007446 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:24.007416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:24.007637 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:24.007496 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:24.007637 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:24.007539 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:24.007637 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:24.007620 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:26.007602744 +0000 UTC m=+49.482670774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : configmap "kube-rbac-proxy" not found Jul 01 16:39:24.007803 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:24.007667 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:24.007803 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:24.007747 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:26.007729287 +0000 UTC m=+49.482797627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:24.089498 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:24.089429 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8mz4h_0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7/dns-node-resolver/0.log" Jul 01 16:39:24.640698 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:24.640663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:24.711809 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:24.711777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:25.223998 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:25.223961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:25.282413 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:25.282379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:25.479938 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:25.479868 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rcbfd_533e899c-b8a1-430f-b439-82348701874e/node-ca/0.log" Jul 01 16:39:26.027687 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:26.027654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:26.028073 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:26.027812 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:26.028073 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:26.027854 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:26.028073 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:26.027811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:26.028073 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:26.027879 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:30.027859895 +0000 UTC m=+53.502927916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:26.028073 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:26.027919 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:30.027896851 +0000 UTC m=+53.502964865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : configmap "kube-rbac-proxy" not found Jul 01 16:39:26.082926 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:26.082896 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x5lf2_00f88e95-65b6-475c-a2bd-3aaf91fd734b/serve-healthcheck-canary/0.log" Jul 01 16:39:26.333299 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:26.333234 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:27.136711 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.136678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:27.137089 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.136741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:27.137089 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.136838 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 16:39:27.137089 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.136868 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:27.137089 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.136881 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd758cbf9-hhr8h: secret "image-registry-tls" not found Jul 01 16:39:27.137089 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.136902 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls podName:70382e84-95d1-4d59-b53f-88721cea8bfe nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.136887953 +0000 UTC m=+66.611955964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-q2z89" (UID: "70382e84-95d1-4d59-b53f-88721cea8bfe") : secret "samples-operator-tls" not found Jul 01 16:39:27.137089 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.136921 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls podName:b1b95ead-65f6-4561-97fa-d74b717fc2ba nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.136910383 +0000 UTC m=+66.611978397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls") pod "image-registry-cd758cbf9-hhr8h" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba") : secret "image-registry-tls" not found Jul 01 16:39:27.237935 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.237905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:27.238100 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.238018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:27.238100 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.238054 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.238037847 +0000 UTC m=+66.713105862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : configmap references non-existent config key: service-ca.crt Jul 01 16:39:27.238100 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.238078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:27.238262 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.238103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:27.238262 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.238106 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:39:27.238262 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.238161 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs podName:88b9dce7-4158-4086-8894-e3ecb1d642fa nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.238144492 +0000 UTC m=+66.713212510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs") pod "router-default-59b55764c-6x7db" (UID: "88b9dce7-4158-4086-8894-e3ecb1d642fa") : secret "router-metrics-certs-default" not found Jul 01 16:39:27.238262 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.238180 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:27.238262 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.238249 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls podName:56acd41c-facb-493d-8eac-8cff2fac85ec nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.23823732 +0000 UTC m=+66.713305334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-sksmc" (UID: "56acd41c-facb-493d-8eac-8cff2fac85ec") : secret "cluster-monitoring-operator-tls" not found Jul 01 16:39:27.238262 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.238187 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:27.238504 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:27.238284 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls podName:dedd0bef-bd30-4e3a-8b98-201a6210b591 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.238276571 +0000 UTC m=+66.713344582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls") pod "dns-default-7csvz" (UID: "dedd0bef-bd30-4e3a-8b98-201a6210b591") : secret "dns-default-metrics-tls" not found Jul 01 16:39:27.581985 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.581907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:27.686467 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.686431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:27.799194 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:27.799166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:28.886628 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:28.886594 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:30.063134 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:30.063105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:30.063520 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:30.063154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:30.063520 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:30.063323 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:30.063520 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:30.063397 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls podName:4ba56669-bfef-46f0-b85a-efc91307b482 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:38.063381378 +0000 UTC m=+61.538449400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bhnz" (UID: "4ba56669-bfef-46f0-b85a-efc91307b482") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:30.063708 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:30.063690 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ba56669-bfef-46f0-b85a-efc91307b482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:30.451352 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:30.451319 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:31.717693 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:31.717665 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:31.718070 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:31.717716 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:31.718070 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:31.718041 2575 scope.go:117] "RemoveContainer" containerID="0bb89df162dd6173cd5603b22aebe0cef25e81173e4de9d563475feec5ed3ac6" Jul 01 16:39:32.460697 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:32.460668 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:39:32.461074 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:32.461059 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/1.log" Jul 01 16:39:32.461184 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:32.461093 2575 generic.go:356] "Generic (PLEG): container finished" podID="80894daf-00f6-4e9d-8175-82e07decf98b" containerID="fb4282a1673808af158f6d84ee8bdf957c6072181feb4e8059257b32d8de9d95" exitCode=255 Jul 01 16:39:32.461184 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:32.461150 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" event={"ID":"80894daf-00f6-4e9d-8175-82e07decf98b","Type":"ContainerDied","Data":"fb4282a1673808af158f6d84ee8bdf957c6072181feb4e8059257b32d8de9d95"} Jul 01 16:39:32.461286 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:32.461238 2575 scope.go:117] "RemoveContainer" containerID="0bb89df162dd6173cd5603b22aebe0cef25e81173e4de9d563475feec5ed3ac6" Jul 01 16:39:32.461515 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:32.461496 2575 scope.go:117] "RemoveContainer" containerID="fb4282a1673808af158f6d84ee8bdf957c6072181feb4e8059257b32d8de9d95" Jul 01 16:39:32.461685 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:32.461667 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-ngb6g_openshift-console-operator(80894daf-00f6-4e9d-8175-82e07decf98b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" podUID="80894daf-00f6-4e9d-8175-82e07decf98b" Jul 01 16:39:32.901905 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:32.901877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:33.000049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.000019 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:33.063704 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.063667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:33.160708 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.160648 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:33.355907 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.355878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:33.465269 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.465205 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:39:33.759649 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.759583 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:33.828888 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.828866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:33.959139 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:33.959113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:34.561920 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:34.561891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:34.758397 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:34.758366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:34.883807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:34.883782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:35.169222 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:35.169146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:35.365960 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:35.365927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:35.770805 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:35.770774 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:35.841993 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:35.841964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:35.954056 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:35.954025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:36.363143 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:36.363110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:36.483959 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:36.483928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:36.582315 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:36.582283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:36.971978 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:36.971948 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:37.330139 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:37.330077 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d8vw7" Jul 01 16:39:37.423721 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:37.423691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:37.556150 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:37.556116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:37.755572 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:37.755543 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:38.130419 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.130395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:38.132618 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.132589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ba56669-bfef-46f0-b85a-efc91307b482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bhnz\" (UID: \"4ba56669-bfef-46f0-b85a-efc91307b482\") " pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:38.161817 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.161790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:38.235703 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.235680 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mj5tc\"" Jul 01 16:39:38.243159 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.243143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bhnz" Jul 01 16:39:38.365451 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.365404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:38.370284 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.370259 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bhnz"] Jul 01 16:39:38.373802 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:38.373779 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba56669_bfef_46f0_b85a_efc91307b482.slice/crio-d88728b9e066708c97c56e9809e3e93e4547cd367e457e63eb566076f294a4f2 WatchSource:0}: Error finding container d88728b9e066708c97c56e9809e3e93e4547cd367e457e63eb566076f294a4f2: Status 404 returned error can't find the container with id d88728b9e066708c97c56e9809e3e93e4547cd367e457e63eb566076f294a4f2 Jul 01 16:39:38.480557 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.480487 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhnz" event={"ID":"4ba56669-bfef-46f0-b85a-efc91307b482","Type":"ContainerStarted","Data":"d88728b9e066708c97c56e9809e3e93e4547cd367e457e63eb566076f294a4f2"} Jul 01 16:39:38.559755 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:38.559726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:39.630736 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:39.630701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:39.757696 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:39.757660 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:40.155660 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:40.155620 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:40.358568 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:40.358537 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:40.755841 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:40.755801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:41.375730 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:41.375696 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:41.565124 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:41.565090 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:41.716901 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:41.716831 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:41.716901 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:41.716899 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:41.717294 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:41.717259 2575 scope.go:117] "RemoveContainer" containerID="fb4282a1673808af158f6d84ee8bdf957c6072181feb4e8059257b32d8de9d95" Jul 01 16:39:41.717528 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:39:41.717505 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-ngb6g_openshift-console-operator(80894daf-00f6-4e9d-8175-82e07decf98b)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" podUID="80894daf-00f6-4e9d-8175-82e07decf98b" Jul 01 16:39:41.751803 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:41.751778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:41.813659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:41.813622 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:42.497491 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:42.497437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhnz" event={"ID":"4ba56669-bfef-46f0-b85a-efc91307b482","Type":"ContainerStarted","Data":"bd2f25aa79cec0c351513f194002a489669dcc0ccc74c3bf0e49ab3069999387"} Jul 01 16:39:42.979946 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:42.979912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:42.980323 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:42.979984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:42.982887 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:42.982868 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:39:42.983966 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:42.983950 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:39:42.993264 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:42.993239 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71d69444-0428-4688-9001-3b5697c4fd16-original-pull-secret\") pod \"global-pull-secret-syncer-7s446\" (UID: \"71d69444-0428-4688-9001-3b5697c4fd16\") " pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:42.993684 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:42.993665 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c472a26-4f40-44d5-a402-20c081f11250-metrics-certs\") pod \"network-metrics-daemon-4tkdg\" (UID: \"7c472a26-4f40-44d5-a402-20c081f11250\") " pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:43.081057 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.081030 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d6vzb\"" Jul 01 16:39:43.081204 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.081062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:43.083742 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.083714 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9mtl\" (UniqueName: \"kubernetes.io/projected/5feba9b7-482f-4723-8209-a34f3f3a066a-kube-api-access-x9mtl\") pod \"network-check-target-ngrc2\" (UID: \"5feba9b7-482f-4723-8209-a34f3f3a066a\") " pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:43.087069 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.087051 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-89cgw\"" Jul 01 16:39:43.088092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.088069 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4tkdg" Jul 01 16:39:43.089297 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.089278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s446" Jul 01 16:39:43.094589 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.094572 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:43.182317 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.182278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:43.182495 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.182380 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:43.189572 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.189545 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70382e84-95d1-4d59-b53f-88721cea8bfe-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-q2z89\" (UID: \"70382e84-95d1-4d59-b53f-88721cea8bfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:43.189717 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.189588 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"image-registry-cd758cbf9-hhr8h\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:43.200860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.200777 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5vwqr\"" Jul 01 16:39:43.208929 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.208698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" Jul 01 16:39:43.271857 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.271823 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4tkdg"] Jul 01 16:39:43.278695 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:43.278660 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c472a26_4f40_44d5_a402_20c081f11250.slice/crio-189a9ebefb3e4970b239b3365e3e1aa755e4806ce60df078bff4113316a614c8 WatchSource:0}: Error finding container 189a9ebefb3e4970b239b3365e3e1aa755e4806ce60df078bff4113316a614c8: Status 404 returned error can't find the container with id 189a9ebefb3e4970b239b3365e3e1aa755e4806ce60df078bff4113316a614c8 Jul 01 16:39:43.284244 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.283847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:43.284244 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.283894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:43.284244 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.283928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:43.284244 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.283992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:43.284814 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.284780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b9dce7-4158-4086-8894-e3ecb1d642fa-service-ca-bundle\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:43.287078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.287038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dedd0bef-bd30-4e3a-8b98-201a6210b591-metrics-tls\") pod \"dns-default-7csvz\" (UID: \"dedd0bef-bd30-4e3a-8b98-201a6210b591\") " pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:43.287609 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.287585 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88b9dce7-4158-4086-8894-e3ecb1d642fa-metrics-certs\") pod \"router-default-59b55764c-6x7db\" (UID: \"88b9dce7-4158-4086-8894-e3ecb1d642fa\") " pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:43.288016 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.287974 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56acd41c-facb-493d-8eac-8cff2fac85ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-sksmc\" (UID: \"56acd41c-facb-493d-8eac-8cff2fac85ec\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:43.290536 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.290427 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s446"] Jul 01 16:39:43.293448 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:43.293423 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d69444_0428_4688_9001_3b5697c4fd16.slice/crio-3575faf56db611553cfdd653c2d004bf9fc82003a3a72645189661c760075016 WatchSource:0}: Error finding container 3575faf56db611553cfdd653c2d004bf9fc82003a3a72645189661c760075016: Status 404 returned error can't find the container with id 3575faf56db611553cfdd653c2d004bf9fc82003a3a72645189661c760075016 Jul 01 16:39:43.310392 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.310281 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ngrc2"] Jul 01 16:39:43.314539 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:43.314512 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5feba9b7_482f_4723_8209_a34f3f3a066a.slice/crio-5a915da72abb3c14a7618c5a60d31d634c4e28da2f9e9609827cd2a66564b439 WatchSource:0}: Error finding container 5a915da72abb3c14a7618c5a60d31d634c4e28da2f9e9609827cd2a66564b439: Status 404 returned error can't find the container with id 5a915da72abb3c14a7618c5a60d31d634c4e28da2f9e9609827cd2a66564b439 Jul 01 16:39:43.386191 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.386165 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89"] Jul 01 16:39:43.493097 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.493045 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzznc\"" Jul 01 16:39:43.500315 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.500290 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:43.503205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.503176 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhnz" event={"ID":"4ba56669-bfef-46f0-b85a-efc91307b482","Type":"ContainerStarted","Data":"2f48527ecab2f041c7b008609eb6886cc91e632895f43b402f5d106de6a4a64c"} Jul 01 16:39:43.504474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.504427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s446" event={"ID":"71d69444-0428-4688-9001-3b5697c4fd16","Type":"ContainerStarted","Data":"3575faf56db611553cfdd653c2d004bf9fc82003a3a72645189661c760075016"} Jul 01 16:39:43.505737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.505714 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4tkdg" event={"ID":"7c472a26-4f40-44d5-a402-20c081f11250","Type":"ContainerStarted","Data":"189a9ebefb3e4970b239b3365e3e1aa755e4806ce60df078bff4113316a614c8"} Jul 01 16:39:43.507205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.507179 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ngrc2" event={"ID":"5feba9b7-482f-4723-8209-a34f3f3a066a","Type":"ContainerStarted","Data":"8a0ac1cb128cf3cefa105a65b3a1296865a8603731a0fedd68981f9a562fc240"} Jul 01 16:39:43.507299 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.507221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ngrc2" event={"ID":"5feba9b7-482f-4723-8209-a34f3f3a066a","Type":"ContainerStarted","Data":"5a915da72abb3c14a7618c5a60d31d634c4e28da2f9e9609827cd2a66564b439"} Jul 01 16:39:43.507364 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.507297 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:39:43.508345 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.508323 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" event={"ID":"70382e84-95d1-4d59-b53f-88721cea8bfe","Type":"ContainerStarted","Data":"b8569a8e677ddfcf91cbdf69baf9c7e088d87f6a9a4916bcc131b5a0560d4f86"} Jul 01 16:39:43.527599 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.527559 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ngrc2" podStartSLOduration=66.527546262 podStartE2EDuration="1m6.527546262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:43.525851153 +0000 UTC m=+67.000919186" watchObservedRunningTime="2026-07-01 16:39:43.527546262 +0000 UTC m=+67.002614294" Jul 01 16:39:43.549519 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.549342 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tpbbc\"" Jul 01 16:39:43.557752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.557731 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" Jul 01 16:39:43.564817 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.564791 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wgm5h\"" Jul 01 16:39:43.572388 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.572305 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:43.584980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.584943 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qw5lg\"" Jul 01 16:39:43.591390 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.591364 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:43.666482 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.666405 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cd758cbf9-hhr8h"] Jul 01 16:39:43.671091 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:43.671052 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b95ead_65f6_4561_97fa_d74b717fc2ba.slice/crio-3f9be4ca91c4617bf8e9ed491b9a23aed814ff0ae5caec3133c5c9d3d184b82d WatchSource:0}: Error finding container 3f9be4ca91c4617bf8e9ed491b9a23aed814ff0ae5caec3133c5c9d3d184b82d: Status 404 returned error can't find the container with id 3f9be4ca91c4617bf8e9ed491b9a23aed814ff0ae5caec3133c5c9d3d184b82d Jul 01 16:39:43.787354 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.787053 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc"] Jul 01 16:39:43.790733 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:43.790704 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56acd41c_facb_493d_8eac_8cff2fac85ec.slice/crio-6701a5121af3e9d584d5a8a37bfa8eaf2d2fcce1022cb39088c271dec18d7fac WatchSource:0}: Error finding container 6701a5121af3e9d584d5a8a37bfa8eaf2d2fcce1022cb39088c271dec18d7fac: Status 404 returned error can't find the container with id 6701a5121af3e9d584d5a8a37bfa8eaf2d2fcce1022cb39088c271dec18d7fac Jul 01 16:39:43.833644 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.833616 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59b55764c-6x7db"] Jul 01 16:39:43.839518 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:43.839490 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b9dce7_4158_4086_8894_e3ecb1d642fa.slice/crio-032e217c061dd3216a5d1dbdb8400ee105440d8e42d1032ee9ccd2fde7c8c044 WatchSource:0}: Error finding container 032e217c061dd3216a5d1dbdb8400ee105440d8e42d1032ee9ccd2fde7c8c044: Status 404 returned error can't find the container with id 032e217c061dd3216a5d1dbdb8400ee105440d8e42d1032ee9ccd2fde7c8c044 Jul 01 16:39:43.848211 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.848173 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7csvz"] Jul 01 16:39:43.852169 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:39:43.852143 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedd0bef_bd30_4e3a_8b98_201a6210b591.slice/crio-333186ff8adfe4654fa2e49aa2d2cc70236fc0ac5b85d4ccd3b4db7dc4bb6063 WatchSource:0}: Error finding container 333186ff8adfe4654fa2e49aa2d2cc70236fc0ac5b85d4ccd3b4db7dc4bb6063: Status 404 returned error can't find the container with id 333186ff8adfe4654fa2e49aa2d2cc70236fc0ac5b85d4ccd3b4db7dc4bb6063 Jul 01 16:39:43.923978 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:43.923955 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:44.077472 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.077335 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:44.294215 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.294179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:44.379662 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.379527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:44.516828 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.516054 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59b55764c-6x7db" event={"ID":"88b9dce7-4158-4086-8894-e3ecb1d642fa","Type":"ContainerStarted","Data":"e5b15f94a29628de7c62c27d9015ebb7eac56dada40536a05b1aad0fa39e496a"} Jul 01 16:39:44.516828 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.516112 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59b55764c-6x7db" event={"ID":"88b9dce7-4158-4086-8894-e3ecb1d642fa","Type":"ContainerStarted","Data":"032e217c061dd3216a5d1dbdb8400ee105440d8e42d1032ee9ccd2fde7c8c044"} Jul 01 16:39:44.519360 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.519323 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" event={"ID":"b1b95ead-65f6-4561-97fa-d74b717fc2ba","Type":"ContainerStarted","Data":"9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5"} Jul 01 16:39:44.519495 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.519371 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" event={"ID":"b1b95ead-65f6-4561-97fa-d74b717fc2ba","Type":"ContainerStarted","Data":"3f9be4ca91c4617bf8e9ed491b9a23aed814ff0ae5caec3133c5c9d3d184b82d"} Jul 01 16:39:44.519663 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.519620 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:39:44.521969 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.521913 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7csvz" event={"ID":"dedd0bef-bd30-4e3a-8b98-201a6210b591","Type":"ContainerStarted","Data":"333186ff8adfe4654fa2e49aa2d2cc70236fc0ac5b85d4ccd3b4db7dc4bb6063"} Jul 01 16:39:44.524154 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.524092 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" event={"ID":"56acd41c-facb-493d-8eac-8cff2fac85ec","Type":"ContainerStarted","Data":"6701a5121af3e9d584d5a8a37bfa8eaf2d2fcce1022cb39088c271dec18d7fac"} Jul 01 16:39:44.542718 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.542670 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59b55764c-6x7db" podStartSLOduration=45.542653833 podStartE2EDuration="45.542653833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:44.540823369 +0000 UTC m=+68.015891404" watchObservedRunningTime="2026-07-01 16:39:44.542653833 +0000 UTC m=+68.017721868" Jul 01 16:39:44.568372 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.568316 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" podStartSLOduration=67.568299604 podStartE2EDuration="1m7.568299604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:44.566820028 +0000 UTC m=+68.041888084" watchObservedRunningTime="2026-07-01 16:39:44.568299604 +0000 UTC m=+68.043367637" Jul 01 16:39:44.572729 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.572709 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:44.575538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:44.575516 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:45.529075 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:45.529010 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:45.530307 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:45.530271 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59b55764c-6x7db" Jul 01 16:39:46.175600 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:46.175563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:46.233440 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:46.233388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:46.557329 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:46.557248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:46.716953 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:46.716852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:46.786425 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:46.786392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:49.469061 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.469031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:49.547265 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.547230 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" event={"ID":"70382e84-95d1-4d59-b53f-88721cea8bfe","Type":"ContainerStarted","Data":"5bf5598732ef5b701bbeeda0ded553d2f72913d2f6e096470de2bb5ab093520a"} Jul 01 16:39:49.547425 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.547292 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" event={"ID":"70382e84-95d1-4d59-b53f-88721cea8bfe","Type":"ContainerStarted","Data":"132571c65a0a404d447bc5d7be8e896bfd9a875ca1eb10470c75af187bb32b53"} Jul 01 16:39:49.549287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.549256 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bhnz" event={"ID":"4ba56669-bfef-46f0-b85a-efc91307b482","Type":"ContainerStarted","Data":"b74d6619e9d15ebe7ad42ef56e8448bbec63a77d0c09481ec6056341c009c323"} Jul 01 16:39:49.550732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.550700 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s446" event={"ID":"71d69444-0428-4688-9001-3b5697c4fd16","Type":"ContainerStarted","Data":"208f7fe4cd33b117f610dc32fd4724a85ee78aeec5c91e054f7728db23bd75fa"} Jul 01 16:39:49.552380 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.552361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4tkdg" event={"ID":"7c472a26-4f40-44d5-a402-20c081f11250","Type":"ContainerStarted","Data":"5607677b65ff9564317eb30f5cc9736a6091688919c798f6cc05d8978f5d45ec"} Jul 01 16:39:49.552496 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.552404 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4tkdg" event={"ID":"7c472a26-4f40-44d5-a402-20c081f11250","Type":"ContainerStarted","Data":"d7ae5a2e303b8c558159adf9b939f7a5b1b86aeafc26c66acf619b9bcf070f46"} Jul 01 16:39:49.554174 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.554122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7csvz" event={"ID":"dedd0bef-bd30-4e3a-8b98-201a6210b591","Type":"ContainerStarted","Data":"2822d462d6b078b69567a46910ad10565023165149b2cf367a2cdf663fcb6c58"} Jul 01 16:39:49.554174 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.554171 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:49.554321 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.554195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7csvz" event={"ID":"dedd0bef-bd30-4e3a-8b98-201a6210b591","Type":"ContainerStarted","Data":"44d6b3b529e018db31a404abe32a516ec7143c8c92795ce897ff32d5fb370fe1"} Jul 01 16:39:49.555565 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.555545 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" event={"ID":"56acd41c-facb-493d-8eac-8cff2fac85ec","Type":"ContainerStarted","Data":"9200df8f917bc44123aa0fddaae96851f84efab06d8db50dd1deb1394e78b454"} Jul 01 16:39:49.565776 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.565756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:49.571171 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.571127 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-q2z89" podStartSLOduration=45.015201072 podStartE2EDuration="50.57111352s" totalImagesPullingTime="5.555912448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:49.570487605 +0000 UTC m=+73.045555638" watchObservedRunningTime="2026-07-01 16:39:49.57111352 +0000 UTC m=+73.046181533" Jul 01 16:39:49.592694 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.592656 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4tkdg" podStartSLOduration=66.842054925 podStartE2EDuration="1m12.59264402s" totalImagesPullingTime="5.750589095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:49.591354623 +0000 UTC m=+73.066422655" watchObservedRunningTime="2026-07-01 16:39:49.59264402 +0000 UTC m=+73.067712053" Jul 01 16:39:49.616747 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.616708 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7s446" podStartSLOduration=66.893135953 podStartE2EDuration="1m12.616696264s" totalImagesPullingTime="5.723560311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:49.616179536 +0000 UTC m=+73.091247572" watchObservedRunningTime="2026-07-01 16:39:49.616696264 +0000 UTC m=+73.091764275" Jul 01 16:39:49.642114 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.642073 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-sksmc" podStartSLOduration=45.644074871 podStartE2EDuration="50.642060339s" totalImagesPullingTime="4.997985468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:49.641440655 +0000 UTC m=+73.116508689" watchObservedRunningTime="2026-07-01 16:39:49.642060339 +0000 UTC m=+73.117128424" Jul 01 16:39:49.662387 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.662345 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7csvz" podStartSLOduration=33.516771188 podStartE2EDuration="38.662328515s" totalImagesPullingTime="5.145557327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:49.661643676 +0000 UTC m=+73.136711709" watchObservedRunningTime="2026-07-01 16:39:49.662328515 +0000 UTC m=+73.137396549" Jul 01 16:39:49.670307 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.670287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:49.694739 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.694704 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6bhnz" podStartSLOduration=17.388189706 podStartE2EDuration="27.694692263s" totalImagesPullingTime="10.306502557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:39:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:49.693507791 +0000 UTC m=+73.168575826" watchObservedRunningTime="2026-07-01 16:39:49.694692263 +0000 UTC m=+73.169760295" Jul 01 16:39:49.743352 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.743325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:49.804917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:49.804859 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:50.086024 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:50.085964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:51.651249 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:51.651218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:51.717468 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:51.717431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:53.147866 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.147837 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:53.166074 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.166055 2575 scope.go:117] "RemoveContainer" containerID="fb4282a1673808af158f6d84ee8bdf957c6072181feb4e8059257b32d8de9d95" Jul 01 16:39:53.242232 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.242207 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:53.343214 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.343181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:53.572164 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.572098 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:39:53.572292 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.572172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" event={"ID":"80894daf-00f6-4e9d-8175-82e07decf98b","Type":"ContainerStarted","Data":"59de95eed9469c2c17dde7128408e93c0b85c3d934a2c5fea6e9ca8ba334ab9d"} Jul 01 16:39:53.572471 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.572433 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:53.596673 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:53.596627 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" podStartSLOduration=45.584137296 podStartE2EDuration="54.596615043s" totalImagesPullingTime="9.012477747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:53.595072991 +0000 UTC m=+77.070141026" watchObservedRunningTime="2026-07-01 16:39:53.596615043 +0000 UTC m=+77.071683103" Jul 01 16:39:54.220356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:54.220326 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-ngb6g" Jul 01 16:39:54.467131 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:54.467105 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:54.560812 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:54.560730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:54.718656 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:54.718628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:54.889264 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:54.889230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:54.965472 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:54.965430 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:55.513784 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:55.513754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:55.714731 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:55.714700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:55.799154 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:55.799071 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:55.866446 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:55.866410 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:55.968211 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:55.968144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:56.112747 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:56.112673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:56.183559 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:56.183529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:57.545094 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:57.545062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:57.642825 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:57.642794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:57.730842 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:57.730814 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:58.230015 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:58.229978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:59.561886 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:59.561777 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7csvz" Jul 01 16:39:59.947142 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:39:59.947109 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:00.183956 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.183927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:00.250781 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.250714 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5"] Jul 01 16:40:00.253580 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.253561 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.261765 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.261743 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 16:40:00.261851 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.261743 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7mwbs\"" Jul 01 16:40:00.263240 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.263220 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 16:40:00.265512 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.265497 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 16:40:00.280431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.280412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:00.295483 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.295443 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jp8wr"] Jul 01 16:40:00.297430 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.297416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.302424 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.302407 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fpg24\"" Jul 01 16:40:00.302540 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.302415 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 16:40:00.303082 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.303067 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 16:40:00.307504 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.307488 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 16:40:00.315767 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82z8h\" (UniqueName: \"kubernetes.io/projected/efe94e17-5431-4014-b952-46dfd31caa19-kube-api-access-82z8h\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.315854 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.315854 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-metrics-client-ca\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.315854 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.315986 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nlmg\" (UniqueName: \"kubernetes.io/projected/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-kube-api-access-2nlmg\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.315986 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-wtmp\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.315986 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.316101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.315999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.316101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.316022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-sys\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.316101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.316036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-root\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.316101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.316057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-textfile\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.316101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.316080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-tls\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.316101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.316096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe94e17-5431-4014-b952-46dfd31caa19-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.345862 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.345837 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5"] Jul 01 16:40:00.376412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.376381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:00.416612 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82z8h\" (UniqueName: \"kubernetes.io/projected/efe94e17-5431-4014-b952-46dfd31caa19-kube-api-access-82z8h\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.416713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.416713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-metrics-client-ca\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.416713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416670 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.416713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nlmg\" (UniqueName: \"kubernetes.io/projected/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-kube-api-access-2nlmg\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.416885 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:40:00.416754 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 16:40:00.416885 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:40:00.416837 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-tls podName:efe94e17-5431-4014-b952-46dfd31caa19 nodeName:}" failed. No retries permitted until 2026-07-01 16:40:00.916817824 +0000 UTC m=+84.391885850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-2gnx5" (UID: "efe94e17-5431-4014-b952-46dfd31caa19") : secret "openshift-state-metrics-tls" not found Jul 01 16:40:00.416885 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-wtmp\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.417019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.416980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-sys\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-root\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417027 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-textfile\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417036 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-wtmp\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-tls\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe94e17-5431-4014-b952-46dfd31caa19-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.417208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-root\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417449 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417211 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-sys\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417449 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:40:00.417270 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 16:40:00.417449 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:40:00.417322 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-tls podName:42fd24f6-705e-4070-87d3-29d7a7d9b1e5 nodeName:}" failed. No retries permitted until 2026-07-01 16:40:00.917306922 +0000 UTC m=+84.392374939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-tls") pod "node-exporter-jp8wr" (UID: "42fd24f6-705e-4070-87d3-29d7a7d9b1e5") : secret "node-exporter-tls" not found Jul 01 16:40:00.417449 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417317 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-metrics-client-ca\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417449 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417358 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-textfile\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417749 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417554 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.417866 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.417845 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe94e17-5431-4014-b952-46dfd31caa19-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.418963 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.418939 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.419319 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.419298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.438321 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.438301 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82z8h\" (UniqueName: \"kubernetes.io/projected/efe94e17-5431-4014-b952-46dfd31caa19-kube-api-access-82z8h\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.438423 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.438407 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nlmg\" (UniqueName: \"kubernetes.io/projected/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-kube-api-access-2nlmg\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.508662 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.508584 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:00.654330 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.654297 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:00.920775 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.920744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-tls\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.920952 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.920794 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:00.923114 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.923081 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42fd24f6-705e-4070-87d3-29d7a7d9b1e5-node-exporter-tls\") pod \"node-exporter-jp8wr\" (UID: \"42fd24f6-705e-4070-87d3-29d7a7d9b1e5\") " pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:00.923193 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:00.923138 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/efe94e17-5431-4014-b952-46dfd31caa19-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-2gnx5\" (UID: \"efe94e17-5431-4014-b952-46dfd31caa19\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:01.162948 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.162910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" Jul 01 16:40:01.206236 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.206211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jp8wr" Jul 01 16:40:01.225531 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:40:01.225499 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fd24f6_705e_4070_87d3_29d7a7d9b1e5.slice/crio-e42790cb7d32388829d6fdc100ccf68c55442c64cbc6ac4c0bb5999f436a4110 WatchSource:0}: Error finding container e42790cb7d32388829d6fdc100ccf68c55442c64cbc6ac4c0bb5999f436a4110: Status 404 returned error can't find the container with id e42790cb7d32388829d6fdc100ccf68c55442c64cbc6ac4c0bb5999f436a4110 Jul 01 16:40:01.300744 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.300721 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5"] Jul 01 16:40:01.302767 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:40:01.302742 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe94e17_5431_4014_b952_46dfd31caa19.slice/crio-a56355c1ca6de091dacdfd33deae2e4189ebe6847678382171e01053f84d7e69 WatchSource:0}: Error finding container a56355c1ca6de091dacdfd33deae2e4189ebe6847678382171e01053f84d7e69: Status 404 returned error can't find the container with id a56355c1ca6de091dacdfd33deae2e4189ebe6847678382171e01053f84d7e69 Jul 01 16:40:01.412573 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.412552 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:40:01.414992 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.414975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.420697 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.420675 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 16:40:01.420956 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.420942 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dwmq6\"" Jul 01 16:40:01.421753 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.421739 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 16:40:01.422251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.422103 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 16:40:01.422251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.422113 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 16:40:01.422251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.422147 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 16:40:01.422251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.422179 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 16:40:01.422251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.422198 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 16:40:01.422251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.422116 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 16:40:01.422637 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.422310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 16:40:01.424656 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424757 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnsrv\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-kube-api-access-dnsrv\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424757 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-out\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424757 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424908 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424908 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424908 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424908 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.424908 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.425100 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424903 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.425100 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.425100 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.424980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.425100 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.425008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-web-config\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.435559 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.435528 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:40:01.525589 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525589 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-web-config\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnsrv\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-kube-api-access-dnsrv\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-out\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.525807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.526128 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.526128 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.526128 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.526128 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.525874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.526128 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.526100 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.527240 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:40:01.527063 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle podName:db6821d7-d72a-45f6-8b05-f72709f7a3ad nodeName:}" failed. No retries permitted until 2026-07-01 16:40:02.027042063 +0000 UTC m=+85.502110089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad") : configmap references non-existent config key: ca-bundle.crt Jul 01 16:40:01.528265 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.528210 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.528846 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.528820 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.529000 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.528984 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.529840 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.529821 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.530014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.529832 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.530186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.530166 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-out\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.530280 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.530260 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-web-config\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.530345 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.530303 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.530754 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.530731 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.531561 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.531541 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.540409 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.540382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnsrv\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-kube-api-access-dnsrv\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:01.615652 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.615612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp8wr" event={"ID":"42fd24f6-705e-4070-87d3-29d7a7d9b1e5","Type":"ContainerStarted","Data":"e42790cb7d32388829d6fdc100ccf68c55442c64cbc6ac4c0bb5999f436a4110"} Jul 01 16:40:01.617442 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.617417 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" event={"ID":"efe94e17-5431-4014-b952-46dfd31caa19","Type":"ContainerStarted","Data":"d72461f8f46f4e4bd7b4b6960792a5dc48bb0c012cb5fae423f4c0d0bba13585"} Jul 01 16:40:01.617587 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.617483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" event={"ID":"efe94e17-5431-4014-b952-46dfd31caa19","Type":"ContainerStarted","Data":"8755314365a3f947a04f10f3a56e6d39bb9f0aaa555deec2d727a93807f3c3df"} Jul 01 16:40:01.617587 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.617511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" event={"ID":"efe94e17-5431-4014-b952-46dfd31caa19","Type":"ContainerStarted","Data":"a56355c1ca6de091dacdfd33deae2e4189ebe6847678382171e01053f84d7e69"} Jul 01 16:40:01.813152 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.813067 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:01.905737 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:01.905707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:02.029905 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:02.029873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:02.030667 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:02.030631 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:02.037917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:02.037898 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:40:02.199626 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:02.199588 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:40:02.200857 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:40:02.200828 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6821d7_d72a_45f6_8b05_f72709f7a3ad.slice/crio-e7b75b76461870ce422b465d89e07f6c5736952bb8ab6c92f2c2054ea6043073 WatchSource:0}: Error finding container e7b75b76461870ce422b465d89e07f6c5736952bb8ab6c92f2c2054ea6043073: Status 404 returned error can't find the container with id e7b75b76461870ce422b465d89e07f6c5736952bb8ab6c92f2c2054ea6043073 Jul 01 16:40:02.627732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:02.627694 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerStarted","Data":"e7b75b76461870ce422b465d89e07f6c5736952bb8ab6c92f2c2054ea6043073"} Jul 01 16:40:03.300227 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.300143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:03.365712 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.365685 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb"] Jul 01 16:40:03.369294 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.369278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.372227 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.372196 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 16:40:03.372349 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.372233 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f2j2p\"" Jul 01 16:40:03.372349 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.372299 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fmkjeklp4107t\"" Jul 01 16:40:03.372564 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.372550 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 16:40:03.372602 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.372582 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 16:40:03.373440 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.373426 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 16:40:03.373508 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.373447 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 16:40:03.384757 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.384736 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb"] Jul 01 16:40:03.444118 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxt52\" (UniqueName: \"kubernetes.io/projected/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-kube-api-access-zxt52\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.444230 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.444230 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.444230 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.444325 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-grpc-tls\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.444362 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-metrics-client-ca\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.444392 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-tls\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.444424 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.444406 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.504674 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.504643 2575 patch_prober.go:28] interesting pod/image-registry-cd758cbf9-hhr8h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 16:40:03.504796 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.504687 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" podUID="b1b95ead-65f6-4561-97fa-d74b717fc2ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:40:03.544719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.544696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.544791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.544724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.544791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.544746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.544942 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.544924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-grpc-tls\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.545028 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.544977 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-metrics-client-ca\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.545076 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.545024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-tls\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.545110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.545088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.545163 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.545147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxt52\" (UniqueName: \"kubernetes.io/projected/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-kube-api-access-zxt52\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.545868 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.545820 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-metrics-client-ca\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.547537 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.547505 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-tls\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.547623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.547600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.547869 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.547852 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.547906 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.547880 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.547985 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.547968 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-grpc-tls\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.548019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.547988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.556056 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.555996 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxt52\" (UniqueName: \"kubernetes.io/projected/9c5c0831-5dbe-4d9c-871d-89aefcfc60a0-kube-api-access-zxt52\") pod \"thanos-querier-5f7cd46bf4-j47nb\" (UID: \"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0\") " pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.635230 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.635195 2575 generic.go:356] "Generic (PLEG): container finished" podID="42fd24f6-705e-4070-87d3-29d7a7d9b1e5" containerID="04bbbaf0b21677b2535309cdae47899c8d0e88de123cda8bedcd5f2bbd7c0647" exitCode=0 Jul 01 16:40:03.635361 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.635276 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp8wr" event={"ID":"42fd24f6-705e-4070-87d3-29d7a7d9b1e5","Type":"ContainerDied","Data":"04bbbaf0b21677b2535309cdae47899c8d0e88de123cda8bedcd5f2bbd7c0647"} Jul 01 16:40:03.637516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.637494 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" event={"ID":"efe94e17-5431-4014-b952-46dfd31caa19","Type":"ContainerStarted","Data":"8dcca9bca5fe0491875a650093076ec44d70a73fdb6ab63f27b1ec20687a9767"} Jul 01 16:40:03.678259 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.678240 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:03.682308 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.682269 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-2gnx5" podStartSLOduration=2.141053778 podStartE2EDuration="3.682254095s" totalImagesPullingTime="1.541200317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:03.680361404 +0000 UTC m=+87.155429438" watchObservedRunningTime="2026-07-01 16:40:03.682254095 +0000 UTC m=+87.157322124" Jul 01 16:40:03.839936 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:03.839910 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb"] Jul 01 16:40:03.842112 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:40:03.842079 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5c0831_5dbe_4d9c_871d_89aefcfc60a0.slice/crio-80f5dcdde19d96d91adbdc5a5d44b8ece25f8fda510ef7c8e9323980507e0da0 WatchSource:0}: Error finding container 80f5dcdde19d96d91adbdc5a5d44b8ece25f8fda510ef7c8e9323980507e0da0: Status 404 returned error can't find the container with id 80f5dcdde19d96d91adbdc5a5d44b8ece25f8fda510ef7c8e9323980507e0da0 Jul 01 16:40:04.457789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.457758 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:04.521879 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.521845 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:04.648623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.648584 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp8wr" event={"ID":"42fd24f6-705e-4070-87d3-29d7a7d9b1e5","Type":"ContainerStarted","Data":"c2cba19e2fb46589d09c7b092d6eb40f12372ba889abff293cb9e81ccd3cc192"} Jul 01 16:40:04.648775 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.648672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp8wr" event={"ID":"42fd24f6-705e-4070-87d3-29d7a7d9b1e5","Type":"ContainerStarted","Data":"7b76b47cc243b222da13219aeb1f87da6937c964f706c697e5e97c46dae5f95d"} Jul 01 16:40:04.649763 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.649736 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" event={"ID":"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0","Type":"ContainerStarted","Data":"80f5dcdde19d96d91adbdc5a5d44b8ece25f8fda510ef7c8e9323980507e0da0"} Jul 01 16:40:04.651073 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.651049 2575 generic.go:356] "Generic (PLEG): container finished" podID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerID="92a9d000d5d0d19be6341c918441d69cd1c179a1e6cc0a9c93ad36c06a9f597e" exitCode=0 Jul 01 16:40:04.651157 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.651125 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"92a9d000d5d0d19be6341c918441d69cd1c179a1e6cc0a9c93ad36c06a9f597e"} Jul 01 16:40:04.676933 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.676886 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jp8wr" podStartSLOduration=3.222513916 podStartE2EDuration="4.676874482s" totalImagesPullingTime="1.385250421s" totalInitContainerRuntime="69.110145ms" isStatefulPod=true podCreationTimestamp="2026-07-01 16:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:04.675695493 +0000 UTC m=+88.150763537" watchObservedRunningTime="2026-07-01 16:40:04.676874482 +0000 UTC m=+88.151942515" Jul 01 16:40:04.945975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.945902 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7"] Jul 01 16:40:04.949234 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.949219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:04.951850 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.951833 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 16:40:04.951903 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.951836 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cqlfj\"" Jul 01 16:40:04.957643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:04.957623 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7"] Jul 01 16:40:05.057779 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.057748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1572a7d0-4d57-4199-97e3-c2fdccae72b0-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-dj2h7\" (UID: \"1572a7d0-4d57-4199-97e3-c2fdccae72b0\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:05.057901 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.057788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7s7c\" (UniqueName: \"kubernetes.io/projected/1572a7d0-4d57-4199-97e3-c2fdccae72b0-kube-api-access-d7s7c\") pod \"monitoring-plugin-cd8656b8-dj2h7\" (UID: \"1572a7d0-4d57-4199-97e3-c2fdccae72b0\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:05.158204 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.158173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1572a7d0-4d57-4199-97e3-c2fdccae72b0-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-dj2h7\" (UID: \"1572a7d0-4d57-4199-97e3-c2fdccae72b0\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:05.158348 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.158219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7s7c\" (UniqueName: \"kubernetes.io/projected/1572a7d0-4d57-4199-97e3-c2fdccae72b0-kube-api-access-d7s7c\") pod \"monitoring-plugin-cd8656b8-dj2h7\" (UID: \"1572a7d0-4d57-4199-97e3-c2fdccae72b0\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:05.160604 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.160575 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1572a7d0-4d57-4199-97e3-c2fdccae72b0-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-dj2h7\" (UID: \"1572a7d0-4d57-4199-97e3-c2fdccae72b0\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:05.168791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.168767 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7s7c\" (UniqueName: \"kubernetes.io/projected/1572a7d0-4d57-4199-97e3-c2fdccae72b0-kube-api-access-d7s7c\") pod \"monitoring-plugin-cd8656b8-dj2h7\" (UID: \"1572a7d0-4d57-4199-97e3-c2fdccae72b0\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:05.245487 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.245394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:05.259423 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.259394 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:05.305816 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.305783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:05.386178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.386150 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7"] Jul 01 16:40:05.388595 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:40:05.388570 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1572a7d0_4d57_4199_97e3_c2fdccae72b0.slice/crio-67b554e33a494bb94254b2a69be190809b485df90ffa25111a864886f560fc56 WatchSource:0}: Error finding container 67b554e33a494bb94254b2a69be190809b485df90ffa25111a864886f560fc56: Status 404 returned error can't find the container with id 67b554e33a494bb94254b2a69be190809b485df90ffa25111a864886f560fc56 Jul 01 16:40:05.533243 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.533165 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:40:05.657276 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.657244 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" event={"ID":"1572a7d0-4d57-4199-97e3-c2fdccae72b0","Type":"ContainerStarted","Data":"67b554e33a494bb94254b2a69be190809b485df90ffa25111a864886f560fc56"} Jul 01 16:40:05.879710 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.879672 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:05.954105 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.954072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:05.991886 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:05.991854 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cd758cbf9-hhr8h"] Jul 01 16:40:06.079992 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:06.079954 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:06.143573 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:06.143501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:06.302799 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:06.302748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:06.507903 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:06.507804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:06.631404 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:06.631365 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:07.668592 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:07.668509 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" event={"ID":"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0","Type":"ContainerStarted","Data":"4f80898a95c220b2c096e8d8e010a6d2370d11c0ec519027115b684484bd3e70"} Jul 01 16:40:07.668945 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:07.668610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" event={"ID":"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0","Type":"ContainerStarted","Data":"0dea854d3a4a57f383b9cc78a9bfce274989bff4c0fec4f362287bdf8f50bfe0"} Jul 01 16:40:07.672077 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:07.671995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerStarted","Data":"db05d327524e6494dd8ccd81e6cfb9243e7b4daf371bb2969fd997bac83ccdc4"} Jul 01 16:40:07.672077 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:07.672042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerStarted","Data":"3544859ac03450160a358f9ca846480160039981fe68ef3ec8f8e3913b03e6a3"} Jul 01 16:40:08.580702 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.580650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:08.678846 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.678807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" event={"ID":"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0","Type":"ContainerStarted","Data":"65bd17ea86dafc1c0aad0f2ad9bc33fe3f01dc8bf0e2cdd31ab0ba4575e332ad"} Jul 01 16:40:08.680330 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.680303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" event={"ID":"1572a7d0-4d57-4199-97e3-c2fdccae72b0","Type":"ContainerStarted","Data":"1af5d0093b00d1ece116f0e29cb3ee91dc146097e372e30617996a91c4175e48"} Jul 01 16:40:08.680484 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.680356 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:08.683532 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.683511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerStarted","Data":"f1bc1b39336bf3e1e51bedcc47753d7f1162d180591a52e3992b6e6201ce6052"} Jul 01 16:40:08.683622 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.683562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerStarted","Data":"7574cb5b6b5e65c0e227eb31be15a35428f03dba7ce1fd03e379a49bcbb6715f"} Jul 01 16:40:08.683622 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.683588 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerStarted","Data":"26144d174334ff4e40a617730d4452fe1b454b18a6c6d0d523846857e35b27f0"} Jul 01 16:40:08.686227 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.686206 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" Jul 01 16:40:08.707936 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.707888 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-dj2h7" podStartSLOduration=1.757935991 podStartE2EDuration="4.707872477s" totalImagesPullingTime="2.949936486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:08.707080433 +0000 UTC m=+92.182148492" watchObservedRunningTime="2026-07-01 16:40:08.707872477 +0000 UTC m=+92.182940513" Jul 01 16:40:08.769422 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.769388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:08.862166 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:08.862138 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:09.535120 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.535092 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-545645c948-qqbg4"] Jul 01 16:40:09.538285 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.538271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.543431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.543196 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 16:40:09.545784 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.544015 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 16:40:09.545784 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.544053 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 16:40:09.545784 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.544243 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 16:40:09.545784 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.544944 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wbnj6\"" Jul 01 16:40:09.546142 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.546112 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 16:40:09.546333 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.546197 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 16:40:09.548098 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.546964 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 16:40:09.552049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.552030 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 16:40:09.555998 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.555979 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545645c948-qqbg4"] Jul 01 16:40:09.597713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.597688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-config\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.597810 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.597720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-service-ca\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.597810 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.597743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-serving-cert\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.597810 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.597770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7dnk\" (UniqueName: \"kubernetes.io/projected/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-kube-api-access-g7dnk\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.597909 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.597872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-oauth-serving-cert\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.597909 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.597900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-trusted-ca-bundle\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.597967 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.597920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-oauth-config\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.691339 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.691309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerStarted","Data":"baa7c6f520d4037b60c83d5848c795cd468b8d397830bc186f754618d58900a1"} Jul 01 16:40:09.694314 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.694291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" event={"ID":"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0","Type":"ContainerStarted","Data":"1233a3a44f3100f75dd00b89b869afa3fe79e05d39e3472bc5d1a0c8a570d589"} Jul 01 16:40:09.694395 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.694353 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" event={"ID":"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0","Type":"ContainerStarted","Data":"645fdd2f1b2d8bf878c3544a022d75711d81f8ec520efaf243cee15eb85b213c"} Jul 01 16:40:09.694395 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.694381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" event={"ID":"9c5c0831-5dbe-4d9c-871d-89aefcfc60a0","Type":"ContainerStarted","Data":"e9562c297427698a1760c122cbbc193955d6d6505be4a2af8bd037dfbd2a4dae"} Jul 01 16:40:09.698833 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.698814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-service-ca\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.698932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.698847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-serving-cert\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.698932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.698868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7dnk\" (UniqueName: \"kubernetes.io/projected/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-kube-api-access-g7dnk\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.698932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.698909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-oauth-serving-cert\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.698932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.698924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-trusted-ca-bundle\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.699101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.699068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-oauth-config\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.699157 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.699134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-config\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.699512 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.699491 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-service-ca\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.699611 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.699598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-oauth-serving-cert\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.699984 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.699966 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-trusted-ca-bundle\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.700191 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.700170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-config\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.701566 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.701547 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-oauth-config\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.701647 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.701553 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-serving-cert\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.711559 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.711536 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7dnk\" (UniqueName: \"kubernetes.io/projected/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-kube-api-access-g7dnk\") pod \"console-545645c948-qqbg4\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:09.732033 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.731997 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.66653733 podStartE2EDuration="8.73198466s" totalImagesPullingTime="6.050362441s" totalInitContainerRuntime="15.084889ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:40:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:09.73037395 +0000 UTC m=+93.205441983" watchObservedRunningTime="2026-07-01 16:40:09.73198466 +0000 UTC m=+93.207052693" Jul 01 16:40:09.761165 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.761110 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" podStartSLOduration=1.901041512 podStartE2EDuration="6.761093597s" totalImagesPullingTime="4.860052085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:40:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:09.759733627 +0000 UTC m=+93.234801679" watchObservedRunningTime="2026-07-01 16:40:09.761093597 +0000 UTC m=+93.236161630" Jul 01 16:40:09.850670 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:09.850583 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:10.031178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:10.030831 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545645c948-qqbg4"] Jul 01 16:40:10.033626 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:40:10.033599 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6636061_eb41_4f61_b7e9_fdf50d0ac0a7.slice/crio-498652dd4c56452ac9fc983444485997596e11b77a7809441588982f55a49e2d WatchSource:0}: Error finding container 498652dd4c56452ac9fc983444485997596e11b77a7809441588982f55a49e2d: Status 404 returned error can't find the container with id 498652dd4c56452ac9fc983444485997596e11b77a7809441588982f55a49e2d Jul 01 16:40:10.699576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:10.699538 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545645c948-qqbg4" event={"ID":"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7","Type":"ContainerStarted","Data":"498652dd4c56452ac9fc983444485997596e11b77a7809441588982f55a49e2d"} Jul 01 16:40:10.700307 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:10.700282 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:13.195663 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:13.195630 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:13.271373 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:13.271342 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:13.714009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:13.713978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545645c948-qqbg4" event={"ID":"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7","Type":"ContainerStarted","Data":"91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0"} Jul 01 16:40:14.526064 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:14.526037 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ngrc2" Jul 01 16:40:14.566031 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:14.565979 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-545645c948-qqbg4" podStartSLOduration=2.077988711 podStartE2EDuration="5.565961314s" totalImagesPullingTime="3.487972603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:13.754815692 +0000 UTC m=+97.229883729" watchObservedRunningTime="2026-07-01 16:40:14.565961314 +0000 UTC m=+98.041029349" Jul 01 16:40:15.279338 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:15.279295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:15.365589 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:15.365558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:16.709642 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:16.709613 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f7cd46bf4-j47nb" Jul 01 16:40:17.835104 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:17.835069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:17.939621 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:17.939593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:19.636635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:19.636587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:19.738164 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:19.738135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:19.850969 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:19.850940 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:19.851193 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:19.850985 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:19.855735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:19.855718 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:20.749081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:20.749054 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:40:21.013862 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:21.013784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:21.096864 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:21.096832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:21.181932 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:21.181905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:21.285369 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:21.285294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:21.662247 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:21.662214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:22.819741 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:22.819707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:27.599029 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:27.598989 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:27.706622 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:27.706597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:31.021976 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.021934 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" podUID="b1b95ead-65f6-4561-97fa-d74b717fc2ba" containerName="registry" containerID="cri-o://9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5" gracePeriod=30 Jul 01 16:40:31.263178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.263150 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:40:31.378237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378212 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-certificates\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378358 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378250 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-installation-pull-secrets\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378358 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378271 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-bound-sa-token\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378358 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378319 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-trusted-ca\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378358 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378339 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378553 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378369 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-image-registry-private-configuration\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378553 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378406 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1b95ead-65f6-4561-97fa-d74b717fc2ba-ca-trust-extracted\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378553 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378437 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddvwg\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-kube-api-access-ddvwg\") pod \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\" (UID: \"b1b95ead-65f6-4561-97fa-d74b717fc2ba\") " Jul 01 16:40:31.378804 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378779 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:40:31.378975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.378946 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:40:31.380764 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.380737 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:40:31.380909 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.380881 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:40:31.380975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.380957 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:40:31.381112 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.381093 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-kube-api-access-ddvwg" (OuterVolumeSpecName: "kube-api-access-ddvwg") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "kube-api-access-ddvwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:40:31.381411 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.381391 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:40:31.387326 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.387300 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b95ead-65f6-4561-97fa-d74b717fc2ba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b1b95ead-65f6-4561-97fa-d74b717fc2ba" (UID: "b1b95ead-65f6-4561-97fa-d74b717fc2ba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:40:31.479668 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479639 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-certificates\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.479668 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479670 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-installation-pull-secrets\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.479791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479680 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-bound-sa-token\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.479791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479689 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1b95ead-65f6-4561-97fa-d74b717fc2ba-trusted-ca\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.479791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479697 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-registry-tls\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.479791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479706 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1b95ead-65f6-4561-97fa-d74b717fc2ba-image-registry-private-configuration\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.479791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479714 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1b95ead-65f6-4561-97fa-d74b717fc2ba-ca-trust-extracted\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.479791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.479723 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddvwg\" (UniqueName: \"kubernetes.io/projected/b1b95ead-65f6-4561-97fa-d74b717fc2ba-kube-api-access-ddvwg\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:40:31.788622 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.788542 2575 generic.go:356] "Generic (PLEG): container finished" podID="b1b95ead-65f6-4561-97fa-d74b717fc2ba" containerID="9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5" exitCode=0 Jul 01 16:40:31.788622 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.788588 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" Jul 01 16:40:31.788814 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.788617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" event={"ID":"b1b95ead-65f6-4561-97fa-d74b717fc2ba","Type":"ContainerDied","Data":"9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5"} Jul 01 16:40:31.788814 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.788667 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd758cbf9-hhr8h" event={"ID":"b1b95ead-65f6-4561-97fa-d74b717fc2ba","Type":"ContainerDied","Data":"3f9be4ca91c4617bf8e9ed491b9a23aed814ff0ae5caec3133c5c9d3d184b82d"} Jul 01 16:40:31.788814 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.788687 2575 scope.go:117] "RemoveContainer" containerID="9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5" Jul 01 16:40:31.797259 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.797242 2575 scope.go:117] "RemoveContainer" containerID="9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5" Jul 01 16:40:31.797543 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:40:31.797519 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5\": container with ID starting with 9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5 not found: ID does not exist" containerID="9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5" Jul 01 16:40:31.797615 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.797554 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5"} err="failed to get container status \"9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5\": rpc error: code = NotFound desc = could not find container \"9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5\": container with ID starting with 9a54ddd150e8dcf61305d81539e088b7bc49d3b52d7ffd089a06e72e64c89fc5 not found: ID does not exist" Jul 01 16:40:31.815585 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.815565 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cd758cbf9-hhr8h"] Jul 01 16:40:31.820714 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:31.820694 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cd758cbf9-hhr8h"] Jul 01 16:40:33.170447 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:33.170415 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b95ead-65f6-4561-97fa-d74b717fc2ba" path="/var/lib/kubelet/pods/b1b95ead-65f6-4561-97fa-d74b717fc2ba/volumes" Jul 01 16:40:40.705102 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:40.705068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:42.610503 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:42.610475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:42.686351 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:42.686328 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:42.842986 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:42.842961 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7f59688-84f5-4e0e-93a5-df9a3353ced0" containerID="8c88cee519b2b02c5de4b002830c442d6796a37e9b41a23a8644666c14a92008" exitCode=0 Jul 01 16:40:42.843121 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:42.843037 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-q97x2" event={"ID":"d7f59688-84f5-4e0e-93a5-df9a3353ced0","Type":"ContainerDied","Data":"8c88cee519b2b02c5de4b002830c442d6796a37e9b41a23a8644666c14a92008"} Jul 01 16:40:42.843358 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:42.843345 2575 scope.go:117] "RemoveContainer" containerID="8c88cee519b2b02c5de4b002830c442d6796a37e9b41a23a8644666c14a92008" Jul 01 16:40:43.848862 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:43.848823 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-q97x2" event={"ID":"d7f59688-84f5-4e0e-93a5-df9a3353ced0","Type":"ContainerStarted","Data":"c0b2d91a71ee86d96233e3f655cb09145b2ccf16a0ba4fd1282a6a8bec3b890c"} Jul 01 16:40:47.866887 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:47.866850 2575 generic.go:356] "Generic (PLEG): container finished" podID="6e397899-feda-4353-bf08-af42ffa8814d" containerID="c8bfde2f54e6634ed8959e7ebf000e6b5cd8aa31d5bac5a7d32df40f7721cc75" exitCode=0 Jul 01 16:40:47.867334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:47.866924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" event={"ID":"6e397899-feda-4353-bf08-af42ffa8814d","Type":"ContainerDied","Data":"c8bfde2f54e6634ed8959e7ebf000e6b5cd8aa31d5bac5a7d32df40f7721cc75"} Jul 01 16:40:47.867334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:47.867265 2575 scope.go:117] "RemoveContainer" containerID="c8bfde2f54e6634ed8959e7ebf000e6b5cd8aa31d5bac5a7d32df40f7721cc75" Jul 01 16:40:48.872582 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:48.872550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-w56hk" event={"ID":"6e397899-feda-4353-bf08-af42ffa8814d","Type":"ContainerStarted","Data":"cea5830554418404bbb5b24be203c6453ebac74022c98e21971c75856a03f7a9"} Jul 01 16:40:52.890308 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:52.890273 2575 generic.go:356] "Generic (PLEG): container finished" podID="c5229590-685f-4e84-a11c-cab27a0f4728" containerID="a60361e9409b985cd97fbc748bd2d487446c1963023cb4ccfc1ddce2beff7fd0" exitCode=0 Jul 01 16:40:52.890685 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:52.890345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" event={"ID":"c5229590-685f-4e84-a11c-cab27a0f4728","Type":"ContainerDied","Data":"a60361e9409b985cd97fbc748bd2d487446c1963023cb4ccfc1ddce2beff7fd0"} Jul 01 16:40:52.890685 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:52.890666 2575 scope.go:117] "RemoveContainer" containerID="a60361e9409b985cd97fbc748bd2d487446c1963023cb4ccfc1ddce2beff7fd0" Jul 01 16:40:53.895834 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:40:53.895803 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vg9pz" event={"ID":"c5229590-685f-4e84-a11c-cab27a0f4728","Type":"ContainerStarted","Data":"a1f133261e3d87fb82a3d57dbb96349ef75e6fb99467c82ba3de453c1fa16531"} Jul 01 16:41:19.840126 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:19.840092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:20.061089 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.061055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:20.863636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.863598 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:41:20.864080 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.863971 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="alertmanager" containerID="cri-o://3544859ac03450160a358f9ca846480160039981fe68ef3ec8f8e3913b03e6a3" gracePeriod=120 Jul 01 16:41:20.864080 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.864009 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-metric" containerID="cri-o://f1bc1b39336bf3e1e51bedcc47753d7f1162d180591a52e3992b6e6201ce6052" gracePeriod=120 Jul 01 16:41:20.864080 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.864048 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-web" containerID="cri-o://26144d174334ff4e40a617730d4452fe1b454b18a6c6d0d523846857e35b27f0" gracePeriod=120 Jul 01 16:41:20.864237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.864084 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy" containerID="cri-o://7574cb5b6b5e65c0e227eb31be15a35428f03dba7ce1fd03e379a49bcbb6715f" gracePeriod=120 Jul 01 16:41:20.864237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.864058 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="config-reloader" containerID="cri-o://db05d327524e6494dd8ccd81e6cfb9243e7b4daf371bb2969fd997bac83ccdc4" gracePeriod=120 Jul 01 16:41:20.864237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:20.864095 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="prom-label-proxy" containerID="cri-o://baa7c6f520d4037b60c83d5848c795cd468b8d397830bc186f754618d58900a1" gracePeriod=120 Jul 01 16:41:21.008554 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008529 2575 generic.go:356] "Generic (PLEG): container finished" podID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerID="baa7c6f520d4037b60c83d5848c795cd468b8d397830bc186f754618d58900a1" exitCode=0 Jul 01 16:41:21.008554 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008552 2575 generic.go:356] "Generic (PLEG): container finished" podID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerID="7574cb5b6b5e65c0e227eb31be15a35428f03dba7ce1fd03e379a49bcbb6715f" exitCode=0 Jul 01 16:41:21.008735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008559 2575 generic.go:356] "Generic (PLEG): container finished" podID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerID="db05d327524e6494dd8ccd81e6cfb9243e7b4daf371bb2969fd997bac83ccdc4" exitCode=0 Jul 01 16:41:21.008735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008566 2575 generic.go:356] "Generic (PLEG): container finished" podID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerID="3544859ac03450160a358f9ca846480160039981fe68ef3ec8f8e3913b03e6a3" exitCode=0 Jul 01 16:41:21.008735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008600 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"baa7c6f520d4037b60c83d5848c795cd468b8d397830bc186f754618d58900a1"} Jul 01 16:41:21.008735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"7574cb5b6b5e65c0e227eb31be15a35428f03dba7ce1fd03e379a49bcbb6715f"} Jul 01 16:41:21.008735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"db05d327524e6494dd8ccd81e6cfb9243e7b4daf371bb2969fd997bac83ccdc4"} Jul 01 16:41:21.008735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:21.008723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"3544859ac03450160a358f9ca846480160039981fe68ef3ec8f8e3913b03e6a3"} Jul 01 16:41:22.017062 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.017032 2575 generic.go:356] "Generic (PLEG): container finished" podID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerID="f1bc1b39336bf3e1e51bedcc47753d7f1162d180591a52e3992b6e6201ce6052" exitCode=0 Jul 01 16:41:22.017062 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.017056 2575 generic.go:356] "Generic (PLEG): container finished" podID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerID="26144d174334ff4e40a617730d4452fe1b454b18a6c6d0d523846857e35b27f0" exitCode=0 Jul 01 16:41:22.017473 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.017076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"f1bc1b39336bf3e1e51bedcc47753d7f1162d180591a52e3992b6e6201ce6052"} Jul 01 16:41:22.017473 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.017162 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"26144d174334ff4e40a617730d4452fe1b454b18a6c6d0d523846857e35b27f0"} Jul 01 16:41:22.108356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.108331 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:22.170661 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170601 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-volume\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.170661 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170635 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnsrv\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-kube-api-access-dnsrv\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.170661 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170656 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-main-db\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.170911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170765 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.170911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170801 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-main-tls\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.170911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170826 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-web-config\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.170911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170873 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-metrics-client-ca\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.170911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170907 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-out\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.171212 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170934 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.171212 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170956 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:41:22.171212 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.170972 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-cluster-tls-config\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.171212 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.171000 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-tls-assets\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.171212 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.171041 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.171212 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.171081 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\" (UID: \"db6821d7-d72a-45f6-8b05-f72709f7a3ad\") " Jul 01 16:41:22.171536 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.171308 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:41:22.171536 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.171312 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-main-db\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.173530 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.173499 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:41:22.174218 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.174172 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:41:22.174218 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.174191 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-kube-api-access-dnsrv" (OuterVolumeSpecName: "kube-api-access-dnsrv") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "kube-api-access-dnsrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:41:22.174381 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.174340 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:41:22.175380 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.175345 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:41:22.175623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.175598 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-volume" (OuterVolumeSpecName: "config-volume") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:41:22.175950 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.175929 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-out" (OuterVolumeSpecName: "config-out") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:41:22.176325 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.176286 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:41:22.177252 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.177226 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:41:22.179183 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.179157 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:41:22.187291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.187267 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-web-config" (OuterVolumeSpecName: "web-config") pod "db6821d7-d72a-45f6-8b05-f72709f7a3ad" (UID: "db6821d7-d72a-45f6-8b05-f72709f7a3ad"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:41:22.272209 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272186 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-volume\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272209 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272207 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnsrv\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-kube-api-access-dnsrv\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272216 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272226 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-main-tls\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272236 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-web-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272244 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db6821d7-d72a-45f6-8b05-f72709f7a3ad-metrics-client-ca\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272252 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db6821d7-d72a-45f6-8b05-f72709f7a3ad-config-out\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272260 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272268 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-cluster-tls-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272276 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db6821d7-d72a-45f6-8b05-f72709f7a3ad-tls-assets\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272285 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.272332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:22.272293 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/db6821d7-d72a-45f6-8b05-f72709f7a3ad-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:41:23.024445 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.024417 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.024859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.024417 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"db6821d7-d72a-45f6-8b05-f72709f7a3ad","Type":"ContainerDied","Data":"e7b75b76461870ce422b465d89e07f6c5736952bb8ab6c92f2c2054ea6043073"} Jul 01 16:41:23.024859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.024530 2575 scope.go:117] "RemoveContainer" containerID="baa7c6f520d4037b60c83d5848c795cd468b8d397830bc186f754618d58900a1" Jul 01 16:41:23.032327 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.032305 2575 scope.go:117] "RemoveContainer" containerID="f1bc1b39336bf3e1e51bedcc47753d7f1162d180591a52e3992b6e6201ce6052" Jul 01 16:41:23.039485 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.039449 2575 scope.go:117] "RemoveContainer" containerID="7574cb5b6b5e65c0e227eb31be15a35428f03dba7ce1fd03e379a49bcbb6715f" Jul 01 16:41:23.046150 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.046131 2575 scope.go:117] "RemoveContainer" containerID="26144d174334ff4e40a617730d4452fe1b454b18a6c6d0d523846857e35b27f0" Jul 01 16:41:23.052655 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.052636 2575 scope.go:117] "RemoveContainer" containerID="db05d327524e6494dd8ccd81e6cfb9243e7b4daf371bb2969fd997bac83ccdc4" Jul 01 16:41:23.059102 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.059085 2575 scope.go:117] "RemoveContainer" containerID="3544859ac03450160a358f9ca846480160039981fe68ef3ec8f8e3913b03e6a3" Jul 01 16:41:23.064221 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.064198 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:41:23.066800 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.066775 2575 scope.go:117] "RemoveContainer" containerID="92a9d000d5d0d19be6341c918441d69cd1c179a1e6cc0a9c93ad36c06a9f597e" Jul 01 16:41:23.068159 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.068141 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:41:23.122441 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122418 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:41:23.122772 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122754 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-web" Jul 01 16:41:23.122772 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122773 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-web" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122792 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="prom-label-proxy" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122800 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="prom-label-proxy" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122815 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="init-config-reloader" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122824 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="init-config-reloader" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122844 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="config-reloader" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122853 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="config-reloader" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122870 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b95ead-65f6-4561-97fa-d74b717fc2ba" containerName="registry" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122878 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b95ead-65f6-4561-97fa-d74b717fc2ba" containerName="registry" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122887 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122896 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122909 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="alertmanager" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122916 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="alertmanager" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122924 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-metric" Jul 01 16:41:23.122968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.122932 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-metric" Jul 01 16:41:23.123643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.123023 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-metric" Jul 01 16:41:23.123643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.123035 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b95ead-65f6-4561-97fa-d74b717fc2ba" containerName="registry" Jul 01 16:41:23.123643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.123044 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="config-reloader" Jul 01 16:41:23.123643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.123052 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="prom-label-proxy" Jul 01 16:41:23.123643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.123063 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy-web" Jul 01 16:41:23.123643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.123072 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="kube-rbac-proxy" Jul 01 16:41:23.123643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.123083 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" containerName="alertmanager" Jul 01 16:41:23.128639 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.128621 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.132933 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.132915 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 16:41:23.133009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.132942 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 16:41:23.133399 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.133380 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 16:41:23.133505 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.133380 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 16:41:23.134294 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.134279 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 16:41:23.134405 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.134379 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 16:41:23.134496 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.134476 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 16:41:23.135401 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.134980 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dwmq6\"" Jul 01 16:41:23.152841 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.152818 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 16:41:23.159339 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.157011 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:41:23.162776 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.162744 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 16:41:23.170728 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.170671 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6821d7-d72a-45f6-8b05-f72709f7a3ad" path="/var/lib/kubelet/pods/db6821d7-d72a-45f6-8b05-f72709f7a3ad/volumes" Jul 01 16:41:23.179992 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.179972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-config-out\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180271 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-web-config\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180271 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180199 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180271 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180271 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180420 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.180420 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.180321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmn7j\" (UniqueName: \"kubernetes.io/projected/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-kube-api-access-lmn7j\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.280732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.280732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.280917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.280917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmn7j\" (UniqueName: \"kubernetes.io/projected/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-kube-api-access-lmn7j\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.280917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.280917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281106 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-config-out\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281106 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281106 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.280972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281359 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.281334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281451 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.281412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281542 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.281493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-web-config\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281542 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.281529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.281789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.281765 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.282305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.282284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.282739 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.282713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.283811 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.283769 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.284021 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.283969 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.284099 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.284031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-config-out\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.284312 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.284291 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.284522 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.284498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.284928 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.284904 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.285361 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.285336 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.285474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.285411 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.285534 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.285479 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-web-config\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.292347 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.292327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmn7j\" (UniqueName: \"kubernetes.io/projected/c2214cb0-d6fb-4204-9ccf-5bf75a59a20e-kube-api-access-lmn7j\") pod \"alertmanager-main-0\" (UID: \"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.438702 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.438648 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:41:23.581790 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:23.581763 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:41:23.582120 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:41:23.582097 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2214cb0_d6fb_4204_9ccf_5bf75a59a20e.slice/crio-fd04e9b7f9b8be57a007a80de34883282142ce0238ba5b19eccb243a4385f297 WatchSource:0}: Error finding container fd04e9b7f9b8be57a007a80de34883282142ce0238ba5b19eccb243a4385f297: Status 404 returned error can't find the container with id fd04e9b7f9b8be57a007a80de34883282142ce0238ba5b19eccb243a4385f297 Jul 01 16:41:24.030178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.030142 2575 generic.go:356] "Generic (PLEG): container finished" podID="c2214cb0-d6fb-4204-9ccf-5bf75a59a20e" containerID="85a89154de340f6bc8bba718cbcf998df596866bdf61daa29340460c0b8503be" exitCode=0 Jul 01 16:41:24.030538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.030228 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerDied","Data":"85a89154de340f6bc8bba718cbcf998df596866bdf61daa29340460c0b8503be"} Jul 01 16:41:24.030538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.030300 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerStarted","Data":"fd04e9b7f9b8be57a007a80de34883282142ce0238ba5b19eccb243a4385f297"} Jul 01 16:41:24.982499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.982469 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7db564d566-259nf"] Jul 01 16:41:24.985990 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.985974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:24.990152 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.990131 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 16:41:24.990400 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.990380 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 16:41:24.990476 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.990402 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nlsmk\"" Jul 01 16:41:24.990476 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.990417 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 16:41:24.990476 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.990406 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 16:41:24.991286 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:24.991272 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 16:41:25.000039 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.000019 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 16:41:25.012103 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.012085 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7db564d566-259nf"] Jul 01 16:41:25.041019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.040997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerStarted","Data":"77498fa8fc6f782bc60fff7c7a726ed1cc9c4c8457f3e9351e8fbe2dff6a2a87"} Jul 01 16:41:25.041356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.041061 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerStarted","Data":"33dcd9ba0146207fe72f63d15e7ff36477f5611041007a5c69a1657a06a77e90"} Jul 01 16:41:25.041356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.041107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerStarted","Data":"7bcd6230d603a4f413d32162ae677e14260cc50fbd274ef7007780fd84d9f41b"} Jul 01 16:41:25.041356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.041152 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerStarted","Data":"51c61f596ef1f6f52fadc48dbce84766978e1f6f15d7175739d613c70129d8a7"} Jul 01 16:41:25.041356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.041191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerStarted","Data":"31d7dec0c1d411be50a992a31b48895a3f3484ab5c491f5d035d0e8b1008506e"} Jul 01 16:41:25.041356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.041231 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2214cb0-d6fb-4204-9ccf-5bf75a59a20e","Type":"ContainerStarted","Data":"fbba6476bedbfa91eec179da42dd819c8469bae69d74cbea84ab69bdc513e310"} Jul 01 16:41:25.088631 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.088581 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.070443166 podStartE2EDuration="2.088568035s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.124869ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:41:25.08676437 +0000 UTC m=+168.561832416" watchObservedRunningTime="2026-07-01 16:41:25.088568035 +0000 UTC m=+168.563636068" Jul 01 16:41:25.093176 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.093150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfgnz\" (UniqueName: \"kubernetes.io/projected/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-kube-api-access-kfgnz\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.093431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.093408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-serving-certs-ca-bundle\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.093757 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.093447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-secret-telemeter-client\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.093878 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.093845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-metrics-client-ca\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.093985 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.093951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-telemeter-client-tls\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.094043 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.093994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-federate-client-tls\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.099108 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.094429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.099108 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.094503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195197 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfgnz\" (UniqueName: \"kubernetes.io/projected/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-kube-api-access-kfgnz\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-serving-certs-ca-bundle\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195230 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-secret-telemeter-client\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195433 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195348 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-metrics-client-ca\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195433 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-telemeter-client-tls\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195433 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-federate-client-tls\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195619 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195499 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.195619 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.195533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.196081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.196052 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-serving-certs-ca-bundle\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.196211 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.196161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-metrics-client-ca\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.196443 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.196424 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.198169 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.198139 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.198308 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.198286 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-secret-telemeter-client\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.198362 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.198296 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-federate-client-tls\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.198362 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.198345 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-telemeter-client-tls\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.207655 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.207634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfgnz\" (UniqueName: \"kubernetes.io/projected/f14e2d1b-0d4d-4b42-a02d-d5875ff8b691-kube-api-access-kfgnz\") pod \"telemeter-client-7db564d566-259nf\" (UID: \"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691\") " pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.295863 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.295810 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7db564d566-259nf" Jul 01 16:41:25.458536 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:25.458511 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7db564d566-259nf"] Jul 01 16:41:25.460713 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:41:25.460682 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14e2d1b_0d4d_4b42_a02d_d5875ff8b691.slice/crio-8dfae2c90698b600ae64f7f7e1babd59ded4933dddfdf5f371dee6c2d14dcd8c WatchSource:0}: Error finding container 8dfae2c90698b600ae64f7f7e1babd59ded4933dddfdf5f371dee6c2d14dcd8c: Status 404 returned error can't find the container with id 8dfae2c90698b600ae64f7f7e1babd59ded4933dddfdf5f371dee6c2d14dcd8c Jul 01 16:41:26.046699 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:26.046665 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7db564d566-259nf" event={"ID":"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691","Type":"ContainerStarted","Data":"8dfae2c90698b600ae64f7f7e1babd59ded4933dddfdf5f371dee6c2d14dcd8c"} Jul 01 16:41:30.066379 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:30.066341 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7db564d566-259nf" event={"ID":"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691","Type":"ContainerStarted","Data":"b0db9fe44527bcca154c7547e0e96c4020fa84d791b140de47ccd0fb264b7ca0"} Jul 01 16:41:30.066787 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:30.066445 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7db564d566-259nf" event={"ID":"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691","Type":"ContainerStarted","Data":"bd82ce0f60202f4aced6d08a7320069d0a0fd1b5dfb660a7a7b114b952d4ca30"} Jul 01 16:41:30.066787 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:30.066481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7db564d566-259nf" event={"ID":"f14e2d1b-0d4d-4b42-a02d-d5875ff8b691","Type":"ContainerStarted","Data":"2d919abd9029c2e48337b1fec2c53517316239ef0ef76de098f20dc2db59c489"} Jul 01 16:41:30.102926 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:30.102875 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7db564d566-259nf" podStartSLOduration=2.053996635 podStartE2EDuration="6.102858135s" totalImagesPullingTime="4.0488615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:41:30.099963378 +0000 UTC m=+173.575031411" watchObservedRunningTime="2026-07-01 16:41:30.102858135 +0000 UTC m=+173.577926168" Jul 01 16:41:30.978772 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:30.978743 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b7f884dd-2wwjl"] Jul 01 16:41:30.982299 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:30.982278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.041674 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.041646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-service-ca\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.041789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.041681 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-trusted-ca-bundle\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.041789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.041714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-oauth-serving-cert\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.041789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.041734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-serving-cert\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.041891 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.041831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-oauth-config\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.041891 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.041863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcl7l\" (UniqueName: \"kubernetes.io/projected/324756d8-0ff5-4a5d-ab75-ff61a08970e1-kube-api-access-vcl7l\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.042001 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.041885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-config\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.079792 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.079767 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b7f884dd-2wwjl"] Jul 01 16:41:31.105072 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.105049 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:31.143250 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.143223 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-oauth-config\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.143368 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.143264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcl7l\" (UniqueName: \"kubernetes.io/projected/324756d8-0ff5-4a5d-ab75-ff61a08970e1-kube-api-access-vcl7l\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.143368 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.143293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-config\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144017 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.143507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-service-ca\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144017 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.143746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-trusted-ca-bundle\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144017 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.143802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-oauth-serving-cert\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144017 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.143831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-serving-cert\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.144274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-service-ca\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144414 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.144310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-config\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144498 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.144476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-trusted-ca-bundle\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.144786 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.144762 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-oauth-serving-cert\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.146169 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.146150 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-oauth-config\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.146518 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.146504 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-serving-cert\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.163756 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.163733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcl7l\" (UniqueName: \"kubernetes.io/projected/324756d8-0ff5-4a5d-ab75-ff61a08970e1-kube-api-access-vcl7l\") pod \"console-54b7f884dd-2wwjl\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.291662 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.291582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:31.325385 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.325359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:31.410686 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.410646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:31.438079 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:31.438057 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b7f884dd-2wwjl"] Jul 01 16:41:31.439533 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:41:31.439504 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324756d8_0ff5_4a5d_ab75_ff61a08970e1.slice/crio-f99d41d98bffecfc5d7070329fe1e91765057b336d7ad814d78e1efe17779c43 WatchSource:0}: Error finding container f99d41d98bffecfc5d7070329fe1e91765057b336d7ad814d78e1efe17779c43: Status 404 returned error can't find the container with id f99d41d98bffecfc5d7070329fe1e91765057b336d7ad814d78e1efe17779c43 Jul 01 16:41:32.075750 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:32.075711 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b7f884dd-2wwjl" event={"ID":"324756d8-0ff5-4a5d-ab75-ff61a08970e1","Type":"ContainerStarted","Data":"8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8"} Jul 01 16:41:32.075928 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:32.075769 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b7f884dd-2wwjl" event={"ID":"324756d8-0ff5-4a5d-ab75-ff61a08970e1","Type":"ContainerStarted","Data":"f99d41d98bffecfc5d7070329fe1e91765057b336d7ad814d78e1efe17779c43"} Jul 01 16:41:32.185257 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:32.185231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:32.266524 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:32.266493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:41.291930 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:41.291894 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:41.292403 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:41.291957 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:41.296384 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:41.296361 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:41.332316 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:41.332273 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b7f884dd-2wwjl" podStartSLOduration=11.332259905 podStartE2EDuration="11.332259905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:41:32.124282985 +0000 UTC m=+175.599351018" watchObservedRunningTime="2026-07-01 16:41:41.332259905 +0000 UTC m=+184.807327937" Jul 01 16:41:42.123546 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:42.123513 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:41:42.238045 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:42.238005 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545645c948-qqbg4"] Jul 01 16:41:42.401092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:42.401053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:42.500613 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:42.500569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:42.576329 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:41:42.576303 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:07.259674 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.259612 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-545645c948-qqbg4" podUID="b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" containerName="console" containerID="cri-o://91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0" gracePeriod=15 Jul 01 16:42:07.513757 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.513692 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:42:07.530065 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530041 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-oauth-serving-cert\") pod \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " Jul 01 16:42:07.530180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530084 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-serving-cert\") pod \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " Jul 01 16:42:07.530180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530140 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-trusted-ca-bundle\") pod \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " Jul 01 16:42:07.530180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530172 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7dnk\" (UniqueName: \"kubernetes.io/projected/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-kube-api-access-g7dnk\") pod \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " Jul 01 16:42:07.530343 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530232 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-config\") pod \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " Jul 01 16:42:07.530343 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530277 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-service-ca\") pod \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " Jul 01 16:42:07.530478 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530354 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-oauth-config\") pod \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\" (UID: \"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7\") " Jul 01 16:42:07.530579 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530436 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" (UID: "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:42:07.530732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530714 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-oauth-serving-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:42:07.530846 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530817 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" (UID: "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:42:07.530980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530849 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-config" (OuterVolumeSpecName: "console-config") pod "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" (UID: "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:42:07.530980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.530896 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" (UID: "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:42:07.532388 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.532362 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-kube-api-access-g7dnk" (OuterVolumeSpecName: "kube-api-access-g7dnk") pod "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" (UID: "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7"). InnerVolumeSpecName "kube-api-access-g7dnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:42:07.532820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.532792 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" (UID: "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:42:07.532904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.532848 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" (UID: "b6636061-eb41-4f61-b7e9-fdf50d0ac0a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:42:07.632084 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.632055 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:42:07.632084 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.632082 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-service-ca\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:42:07.632205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.632091 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-oauth-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:42:07.632205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.632101 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-console-serving-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:42:07.632205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.632109 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-trusted-ca-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:42:07.632205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:07.632118 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7dnk\" (UniqueName: \"kubernetes.io/projected/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7-kube-api-access-g7dnk\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:42:08.226407 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.226367 2575 generic.go:356] "Generic (PLEG): container finished" podID="b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" containerID="91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0" exitCode=0 Jul 01 16:42:08.226613 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.226421 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545645c948-qqbg4" Jul 01 16:42:08.226613 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.226474 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545645c948-qqbg4" event={"ID":"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7","Type":"ContainerDied","Data":"91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0"} Jul 01 16:42:08.226613 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.226535 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545645c948-qqbg4" event={"ID":"b6636061-eb41-4f61-b7e9-fdf50d0ac0a7","Type":"ContainerDied","Data":"498652dd4c56452ac9fc983444485997596e11b77a7809441588982f55a49e2d"} Jul 01 16:42:08.226613 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.226563 2575 scope.go:117] "RemoveContainer" containerID="91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0" Jul 01 16:42:08.234991 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.234975 2575 scope.go:117] "RemoveContainer" containerID="91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0" Jul 01 16:42:08.235248 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:42:08.235229 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0\": container with ID starting with 91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0 not found: ID does not exist" containerID="91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0" Jul 01 16:42:08.235316 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.235255 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0"} err="failed to get container status \"91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0\": rpc error: code = NotFound desc = could not find container \"91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0\": container with ID starting with 91404bbcc005b4d8d1f69fd2f7ab7795a2b06c915833f067a8d518705f85c1e0 not found: ID does not exist" Jul 01 16:42:08.250489 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.250422 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545645c948-qqbg4"] Jul 01 16:42:08.256614 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:08.256591 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-545645c948-qqbg4"] Jul 01 16:42:09.170562 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:09.170529 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" path="/var/lib/kubelet/pods/b6636061-eb41-4f61-b7e9-fdf50d0ac0a7/volumes" Jul 01 16:42:14.034246 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:14.034201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:14.138391 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:14.138361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:35.054123 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:35.054086 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:35.121578 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:35.121546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:39.624309 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:39.624269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:46.903354 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:46.903322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:46.965022 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:46.964987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:54.429323 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.429292 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68b4fd98bf-dpzn8"] Jul 01 16:42:54.432092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.432067 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" containerName="console" Jul 01 16:42:54.432237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.432227 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" containerName="console" Jul 01 16:42:54.432438 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.432426 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6636061-eb41-4f61-b7e9-fdf50d0ac0a7" containerName="console" Jul 01 16:42:54.436827 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.436806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.445192 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.445170 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b4fd98bf-dpzn8"] Jul 01 16:42:54.514364 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.514337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:54.574836 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.574811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:54.591108 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.591073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-trusted-ca-bundle\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.591205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.591127 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-console-config\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.591205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.591156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-serving-cert\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.591205 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.591200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqn6\" (UniqueName: \"kubernetes.io/projected/b4304157-158f-445e-ab42-68c3e64f8a1f-kube-api-access-gxqn6\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.591360 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.591280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-service-ca\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.591360 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.591321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-oauth-config\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.591443 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.591359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-oauth-serving-cert\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.692415 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.692358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-service-ca\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.692415 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.692397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-oauth-config\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.692415 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.692421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-oauth-serving-cert\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.692635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.692609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-trusted-ca-bundle\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.692688 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.692656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-console-config\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.692747 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.692685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-serving-cert\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.692747 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.692734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqn6\" (UniqueName: \"kubernetes.io/projected/b4304157-158f-445e-ab42-68c3e64f8a1f-kube-api-access-gxqn6\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.693187 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.693158 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-service-ca\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.693270 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.693161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-oauth-serving-cert\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.693389 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.693365 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-console-config\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.693682 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.693658 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-trusted-ca-bundle\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.694987 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.694956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-serving-cert\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.695060 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.695009 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-oauth-config\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.702732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.702711 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqn6\" (UniqueName: \"kubernetes.io/projected/b4304157-158f-445e-ab42-68c3e64f8a1f-kube-api-access-gxqn6\") pod \"console-68b4fd98bf-dpzn8\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.746721 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.746703 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:42:54.877820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:54.877794 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b4fd98bf-dpzn8"] Jul 01 16:42:54.880128 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:42:54.880102 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4304157_158f_445e_ab42_68c3e64f8a1f.slice/crio-74d035756e597570ab9a2e1c9283abc5843530dc0914f1854e244be31752d71a WatchSource:0}: Error finding container 74d035756e597570ab9a2e1c9283abc5843530dc0914f1854e244be31752d71a: Status 404 returned error can't find the container with id 74d035756e597570ab9a2e1c9283abc5843530dc0914f1854e244be31752d71a Jul 01 16:42:55.415987 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:55.415957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b4fd98bf-dpzn8" event={"ID":"b4304157-158f-445e-ab42-68c3e64f8a1f","Type":"ContainerStarted","Data":"a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9"} Jul 01 16:42:55.416154 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:55.416002 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b4fd98bf-dpzn8" event={"ID":"b4304157-158f-445e-ab42-68c3e64f8a1f","Type":"ContainerStarted","Data":"74d035756e597570ab9a2e1c9283abc5843530dc0914f1854e244be31752d71a"} Jul 01 16:42:55.436930 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:55.436882 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68b4fd98bf-dpzn8" podStartSLOduration=1.436865893 podStartE2EDuration="1.436865893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:42:55.436071904 +0000 UTC m=+258.911139941" watchObservedRunningTime="2026-07-01 16:42:55.436865893 +0000 UTC m=+258.911933925" Jul 01 16:42:57.591752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:57.591714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:57.694585 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:42:57.694550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:04.747832 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:04.747756 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:43:04.747832 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:04.747809 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:43:04.752412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:04.752391 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:43:05.458203 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:05.458175 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:43:05.511193 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:05.511160 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b7f884dd-2wwjl"] Jul 01 16:43:05.614795 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:05.614763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:06.002151 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:06.002117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:06.097662 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:06.097634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:30.534357 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.534295 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54b7f884dd-2wwjl" podUID="324756d8-0ff5-4a5d-ab75-ff61a08970e1" containerName="console" containerID="cri-o://8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8" gracePeriod=15 Jul 01 16:43:30.780103 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.780079 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:43:30.860221 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860157 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-oauth-serving-cert\") pod \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " Jul 01 16:43:30.860221 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860207 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-service-ca\") pod \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " Jul 01 16:43:30.860412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860237 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-config\") pod \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " Jul 01 16:43:30.860412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860334 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcl7l\" (UniqueName: \"kubernetes.io/projected/324756d8-0ff5-4a5d-ab75-ff61a08970e1-kube-api-access-vcl7l\") pod \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " Jul 01 16:43:30.860412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860381 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-serving-cert\") pod \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " Jul 01 16:43:30.860605 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860411 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-oauth-config\") pod \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " Jul 01 16:43:30.860605 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860445 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-trusted-ca-bundle\") pod \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\" (UID: \"324756d8-0ff5-4a5d-ab75-ff61a08970e1\") " Jul 01 16:43:30.860605 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860586 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-config" (OuterVolumeSpecName: "console-config") pod "324756d8-0ff5-4a5d-ab75-ff61a08970e1" (UID: "324756d8-0ff5-4a5d-ab75-ff61a08970e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:43:30.860752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860600 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "324756d8-0ff5-4a5d-ab75-ff61a08970e1" (UID: "324756d8-0ff5-4a5d-ab75-ff61a08970e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:43:30.860752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860653 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "324756d8-0ff5-4a5d-ab75-ff61a08970e1" (UID: "324756d8-0ff5-4a5d-ab75-ff61a08970e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:43:30.860921 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860902 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-oauth-serving-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:43:30.860980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860926 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-service-ca\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:43:30.860980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860934 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "324756d8-0ff5-4a5d-ab75-ff61a08970e1" (UID: "324756d8-0ff5-4a5d-ab75-ff61a08970e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:43:30.860980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.860941 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:43:30.862447 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.862428 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "324756d8-0ff5-4a5d-ab75-ff61a08970e1" (UID: "324756d8-0ff5-4a5d-ab75-ff61a08970e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:43:30.862799 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.862778 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "324756d8-0ff5-4a5d-ab75-ff61a08970e1" (UID: "324756d8-0ff5-4a5d-ab75-ff61a08970e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:43:30.862853 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.862809 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/324756d8-0ff5-4a5d-ab75-ff61a08970e1-kube-api-access-vcl7l" (OuterVolumeSpecName: "kube-api-access-vcl7l") pod "324756d8-0ff5-4a5d-ab75-ff61a08970e1" (UID: "324756d8-0ff5-4a5d-ab75-ff61a08970e1"). InnerVolumeSpecName "kube-api-access-vcl7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:43:30.961596 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.961575 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-oauth-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:43:30.961596 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.961594 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324756d8-0ff5-4a5d-ab75-ff61a08970e1-trusted-ca-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:43:30.961730 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.961605 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcl7l\" (UniqueName: \"kubernetes.io/projected/324756d8-0ff5-4a5d-ab75-ff61a08970e1-kube-api-access-vcl7l\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:43:30.961730 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:30.961614 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/324756d8-0ff5-4a5d-ab75-ff61a08970e1-console-serving-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:43:31.560225 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.560138 2575 generic.go:356] "Generic (PLEG): container finished" podID="324756d8-0ff5-4a5d-ab75-ff61a08970e1" containerID="8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8" exitCode=0 Jul 01 16:43:31.560225 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.560185 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b7f884dd-2wwjl" Jul 01 16:43:31.560225 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.560195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b7f884dd-2wwjl" event={"ID":"324756d8-0ff5-4a5d-ab75-ff61a08970e1","Type":"ContainerDied","Data":"8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8"} Jul 01 16:43:31.560661 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.560244 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b7f884dd-2wwjl" event={"ID":"324756d8-0ff5-4a5d-ab75-ff61a08970e1","Type":"ContainerDied","Data":"f99d41d98bffecfc5d7070329fe1e91765057b336d7ad814d78e1efe17779c43"} Jul 01 16:43:31.560661 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.560270 2575 scope.go:117] "RemoveContainer" containerID="8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8" Jul 01 16:43:31.568392 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.568363 2575 scope.go:117] "RemoveContainer" containerID="8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8" Jul 01 16:43:31.568687 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:43:31.568660 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8\": container with ID starting with 8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8 not found: ID does not exist" containerID="8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8" Jul 01 16:43:31.568778 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.568691 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8"} err="failed to get container status \"8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8\": rpc error: code = NotFound desc = could not find container \"8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8\": container with ID starting with 8a5da4cda7175e19bc4133d327a1df09d4ab499f74287e0775388229bc7389a8 not found: ID does not exist" Jul 01 16:43:31.581058 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.581036 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b7f884dd-2wwjl"] Jul 01 16:43:31.586307 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:31.586286 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b7f884dd-2wwjl"] Jul 01 16:43:33.171324 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:33.171288 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="324756d8-0ff5-4a5d-ab75-ff61a08970e1" path="/var/lib/kubelet/pods/324756d8-0ff5-4a5d-ab75-ff61a08970e1/volumes" Jul 01 16:43:37.113833 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:37.113806 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:43:37.116176 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:37.116152 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:43:37.119014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:37.118991 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:43:37.121568 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:37.121548 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:43:37.124441 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:37.124423 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 16:43:48.449078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.449042 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj"] Jul 01 16:43:48.451426 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.449359 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="324756d8-0ff5-4a5d-ab75-ff61a08970e1" containerName="console" Jul 01 16:43:48.451426 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.449370 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="324756d8-0ff5-4a5d-ab75-ff61a08970e1" containerName="console" Jul 01 16:43:48.451426 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.449436 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="324756d8-0ff5-4a5d-ab75-ff61a08970e1" containerName="console" Jul 01 16:43:48.452306 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.452290 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.455214 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.455185 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:43:48.456255 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.456237 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:43:48.456352 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.456235 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ndvlp\"" Jul 01 16:43:48.461242 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.461221 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj"] Jul 01 16:43:48.618398 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.618364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.618587 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.618405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8wkp\" (UniqueName: \"kubernetes.io/projected/bb1bbd14-5707-4266-8621-2b0b9b011f74-kube-api-access-s8wkp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.618587 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.618503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.639432 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.639407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:48.719431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.719355 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.719431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.719414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.719623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.719441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8wkp\" (UniqueName: \"kubernetes.io/projected/bb1bbd14-5707-4266-8621-2b0b9b011f74-kube-api-access-s8wkp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.719764 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.719746 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.719803 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.719770 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.729210 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.729178 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8wkp\" (UniqueName: \"kubernetes.io/projected/bb1bbd14-5707-4266-8621-2b0b9b011f74-kube-api-access-s8wkp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.762150 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.762124 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:43:48.892968 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.892931 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj"] Jul 01 16:43:48.895810 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:43:48.895785 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1bbd14_5707_4266_8621_2b0b9b011f74.slice/crio-ecc6dc0033c41827945316abb9500a7e6c52146fc975473065c6ea387dc77e31 WatchSource:0}: Error finding container ecc6dc0033c41827945316abb9500a7e6c52146fc975473065c6ea387dc77e31: Status 404 returned error can't find the container with id ecc6dc0033c41827945316abb9500a7e6c52146fc975473065c6ea387dc77e31 Jul 01 16:43:48.897839 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:48.897824 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:43:49.636793 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:49.636749 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" event={"ID":"bb1bbd14-5707-4266-8621-2b0b9b011f74","Type":"ContainerStarted","Data":"ecc6dc0033c41827945316abb9500a7e6c52146fc975473065c6ea387dc77e31"} Jul 01 16:43:52.347475 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:52.347426 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:57.672062 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:57.672026 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerID="0abe6987620a6e51202aed4a1d6dcb4f21f03b705237a78fd586a2be663db071" exitCode=0 Jul 01 16:43:57.672429 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:43:57.672111 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" event={"ID":"bb1bbd14-5707-4266-8621-2b0b9b011f74","Type":"ContainerDied","Data":"0abe6987620a6e51202aed4a1d6dcb4f21f03b705237a78fd586a2be663db071"} Jul 01 16:44:00.686537 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:00.686448 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerID="b75c4289cced48d29e6e5b5610e6bd84a0d1b0cbe011548b7c7caa94ab723531" exitCode=0 Jul 01 16:44:00.686836 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:00.686530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" event={"ID":"bb1bbd14-5707-4266-8621-2b0b9b011f74","Type":"ContainerDied","Data":"b75c4289cced48d29e6e5b5610e6bd84a0d1b0cbe011548b7c7caa94ab723531"} Jul 01 16:44:10.736298 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:10.736265 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerID="9e132d18324bb7efeb7a8ba52d8230513e6eca4726c6608ae63902242be0118f" exitCode=0 Jul 01 16:44:10.736726 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:10.736353 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" event={"ID":"bb1bbd14-5707-4266-8621-2b0b9b011f74","Type":"ContainerDied","Data":"9e132d18324bb7efeb7a8ba52d8230513e6eca4726c6608ae63902242be0118f"} Jul 01 16:44:11.870625 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:11.870598 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:44:11.923646 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:11.923604 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-bundle\") pod \"bb1bbd14-5707-4266-8621-2b0b9b011f74\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " Jul 01 16:44:11.923815 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:11.923696 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-util\") pod \"bb1bbd14-5707-4266-8621-2b0b9b011f74\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " Jul 01 16:44:11.923815 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:11.923758 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8wkp\" (UniqueName: \"kubernetes.io/projected/bb1bbd14-5707-4266-8621-2b0b9b011f74-kube-api-access-s8wkp\") pod \"bb1bbd14-5707-4266-8621-2b0b9b011f74\" (UID: \"bb1bbd14-5707-4266-8621-2b0b9b011f74\") " Jul 01 16:44:11.924517 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:11.924488 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-bundle" (OuterVolumeSpecName: "bundle") pod "bb1bbd14-5707-4266-8621-2b0b9b011f74" (UID: "bb1bbd14-5707-4266-8621-2b0b9b011f74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:44:11.926045 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:11.926019 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1bbd14-5707-4266-8621-2b0b9b011f74-kube-api-access-s8wkp" (OuterVolumeSpecName: "kube-api-access-s8wkp") pod "bb1bbd14-5707-4266-8621-2b0b9b011f74" (UID: "bb1bbd14-5707-4266-8621-2b0b9b011f74"). InnerVolumeSpecName "kube-api-access-s8wkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:44:11.928480 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:11.928434 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-util" (OuterVolumeSpecName: "util") pod "bb1bbd14-5707-4266-8621-2b0b9b011f74" (UID: "bb1bbd14-5707-4266-8621-2b0b9b011f74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:44:12.024998 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:12.024918 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:12.024998 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:12.024949 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8wkp\" (UniqueName: \"kubernetes.io/projected/bb1bbd14-5707-4266-8621-2b0b9b011f74-kube-api-access-s8wkp\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:12.024998 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:12.024960 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1bbd14-5707-4266-8621-2b0b9b011f74-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:12.746924 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:12.746892 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" Jul 01 16:44:12.746924 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:12.746905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkq2sj" event={"ID":"bb1bbd14-5707-4266-8621-2b0b9b011f74","Type":"ContainerDied","Data":"ecc6dc0033c41827945316abb9500a7e6c52146fc975473065c6ea387dc77e31"} Jul 01 16:44:12.747149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:12.746946 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecc6dc0033c41827945316abb9500a7e6c52146fc975473065c6ea387dc77e31" Jul 01 16:44:14.249066 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:14.249037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:15.628637 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:15.628603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:16.209623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.209591 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x"] Jul 01 16:44:16.209959 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.209944 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerName="pull" Jul 01 16:44:16.210002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.209961 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerName="pull" Jul 01 16:44:16.210002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.209976 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerName="util" Jul 01 16:44:16.210002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.209981 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerName="util" Jul 01 16:44:16.210002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.209991 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerName="extract" Jul 01 16:44:16.210002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.209997 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerName="extract" Jul 01 16:44:16.210146 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.210053 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1bbd14-5707-4266-8621-2b0b9b011f74" containerName="extract" Jul 01 16:44:16.213352 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.213334 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.218820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.218796 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 01 16:44:16.219068 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.218971 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5mm4k\"" Jul 01 16:44:16.220030 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.219997 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:44:16.225806 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.225778 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x"] Jul 01 16:44:16.260719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.260680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2v6n\" (UniqueName: \"kubernetes.io/projected/240b1bd9-8a96-405d-b328-7119989a476a-kube-api-access-t2v6n\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gn88x\" (UID: \"240b1bd9-8a96-405d-b328-7119989a476a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.260893 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.260728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240b1bd9-8a96-405d-b328-7119989a476a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gn88x\" (UID: \"240b1bd9-8a96-405d-b328-7119989a476a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.361712 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.361668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2v6n\" (UniqueName: \"kubernetes.io/projected/240b1bd9-8a96-405d-b328-7119989a476a-kube-api-access-t2v6n\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gn88x\" (UID: \"240b1bd9-8a96-405d-b328-7119989a476a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.361923 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.361730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240b1bd9-8a96-405d-b328-7119989a476a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gn88x\" (UID: \"240b1bd9-8a96-405d-b328-7119989a476a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.362131 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.362112 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240b1bd9-8a96-405d-b328-7119989a476a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gn88x\" (UID: \"240b1bd9-8a96-405d-b328-7119989a476a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.370776 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.370751 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2v6n\" (UniqueName: \"kubernetes.io/projected/240b1bd9-8a96-405d-b328-7119989a476a-kube-api-access-t2v6n\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gn88x\" (UID: \"240b1bd9-8a96-405d-b328-7119989a476a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.523176 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.523086 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" Jul 01 16:44:16.666590 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.666563 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x"] Jul 01 16:44:16.666949 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:44:16.666591 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240b1bd9_8a96_405d_b328_7119989a476a.slice/crio-277bf6906725678c16363366c04c42ecc1b523ebbfee7a86f870e39f3c77c741 WatchSource:0}: Error finding container 277bf6906725678c16363366c04c42ecc1b523ebbfee7a86f870e39f3c77c741: Status 404 returned error can't find the container with id 277bf6906725678c16363366c04c42ecc1b523ebbfee7a86f870e39f3c77c741 Jul 01 16:44:16.770683 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:16.770649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" event={"ID":"240b1bd9-8a96-405d-b328-7119989a476a","Type":"ContainerStarted","Data":"277bf6906725678c16363366c04c42ecc1b523ebbfee7a86f870e39f3c77c741"} Jul 01 16:44:17.866987 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:17.866951 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:18.028478 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:18.028425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:22.447584 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:22.447546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:22.508922 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:22.508894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:22.853895 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:22.853805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:22.954164 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:22.954114 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:25.407688 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:25.407644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:25.502798 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:25.502765 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:25.810756 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:25.810659 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" event={"ID":"240b1bd9-8a96-405d-b328-7119989a476a","Type":"ContainerStarted","Data":"2e1fe773944c0f652c9acf1f4dfb5a0a35b6403be318ec6cc3fc81ff07ed6cb3"} Jul 01 16:44:25.834900 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:25.834844 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gn88x" podStartSLOduration=1.708755069 podStartE2EDuration="9.834829235s" totalImagesPullingTime="8.126074166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:44:25.833533968 +0000 UTC m=+349.308602000" watchObservedRunningTime="2026-07-01 16:44:25.834829235 +0000 UTC m=+349.309897267" Jul 01 16:44:26.171019 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:26.170983 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:26.267404 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:26.267375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:27.212753 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.212720 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7xktt"] Jul 01 16:44:27.216013 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.215997 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.218713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.218694 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 16:44:27.219830 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.219815 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 16:44:27.219896 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.219834 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ncq5b\"" Jul 01 16:44:27.227609 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.227586 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7xktt"] Jul 01 16:44:27.345803 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.345770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmft\" (UniqueName: \"kubernetes.io/projected/779bece8-bd98-4516-960f-273406073010-kube-api-access-rzmft\") pod \"cert-manager-webhook-7dc76cbb94-7xktt\" (UID: \"779bece8-bd98-4516-960f-273406073010\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.345969 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.345827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/779bece8-bd98-4516-960f-273406073010-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7xktt\" (UID: \"779bece8-bd98-4516-960f-273406073010\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.446914 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.446880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmft\" (UniqueName: \"kubernetes.io/projected/779bece8-bd98-4516-960f-273406073010-kube-api-access-rzmft\") pod \"cert-manager-webhook-7dc76cbb94-7xktt\" (UID: \"779bece8-bd98-4516-960f-273406073010\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.447082 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.446981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/779bece8-bd98-4516-960f-273406073010-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7xktt\" (UID: \"779bece8-bd98-4516-960f-273406073010\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.456368 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.456335 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/779bece8-bd98-4516-960f-273406073010-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7xktt\" (UID: \"779bece8-bd98-4516-960f-273406073010\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.456514 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.456479 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmft\" (UniqueName: \"kubernetes.io/projected/779bece8-bd98-4516-960f-273406073010-kube-api-access-rzmft\") pod \"cert-manager-webhook-7dc76cbb94-7xktt\" (UID: \"779bece8-bd98-4516-960f-273406073010\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.538104 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.538023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:27.672990 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.672965 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7xktt"] Jul 01 16:44:27.675400 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:44:27.675370 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod779bece8_bd98_4516_960f_273406073010.slice/crio-2cce039484b8cd0c854b6c41c840c0fce782991c60e86f7ee93d28e69eebade4 WatchSource:0}: Error finding container 2cce039484b8cd0c854b6c41c840c0fce782991c60e86f7ee93d28e69eebade4: Status 404 returned error can't find the container with id 2cce039484b8cd0c854b6c41c840c0fce782991c60e86f7ee93d28e69eebade4 Jul 01 16:44:27.683550 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.683527 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc"] Jul 01 16:44:27.688447 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.688431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.691242 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.691221 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:44:27.691351 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.691244 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:44:27.691351 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.691244 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ndvlp\"" Jul 01 16:44:27.695535 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.695513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc"] Jul 01 16:44:27.748597 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.748564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.748752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.748603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.748752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.748621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dd4t\" (UniqueName: \"kubernetes.io/projected/fa6493e5-0df7-497d-9ae1-859ecd95ff64-kube-api-access-4dd4t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.821204 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.821128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" event={"ID":"779bece8-bd98-4516-960f-273406073010","Type":"ContainerStarted","Data":"2cce039484b8cd0c854b6c41c840c0fce782991c60e86f7ee93d28e69eebade4"} Jul 01 16:44:27.849599 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.849570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.849750 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.849609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.849750 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.849627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dd4t\" (UniqueName: \"kubernetes.io/projected/fa6493e5-0df7-497d-9ae1-859ecd95ff64-kube-api-access-4dd4t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.849976 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.849958 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.850014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.849988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.859940 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.859913 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dd4t\" (UniqueName: \"kubernetes.io/projected/fa6493e5-0df7-497d-9ae1-859ecd95ff64-kube-api-access-4dd4t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:27.999004 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:27.998973 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:28.124836 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:28.124631 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc"] Jul 01 16:44:28.127441 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:44:28.127414 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6493e5_0df7_497d_9ae1_859ecd95ff64.slice/crio-4e59bb702b26d4e5e05220bca98b2276780d5dd23ef13174786abfd188e1207e WatchSource:0}: Error finding container 4e59bb702b26d4e5e05220bca98b2276780d5dd23ef13174786abfd188e1207e: Status 404 returned error can't find the container with id 4e59bb702b26d4e5e05220bca98b2276780d5dd23ef13174786abfd188e1207e Jul 01 16:44:28.343049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:28.342992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:28.725068 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:28.725034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:28.827350 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:28.827318 2575 generic.go:356] "Generic (PLEG): container finished" podID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerID="a04b706c5d291b32fad438e7cccd574eb8f7962906cd221930476b0ae9f44a7d" exitCode=0 Jul 01 16:44:28.827511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:28.827423 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" event={"ID":"fa6493e5-0df7-497d-9ae1-859ecd95ff64","Type":"ContainerDied","Data":"a04b706c5d291b32fad438e7cccd574eb8f7962906cd221930476b0ae9f44a7d"} Jul 01 16:44:28.827511 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:28.827488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" event={"ID":"fa6493e5-0df7-497d-9ae1-859ecd95ff64","Type":"ContainerStarted","Data":"4e59bb702b26d4e5e05220bca98b2276780d5dd23ef13174786abfd188e1207e"} Jul 01 16:44:29.388149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:29.388104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:32.851969 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:32.851926 2575 generic.go:356] "Generic (PLEG): container finished" podID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerID="aaeb44ebd2c495728257ece8125866c529bbf2dbe7f39133cab80058f9d57540" exitCode=0 Jul 01 16:44:32.852466 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:32.852015 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" event={"ID":"fa6493e5-0df7-497d-9ae1-859ecd95ff64","Type":"ContainerDied","Data":"aaeb44ebd2c495728257ece8125866c529bbf2dbe7f39133cab80058f9d57540"} Jul 01 16:44:32.853401 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:32.853376 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" event={"ID":"779bece8-bd98-4516-960f-273406073010","Type":"ContainerStarted","Data":"14dc29aaa375e6fa1e40576da4fb15c1ceffb1bae75820a07c9031bbbcad8df7"} Jul 01 16:44:32.853528 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:32.853489 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:32.890298 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:32.890253 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" podStartSLOduration=1.6238601639999999 podStartE2EDuration="5.890240365s" totalImagesPullingTime="4.266380201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:44:32.889637279 +0000 UTC m=+356.364705309" watchObservedRunningTime="2026-07-01 16:44:32.890240365 +0000 UTC m=+356.365308398" Jul 01 16:44:33.860864 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:33.860827 2575 generic.go:356] "Generic (PLEG): container finished" podID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerID="06f9f64a3d60da91552e23a413126f5309d0905fc423efdcd988486e06e9fcaa" exitCode=0 Jul 01 16:44:33.861383 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:33.860923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" event={"ID":"fa6493e5-0df7-497d-9ae1-859ecd95ff64","Type":"ContainerDied","Data":"06f9f64a3d60da91552e23a413126f5309d0905fc423efdcd988486e06e9fcaa"} Jul 01 16:44:34.995004 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:34.994979 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:35.110193 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.110155 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-util\") pod \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " Jul 01 16:44:35.110193 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.110193 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-bundle\") pod \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " Jul 01 16:44:35.110400 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.110241 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dd4t\" (UniqueName: \"kubernetes.io/projected/fa6493e5-0df7-497d-9ae1-859ecd95ff64-kube-api-access-4dd4t\") pod \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\" (UID: \"fa6493e5-0df7-497d-9ae1-859ecd95ff64\") " Jul 01 16:44:35.110647 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.110625 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-bundle" (OuterVolumeSpecName: "bundle") pod "fa6493e5-0df7-497d-9ae1-859ecd95ff64" (UID: "fa6493e5-0df7-497d-9ae1-859ecd95ff64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:44:35.112255 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.112233 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6493e5-0df7-497d-9ae1-859ecd95ff64-kube-api-access-4dd4t" (OuterVolumeSpecName: "kube-api-access-4dd4t") pod "fa6493e5-0df7-497d-9ae1-859ecd95ff64" (UID: "fa6493e5-0df7-497d-9ae1-859ecd95ff64"). InnerVolumeSpecName "kube-api-access-4dd4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:44:35.114436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.114403 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-util" (OuterVolumeSpecName: "util") pod "fa6493e5-0df7-497d-9ae1-859ecd95ff64" (UID: "fa6493e5-0df7-497d-9ae1-859ecd95ff64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:44:35.211600 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.211563 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dd4t\" (UniqueName: \"kubernetes.io/projected/fa6493e5-0df7-497d-9ae1-859ecd95ff64-kube-api-access-4dd4t\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:35.211600 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.211595 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:35.211600 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.211606 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6493e5-0df7-497d-9ae1-859ecd95ff64-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:35.872501 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.872443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" event={"ID":"fa6493e5-0df7-497d-9ae1-859ecd95ff64","Type":"ContainerDied","Data":"4e59bb702b26d4e5e05220bca98b2276780d5dd23ef13174786abfd188e1207e"} Jul 01 16:44:35.872501 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.872492 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8bjlc" Jul 01 16:44:35.872706 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:35.872522 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e59bb702b26d4e5e05220bca98b2276780d5dd23ef13174786abfd188e1207e" Jul 01 16:44:37.121030 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:37.121001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:37.268897 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:37.268865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:37.327450 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:37.327426 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:38.863236 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:38.863202 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7xktt" Jul 01 16:44:40.140658 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:40.140622 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:40.243688 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:40.243658 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:41.528307 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528272 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n"] Jul 01 16:44:41.528725 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528604 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerName="pull" Jul 01 16:44:41.528725 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528615 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerName="pull" Jul 01 16:44:41.528725 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528626 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerName="util" Jul 01 16:44:41.528725 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528631 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerName="util" Jul 01 16:44:41.528725 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528646 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerName="extract" Jul 01 16:44:41.528725 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528651 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerName="extract" Jul 01 16:44:41.528725 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.528726 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6493e5-0df7-497d-9ae1-859ecd95ff64" containerName="extract" Jul 01 16:44:41.561761 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.561738 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n"] Jul 01 16:44:41.561883 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.561817 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:41.564841 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.564820 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:44:41.565990 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.565969 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6f9sf\"" Jul 01 16:44:41.566094 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.566051 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 16:44:41.662939 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.662916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7948\" (UniqueName: \"kubernetes.io/projected/8ec9c158-d9fc-4ff1-8639-358d52992527-kube-api-access-w7948\") pod \"openshift-lws-operator-fd8ccff4c-5k68n\" (UID: \"8ec9c158-d9fc-4ff1-8639-358d52992527\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:41.663049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.662944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ec9c158-d9fc-4ff1-8639-358d52992527-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5k68n\" (UID: \"8ec9c158-d9fc-4ff1-8639-358d52992527\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:41.763920 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.763894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ec9c158-d9fc-4ff1-8639-358d52992527-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5k68n\" (UID: \"8ec9c158-d9fc-4ff1-8639-358d52992527\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:41.764012 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.763981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7948\" (UniqueName: \"kubernetes.io/projected/8ec9c158-d9fc-4ff1-8639-358d52992527-kube-api-access-w7948\") pod \"openshift-lws-operator-fd8ccff4c-5k68n\" (UID: \"8ec9c158-d9fc-4ff1-8639-358d52992527\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:41.764248 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.764230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ec9c158-d9fc-4ff1-8639-358d52992527-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5k68n\" (UID: \"8ec9c158-d9fc-4ff1-8639-358d52992527\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:41.773366 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.773338 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7948\" (UniqueName: \"kubernetes.io/projected/8ec9c158-d9fc-4ff1-8639-358d52992527-kube-api-access-w7948\") pod \"openshift-lws-operator-fd8ccff4c-5k68n\" (UID: \"8ec9c158-d9fc-4ff1-8639-358d52992527\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:41.871027 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:41.870974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" Jul 01 16:44:42.022187 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:42.022154 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n"] Jul 01 16:44:42.024811 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:44:42.024783 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ec9c158_d9fc_4ff1_8639_358d52992527.slice/crio-a812449a19922a420988dd1c463f99a72269142be129cf09b8927ff99a9373ba WatchSource:0}: Error finding container a812449a19922a420988dd1c463f99a72269142be129cf09b8927ff99a9373ba: Status 404 returned error can't find the container with id a812449a19922a420988dd1c463f99a72269142be129cf09b8927ff99a9373ba Jul 01 16:44:42.919018 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:42.918981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" event={"ID":"8ec9c158-d9fc-4ff1-8639-358d52992527","Type":"ContainerStarted","Data":"a812449a19922a420988dd1c463f99a72269142be129cf09b8927ff99a9373ba"} Jul 01 16:44:44.931589 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:44.931555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" event={"ID":"8ec9c158-d9fc-4ff1-8639-358d52992527","Type":"ContainerStarted","Data":"e6d1f8f4e685cd57cbf075581b893f3aba47e499845c6c64abeaabf6b170112f"} Jul 01 16:44:44.949091 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:44.949042 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5k68n" podStartSLOduration=1.745108661 podStartE2EDuration="3.949028573s" totalImagesPullingTime="2.203919912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:44:44.948634761 +0000 UTC m=+368.423702817" watchObservedRunningTime="2026-07-01 16:44:44.949028573 +0000 UTC m=+368.424096606" Jul 01 16:44:45.718306 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:45.718260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:45.835577 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:45.835549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:45.954420 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:45.954391 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-b4fzm"] Jul 01 16:44:45.975026 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:45.974960 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-b4fzm"] Jul 01 16:44:45.975166 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:45.975034 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:45.977832 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:45.977810 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tftpn\"" Jul 01 16:44:46.099041 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.099013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjw9n\" (UniqueName: \"kubernetes.io/projected/d6e1ff64-32b3-4a56-8674-ff640aa1eb74-kube-api-access-qjw9n\") pod \"cert-manager-59c77684cc-b4fzm\" (UID: \"d6e1ff64-32b3-4a56-8674-ff640aa1eb74\") " pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:46.099151 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.099125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6e1ff64-32b3-4a56-8674-ff640aa1eb74-bound-sa-token\") pod \"cert-manager-59c77684cc-b4fzm\" (UID: \"d6e1ff64-32b3-4a56-8674-ff640aa1eb74\") " pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:46.199933 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.199903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6e1ff64-32b3-4a56-8674-ff640aa1eb74-bound-sa-token\") pod \"cert-manager-59c77684cc-b4fzm\" (UID: \"d6e1ff64-32b3-4a56-8674-ff640aa1eb74\") " pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:46.200053 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.199955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjw9n\" (UniqueName: \"kubernetes.io/projected/d6e1ff64-32b3-4a56-8674-ff640aa1eb74-kube-api-access-qjw9n\") pod \"cert-manager-59c77684cc-b4fzm\" (UID: \"d6e1ff64-32b3-4a56-8674-ff640aa1eb74\") " pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:46.211709 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.211678 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6e1ff64-32b3-4a56-8674-ff640aa1eb74-bound-sa-token\") pod \"cert-manager-59c77684cc-b4fzm\" (UID: \"d6e1ff64-32b3-4a56-8674-ff640aa1eb74\") " pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:46.212576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.212558 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjw9n\" (UniqueName: \"kubernetes.io/projected/d6e1ff64-32b3-4a56-8674-ff640aa1eb74-kube-api-access-qjw9n\") pod \"cert-manager-59c77684cc-b4fzm\" (UID: \"d6e1ff64-32b3-4a56-8674-ff640aa1eb74\") " pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:46.284547 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.284499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-b4fzm" Jul 01 16:44:46.439281 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.439257 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-b4fzm"] Jul 01 16:44:46.441527 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:44:46.441497 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6e1ff64_32b3_4a56_8674_ff640aa1eb74.slice/crio-133c988d737dbc9b9463a27da6f9bdb5f5aa00388533db10aefc86fbd8a95ece WatchSource:0}: Error finding container 133c988d737dbc9b9463a27da6f9bdb5f5aa00388533db10aefc86fbd8a95ece: Status 404 returned error can't find the container with id 133c988d737dbc9b9463a27da6f9bdb5f5aa00388533db10aefc86fbd8a95ece Jul 01 16:44:46.942353 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.942321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-b4fzm" event={"ID":"d6e1ff64-32b3-4a56-8674-ff640aa1eb74","Type":"ContainerStarted","Data":"fb2f1c43bd0d6373138d7421639bd9bfc38411a57e0a4bba8eb8fb818db62c0a"} Jul 01 16:44:46.942353 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.942356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-b4fzm" event={"ID":"d6e1ff64-32b3-4a56-8674-ff640aa1eb74","Type":"ContainerStarted","Data":"133c988d737dbc9b9463a27da6f9bdb5f5aa00388533db10aefc86fbd8a95ece"} Jul 01 16:44:46.963958 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:46.963910 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-b4fzm" podStartSLOduration=1.963895388 podStartE2EDuration="1.963895388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:44:46.961412132 +0000 UTC m=+370.436480178" watchObservedRunningTime="2026-07-01 16:44:46.963895388 +0000 UTC m=+370.438963420" Jul 01 16:44:47.758446 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.758415 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5"] Jul 01 16:44:47.760693 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.760676 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:47.763445 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.763412 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ndvlp\"" Jul 01 16:44:47.763579 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.763474 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:44:47.764649 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.764625 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:44:47.772209 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.772190 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5"] Jul 01 16:44:47.864020 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.863984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:47.913298 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.913261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:47.913499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.913316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvglf\" (UniqueName: \"kubernetes.io/projected/80bd1b77-128a-48df-b941-5e8692a6be1a-kube-api-access-zvglf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:47.913499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:47.913399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.014659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.014579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.014659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.014636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.015053 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.014671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvglf\" (UniqueName: \"kubernetes.io/projected/80bd1b77-128a-48df-b941-5e8692a6be1a-kube-api-access-zvglf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.015053 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.014967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.015053 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.014983 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.025001 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.024980 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvglf\" (UniqueName: \"kubernetes.io/projected/80bd1b77-128a-48df-b941-5e8692a6be1a-kube-api-access-zvglf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.069818 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.069794 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:48.198138 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.198113 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5"] Jul 01 16:44:48.200370 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:44:48.200338 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bd1b77_128a_48df_b941_5e8692a6be1a.slice/crio-4903819e7dc417238c7cdaf0aa15f5a7021b2571be4f65c1071f6135c38392ad WatchSource:0}: Error finding container 4903819e7dc417238c7cdaf0aa15f5a7021b2571be4f65c1071f6135c38392ad: Status 404 returned error can't find the container with id 4903819e7dc417238c7cdaf0aa15f5a7021b2571be4f65c1071f6135c38392ad Jul 01 16:44:48.954560 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.954531 2575 generic.go:356] "Generic (PLEG): container finished" podID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerID="8e0d7381253aba410103c3bcbea49f34806fa37d1236e2d6b30f5a32ea823b46" exitCode=0 Jul 01 16:44:48.954794 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.954569 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" event={"ID":"80bd1b77-128a-48df-b941-5e8692a6be1a","Type":"ContainerDied","Data":"8e0d7381253aba410103c3bcbea49f34806fa37d1236e2d6b30f5a32ea823b46"} Jul 01 16:44:48.954794 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:48.954604 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" event={"ID":"80bd1b77-128a-48df-b941-5e8692a6be1a","Type":"ContainerStarted","Data":"4903819e7dc417238c7cdaf0aa15f5a7021b2571be4f65c1071f6135c38392ad"} Jul 01 16:44:49.961342 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:49.961315 2575 generic.go:356] "Generic (PLEG): container finished" podID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerID="d17bb8b2573c4ddbb51b685f1d5fabb4a01d9609727e9d17bd77d3322c5831e2" exitCode=0 Jul 01 16:44:49.961818 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:49.961372 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" event={"ID":"80bd1b77-128a-48df-b941-5e8692a6be1a","Type":"ContainerDied","Data":"d17bb8b2573c4ddbb51b685f1d5fabb4a01d9609727e9d17bd77d3322c5831e2"} Jul 01 16:44:50.971163 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:50.971131 2575 generic.go:356] "Generic (PLEG): container finished" podID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerID="d58cfc58f1df2adf358575e71e11c4c53758e80255a1ad438ae0f33bc1e5f074" exitCode=0 Jul 01 16:44:50.971588 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:50.971217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" event={"ID":"80bd1b77-128a-48df-b941-5e8692a6be1a","Type":"ContainerDied","Data":"d58cfc58f1df2adf358575e71e11c4c53758e80255a1ad438ae0f33bc1e5f074"} Jul 01 16:44:52.101570 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.101545 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:44:52.248572 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.248504 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-bundle\") pod \"80bd1b77-128a-48df-b941-5e8692a6be1a\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " Jul 01 16:44:52.248572 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.248559 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-util\") pod \"80bd1b77-128a-48df-b941-5e8692a6be1a\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " Jul 01 16:44:52.248722 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.248602 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvglf\" (UniqueName: \"kubernetes.io/projected/80bd1b77-128a-48df-b941-5e8692a6be1a-kube-api-access-zvglf\") pod \"80bd1b77-128a-48df-b941-5e8692a6be1a\" (UID: \"80bd1b77-128a-48df-b941-5e8692a6be1a\") " Jul 01 16:44:52.249171 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.249145 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-bundle" (OuterVolumeSpecName: "bundle") pod "80bd1b77-128a-48df-b941-5e8692a6be1a" (UID: "80bd1b77-128a-48df-b941-5e8692a6be1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:44:52.250679 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.250654 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80bd1b77-128a-48df-b941-5e8692a6be1a-kube-api-access-zvglf" (OuterVolumeSpecName: "kube-api-access-zvglf") pod "80bd1b77-128a-48df-b941-5e8692a6be1a" (UID: "80bd1b77-128a-48df-b941-5e8692a6be1a"). InnerVolumeSpecName "kube-api-access-zvglf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:44:52.254362 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.254328 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-util" (OuterVolumeSpecName: "util") pod "80bd1b77-128a-48df-b941-5e8692a6be1a" (UID: "80bd1b77-128a-48df-b941-5e8692a6be1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:44:52.349595 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.349569 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvglf\" (UniqueName: \"kubernetes.io/projected/80bd1b77-128a-48df-b941-5e8692a6be1a-kube-api-access-zvglf\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:52.349595 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.349592 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:52.349730 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.349602 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80bd1b77-128a-48df-b941-5e8692a6be1a-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:44:52.982119 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.982083 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" event={"ID":"80bd1b77-128a-48df-b941-5e8692a6be1a","Type":"ContainerDied","Data":"4903819e7dc417238c7cdaf0aa15f5a7021b2571be4f65c1071f6135c38392ad"} Jul 01 16:44:52.982305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.982130 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4903819e7dc417238c7cdaf0aa15f5a7021b2571be4f65c1071f6135c38392ad" Jul 01 16:44:52.982305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:44:52.982092 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf8br5" Jul 01 16:45:04.042029 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.041992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.144263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.144226 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.425050 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.425024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.497319 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497292 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5"] Jul 01 16:45:04.497730 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497710 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerName="extract" Jul 01 16:45:04.497730 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497728 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerName="extract" Jul 01 16:45:04.497874 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497762 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerName="pull" Jul 01 16:45:04.497874 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497772 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerName="pull" Jul 01 16:45:04.497874 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497788 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerName="util" Jul 01 16:45:04.497874 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497795 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerName="util" Jul 01 16:45:04.498073 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.497899 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="80bd1b77-128a-48df-b941-5e8692a6be1a" containerName="extract" Jul 01 16:45:04.501066 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.501046 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.504033 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.504016 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 16:45:04.504120 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.504096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 16:45:04.504200 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.504179 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 16:45:04.504316 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.504300 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 16:45:04.504951 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.504933 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kwhtb\"" Jul 01 16:45:04.518152 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.518131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5"] Jul 01 16:45:04.528640 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.528617 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.540904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.540881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41045c75-97eb-4954-b022-02baa7c9f5d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.540991 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.540908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41045c75-97eb-4954-b022-02baa7c9f5d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.540991 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.540935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41045c75-97eb-4954-b022-02baa7c9f5d7-tmp\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.541097 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.540992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41045c75-97eb-4954-b022-02baa7c9f5d7-manifests\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.541097 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.541087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znczw\" (UniqueName: \"kubernetes.io/projected/41045c75-97eb-4954-b022-02baa7c9f5d7-kube-api-access-znczw\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.616020 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.615993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.642144 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.642115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41045c75-97eb-4954-b022-02baa7c9f5d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.642310 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.642150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41045c75-97eb-4954-b022-02baa7c9f5d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.642310 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.642184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41045c75-97eb-4954-b022-02baa7c9f5d7-tmp\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.642310 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.642216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41045c75-97eb-4954-b022-02baa7c9f5d7-manifests\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.642310 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.642280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znczw\" (UniqueName: \"kubernetes.io/projected/41045c75-97eb-4954-b022-02baa7c9f5d7-kube-api-access-znczw\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.642763 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.642737 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41045c75-97eb-4954-b022-02baa7c9f5d7-manifests\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.644537 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.644505 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41045c75-97eb-4954-b022-02baa7c9f5d7-tmp\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.644668 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.644636 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41045c75-97eb-4954-b022-02baa7c9f5d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.644815 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.644797 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41045c75-97eb-4954-b022-02baa7c9f5d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.652336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.652316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znczw\" (UniqueName: \"kubernetes.io/projected/41045c75-97eb-4954-b022-02baa7c9f5d7-kube-api-access-znczw\") pod \"opendatahub-operator-controller-manager-579557fd58-dz6g5\" (UID: \"41045c75-97eb-4954-b022-02baa7c9f5d7\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.707309 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.707248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.808516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.808470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.810936 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.810919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:04.907879 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.907843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:04.970664 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.970637 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5"] Jul 01 16:45:04.972754 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:45:04.972716 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41045c75_97eb_4954_b022_02baa7c9f5d7.slice/crio-5aaf009adbded5ef28df9dd95300e5e149ebd7246a37515b26400d6a27eb0a6b WatchSource:0}: Error finding container 5aaf009adbded5ef28df9dd95300e5e149ebd7246a37515b26400d6a27eb0a6b: Status 404 returned error can't find the container with id 5aaf009adbded5ef28df9dd95300e5e149ebd7246a37515b26400d6a27eb0a6b Jul 01 16:45:04.973497 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:04.973446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:05.041072 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:05.041043 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" event={"ID":"41045c75-97eb-4954-b022-02baa7c9f5d7","Type":"ContainerStarted","Data":"5aaf009adbded5ef28df9dd95300e5e149ebd7246a37515b26400d6a27eb0a6b"} Jul 01 16:45:05.069778 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:05.069752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:05.232752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:05.232664 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:05.342681 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:05.342641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:06.928964 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:06.928924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:09.064762 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:09.064729 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" event={"ID":"41045c75-97eb-4954-b022-02baa7c9f5d7","Type":"ContainerStarted","Data":"bdfdd6ae5b8c3b0906841d4c2e5ad35e393561f57ab8d6160bcb73a8de2bb8a1"} Jul 01 16:45:09.502698 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:09.502662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:09.639814 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:09.639788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:10.072002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:10.071914 2575 generic.go:356] "Generic (PLEG): container finished" podID="41045c75-97eb-4954-b022-02baa7c9f5d7" containerID="bdfdd6ae5b8c3b0906841d4c2e5ad35e393561f57ab8d6160bcb73a8de2bb8a1" exitCode=0 Jul 01 16:45:10.072002 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:10.071955 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" event={"ID":"41045c75-97eb-4954-b022-02baa7c9f5d7","Type":"ContainerDied","Data":"bdfdd6ae5b8c3b0906841d4c2e5ad35e393561f57ab8d6160bcb73a8de2bb8a1"} Jul 01 16:45:11.079005 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:11.078913 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" event={"ID":"41045c75-97eb-4954-b022-02baa7c9f5d7","Type":"ContainerStarted","Data":"0c747478da41afd8f32595a3619fa0051f1c8bac7e6479260d4e53e0e6b00344"} Jul 01 16:45:11.079432 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:11.079022 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:11.105833 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:11.105774 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" podStartSLOduration=2.1877528 podStartE2EDuration="7.105759257s" totalImagesPullingTime="3.967123209s" totalInitContainerRuntime="950.883248ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:11.102547855 +0000 UTC m=+394.577615890" watchObservedRunningTime="2026-07-01 16:45:11.105759257 +0000 UTC m=+394.580827289" Jul 01 16:45:22.086953 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:22.086916 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-dz6g5" Jul 01 16:45:23.991957 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:23.991921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:24.442380 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:24.442344 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:24.569144 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:24.569115 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:24.861532 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:24.861438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:24.959334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:24.959305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:25.066732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:25.066695 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:25.171194 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:25.171168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:25.419045 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:25.419013 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:25.795061 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:25.795027 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:25.987684 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:25.987650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:26.064976 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:26.064907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:26.358371 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:26.358297 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:27.045130 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.045098 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-996f85ff6-g7hr6"] Jul 01 16:45:27.053135 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.053113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.056025 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.056004 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7gbbm\"" Jul 01 16:45:27.056192 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.056058 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 16:45:27.059613 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.059593 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-996f85ff6-g7hr6"] Jul 01 16:45:27.086084 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.086057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:27.125868 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.125847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5fxh\" (UniqueName: \"kubernetes.io/projected/49b05101-74d4-4c8c-b79d-cf6a5439f40b-kube-api-access-c5fxh\") pod \"dashboard-redirect-996f85ff6-g7hr6\" (UID: \"49b05101-74d4-4c8c-b79d-cf6a5439f40b\") " pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.125967 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.125917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/49b05101-74d4-4c8c-b79d-cf6a5439f40b-redirect-config\") pod \"dashboard-redirect-996f85ff6-g7hr6\" (UID: \"49b05101-74d4-4c8c-b79d-cf6a5439f40b\") " pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.226413 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.226387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/49b05101-74d4-4c8c-b79d-cf6a5439f40b-redirect-config\") pod \"dashboard-redirect-996f85ff6-g7hr6\" (UID: \"49b05101-74d4-4c8c-b79d-cf6a5439f40b\") " pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.226580 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.226438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5fxh\" (UniqueName: \"kubernetes.io/projected/49b05101-74d4-4c8c-b79d-cf6a5439f40b-kube-api-access-c5fxh\") pod \"dashboard-redirect-996f85ff6-g7hr6\" (UID: \"49b05101-74d4-4c8c-b79d-cf6a5439f40b\") " pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.227050 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.227031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/49b05101-74d4-4c8c-b79d-cf6a5439f40b-redirect-config\") pod \"dashboard-redirect-996f85ff6-g7hr6\" (UID: \"49b05101-74d4-4c8c-b79d-cf6a5439f40b\") " pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.235566 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.235541 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5fxh\" (UniqueName: \"kubernetes.io/projected/49b05101-74d4-4c8c-b79d-cf6a5439f40b-kube-api-access-c5fxh\") pod \"dashboard-redirect-996f85ff6-g7hr6\" (UID: \"49b05101-74d4-4c8c-b79d-cf6a5439f40b\") " pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.357635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.357564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:27.364450 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.364434 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" Jul 01 16:45:27.495282 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:27.495260 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-996f85ff6-g7hr6"] Jul 01 16:45:27.498005 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:45:27.497977 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b05101_74d4_4c8c_b79d_cf6a5439f40b.slice/crio-42ebd7cda94a50e1d1f5e91873f5f3a7edbaa702eba4962177cf0b31809033b1 WatchSource:0}: Error finding container 42ebd7cda94a50e1d1f5e91873f5f3a7edbaa702eba4962177cf0b31809033b1: Status 404 returned error can't find the container with id 42ebd7cda94a50e1d1f5e91873f5f3a7edbaa702eba4962177cf0b31809033b1 Jul 01 16:45:28.163880 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:28.163843 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" event={"ID":"49b05101-74d4-4c8c-b79d-cf6a5439f40b","Type":"ContainerStarted","Data":"42ebd7cda94a50e1d1f5e91873f5f3a7edbaa702eba4962177cf0b31809033b1"} Jul 01 16:45:33.192777 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.192740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" event={"ID":"49b05101-74d4-4c8c-b79d-cf6a5439f40b","Type":"ContainerStarted","Data":"320f586a6415d8f9a52bea6715f8f2cbf11a643e7e21b54ff1adea8031558436"} Jul 01 16:45:33.213779 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.213733 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-996f85ff6-g7hr6" podStartSLOduration=1.223676782 podStartE2EDuration="6.213717257s" totalImagesPullingTime="4.990040475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:33.212525548 +0000 UTC m=+416.687593585" watchObservedRunningTime="2026-07-01 16:45:33.213717257 +0000 UTC m=+416.688785290" Jul 01 16:45:33.329418 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.329388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:33.403009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.402972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:33.609728 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.609643 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc"] Jul 01 16:45:33.615509 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.615484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.619104 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.619077 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 16:45:33.619521 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.619502 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zv87l\"" Jul 01 16:45:33.630248 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.630220 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc"] Jul 01 16:45:33.683636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eceb602d-527f-427f-b694-d0b1a29bac36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.683636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.683850 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eceb602d-527f-427f-b694-d0b1a29bac36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.683850 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7xwk\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-kube-api-access-n7xwk\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.683850 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.683850 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.683850 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.684097 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.684097 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.683909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.784845 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.784819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eceb602d-527f-427f-b694-d0b1a29bac36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.784972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.784853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7xwk\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-kube-api-access-n7xwk\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.784972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.784871 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.784972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.784897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.784972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.784924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.784972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.784957 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.785214 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.785014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.785214 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.785152 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eceb602d-527f-427f-b694-d0b1a29bac36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.785214 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.785181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.785366 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.785333 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.785407 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.785363 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.785519 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.785496 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.785590 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.785561 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.786071 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.786047 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eceb602d-527f-427f-b694-d0b1a29bac36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.787297 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.787277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.787431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.787413 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eceb602d-527f-427f-b694-d0b1a29bac36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.809171 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.809149 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.809347 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.809330 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7xwk\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-kube-api-access-n7xwk\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:33.925756 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:33.925733 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:34.004439 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.004406 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:34.082765 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.082739 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc"] Jul 01 16:45:34.083932 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:45:34.083901 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeceb602d_527f_427f_b694_d0b1a29bac36.slice/crio-2f291065aa63d25127811b548d0f1447df1d0a84e5a56816079d7998ea60e5e1 WatchSource:0}: Error finding container 2f291065aa63d25127811b548d0f1447df1d0a84e5a56816079d7998ea60e5e1: Status 404 returned error can't find the container with id 2f291065aa63d25127811b548d0f1447df1d0a84e5a56816079d7998ea60e5e1 Jul 01 16:45:34.096576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.096552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:34.166242 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.166217 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92"] Jul 01 16:45:34.170692 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.170677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.198349 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.198330 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" event={"ID":"eceb602d-527f-427f-b694-d0b1a29bac36","Type":"ContainerStarted","Data":"2f291065aa63d25127811b548d0f1447df1d0a84e5a56816079d7998ea60e5e1"} Jul 01 16:45:34.212537 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.212517 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92"] Jul 01 16:45:34.262233 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.262201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:34.289524 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289615 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289615 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289831 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpqc7\" (UniqueName: \"kubernetes.io/projected/4a4cc670-c1af-4bfd-9007-46f2301450d1-kube-api-access-lpqc7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289831 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.289911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.289902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4cc670-c1af-4bfd-9007-46f2301450d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391341 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391341 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391342 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpqc7\" (UniqueName: \"kubernetes.io/projected/4a4cc670-c1af-4bfd-9007-46f2301450d1-kube-api-access-lpqc7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391620 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391620 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391620 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391620 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4cc670-c1af-4bfd-9007-46f2301450d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391620 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391620 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391620 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391826 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391903 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.391980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391960 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.392149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.391988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.392289 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.392262 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a4cc670-c1af-4bfd-9007-46f2301450d1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.393572 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.393555 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.393855 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.393838 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.405865 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.405835 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a4cc670-c1af-4bfd-9007-46f2301450d1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.405980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.405963 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpqc7\" (UniqueName: \"kubernetes.io/projected/4a4cc670-c1af-4bfd-9007-46f2301450d1-kube-api-access-lpqc7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ptt92\" (UID: \"4a4cc670-c1af-4bfd-9007-46f2301450d1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.480985 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.480931 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:34.626833 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.626804 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92"] Jul 01 16:45:34.627645 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:45:34.627622 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4cc670_c1af_4bfd_9007_46f2301450d1.slice/crio-537952b42003677738b1fd7196f2a35ca2158e3b6780e0408365db50432150be WatchSource:0}: Error finding container 537952b42003677738b1fd7196f2a35ca2158e3b6780e0408365db50432150be: Status 404 returned error can't find the container with id 537952b42003677738b1fd7196f2a35ca2158e3b6780e0408365db50432150be Jul 01 16:45:34.869512 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:34.869401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:35.203505 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.203473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" event={"ID":"4a4cc670-c1af-4bfd-9007-46f2301450d1","Type":"ContainerStarted","Data":"537952b42003677738b1fd7196f2a35ca2158e3b6780e0408365db50432150be"} Jul 01 16:45:35.737564 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.737532 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6"] Jul 01 16:45:35.742186 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.742170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:35.747010 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.746979 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 16:45:35.747010 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.747002 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 16:45:35.747198 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.747020 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g4hjd\"" Jul 01 16:45:35.747198 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.746979 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 16:45:35.769801 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.769780 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6"] Jul 01 16:45:35.904367 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.904327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bf5764e-09fd-4544-9494-ae7fac52149b-manager-config\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:35.904579 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.904385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbwnw\" (UniqueName: \"kubernetes.io/projected/5bf5764e-09fd-4544-9494-ae7fac52149b-kube-api-access-mbwnw\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:35.904579 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.904503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bf5764e-09fd-4544-9494-ae7fac52149b-metrics-cert\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:35.904579 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:35.904525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bf5764e-09fd-4544-9494-ae7fac52149b-cert\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.005830 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.005760 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bf5764e-09fd-4544-9494-ae7fac52149b-metrics-cert\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.005830 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.005795 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bf5764e-09fd-4544-9494-ae7fac52149b-cert\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.006037 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.005843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bf5764e-09fd-4544-9494-ae7fac52149b-manager-config\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.006037 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.006014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbwnw\" (UniqueName: \"kubernetes.io/projected/5bf5764e-09fd-4544-9494-ae7fac52149b-kube-api-access-mbwnw\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.006649 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.006619 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bf5764e-09fd-4544-9494-ae7fac52149b-manager-config\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.008744 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.008718 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bf5764e-09fd-4544-9494-ae7fac52149b-cert\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.008892 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.008792 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bf5764e-09fd-4544-9494-ae7fac52149b-metrics-cert\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.021745 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.021719 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbwnw\" (UniqueName: \"kubernetes.io/projected/5bf5764e-09fd-4544-9494-ae7fac52149b-kube-api-access-mbwnw\") pod \"lws-controller-manager-66fb8c9499-cjbb6\" (UID: \"5bf5764e-09fd-4544-9494-ae7fac52149b\") " pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.052111 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.052085 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:36.391295 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:36.391270 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6"] Jul 01 16:45:36.393720 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:45:36.393696 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf5764e_09fd_4544_9494_ae7fac52149b.slice/crio-e20f309306495282e72ed7c5472a633957fbc9d06f0b53c2f9fbe5fc6cdbe1e6 WatchSource:0}: Error finding container e20f309306495282e72ed7c5472a633957fbc9d06f0b53c2f9fbe5fc6cdbe1e6: Status 404 returned error can't find the container with id e20f309306495282e72ed7c5472a633957fbc9d06f0b53c2f9fbe5fc6cdbe1e6 Jul 01 16:45:37.010072 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:37.007401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:37.114709 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:37.114655 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:37.208054 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:37.208008 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:37.217403 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:37.217368 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" event={"ID":"5bf5764e-09fd-4544-9494-ae7fac52149b","Type":"ContainerStarted","Data":"e20f309306495282e72ed7c5472a633957fbc9d06f0b53c2f9fbe5fc6cdbe1e6"} Jul 01 16:45:37.306828 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:37.306748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:37.559078 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:37.558988 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:38.033152 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.033106 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 16:45:38.033280 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.033203 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 16:45:38.033280 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.033267 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 16:45:38.038496 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.038444 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 16:45:38.038570 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.038552 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 16:45:38.038618 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.038600 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 16:45:38.225315 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.225282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" event={"ID":"4a4cc670-c1af-4bfd-9007-46f2301450d1","Type":"ContainerStarted","Data":"f2197a972d3af4579fa5475f4cffb81d16f9e95a35721da47d9d0c7c2572482a"} Jul 01 16:45:38.227004 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.226978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" event={"ID":"eceb602d-527f-427f-b694-d0b1a29bac36","Type":"ContainerStarted","Data":"b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d"} Jul 01 16:45:38.304143 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.304015 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" podStartSLOduration=0.895617491 podStartE2EDuration="4.303993984s" totalImagesPullingTime="3.408376493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:38.302723389 +0000 UTC m=+421.777791422" watchObservedRunningTime="2026-07-01 16:45:38.303993984 +0000 UTC m=+421.779062018" Jul 01 16:45:38.346702 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.346650 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" podStartSLOduration=1.399806124 podStartE2EDuration="5.346630837s" totalImagesPullingTime="3.946824713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:38.344761044 +0000 UTC m=+421.819829096" watchObservedRunningTime="2026-07-01 16:45:38.346630837 +0000 UTC m=+421.821698874" Jul 01 16:45:38.392496 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.392446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:38.481772 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.481744 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:38.533924 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.533895 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:38.635475 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.635423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:38.926727 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:38.926656 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:39.486592 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:39.486561 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:39.927720 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:39.927696 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 01 16:45:39.928073 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:39.927768 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" podUID="eceb602d-527f-427f-b694-d0b1a29bac36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 01 16:45:40.239515 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.239479 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" event={"ID":"5bf5764e-09fd-4544-9494-ae7fac52149b","Type":"ContainerStarted","Data":"2f756fce81c478d66579c9607918f07c16a9536a73c9ab368060b9407d62caf6"} Jul 01 16:45:40.239799 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.239774 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:45:40.239921 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.239816 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:40.240516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.240499 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ptt92" Jul 01 16:45:40.265402 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.265359 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" podStartSLOduration=1.7964980430000002 podStartE2EDuration="5.265346267s" totalImagesPullingTime="3.468848224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:40.264068644 +0000 UTC m=+423.739136697" watchObservedRunningTime="2026-07-01 16:45:40.265346267 +0000 UTC m=+423.740414301" Jul 01 16:45:40.406023 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.405983 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc"] Jul 01 16:45:40.926440 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.926404 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 01 16:45:40.926614 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:40.926488 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" podUID="eceb602d-527f-427f-b694-d0b1a29bac36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 01 16:45:41.244089 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:41.243997 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" podUID="eceb602d-527f-427f-b694-d0b1a29bac36" containerName="istio-proxy" containerID="cri-o://b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d" gracePeriod=30 Jul 01 16:45:46.492180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.492156 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:46.600265 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600203 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-envoy\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600265 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600246 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eceb602d-527f-427f-b694-d0b1a29bac36-istio-podinfo\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600265 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600264 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7xwk\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-kube-api-access-n7xwk\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600290 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-socket\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600330 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eceb602d-527f-427f-b694-d0b1a29bac36-istiod-ca-cert\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600369 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-certs\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600393 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-credential-socket\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600414 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-istio-token\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600450 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-data\") pod \"eceb602d-527f-427f-b694-d0b1a29bac36\" (UID: \"eceb602d-527f-427f-b694-d0b1a29bac36\") " Jul 01 16:45:46.600860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600602 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:45:46.600860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600668 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:45:46.600860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600805 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-socket\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.600860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600826 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-credential-socket\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.600860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600831 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-data" (OuterVolumeSpecName: "istio-data") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:45:46.600860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.600844 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eceb602d-527f-427f-b694-d0b1a29bac36-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:45:46.601159 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.601030 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:45:46.602527 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.602503 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-kube-api-access-n7xwk" (OuterVolumeSpecName: "kube-api-access-n7xwk") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "kube-api-access-n7xwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:45:46.602634 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.602538 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eceb602d-527f-427f-b694-d0b1a29bac36-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 01 16:45:46.602634 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.602560 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:45:46.602718 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.602654 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-istio-token" (OuterVolumeSpecName: "istio-token") pod "eceb602d-527f-427f-b694-d0b1a29bac36" (UID: "eceb602d-527f-427f-b694-d0b1a29bac36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:45:46.702139 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.702114 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-istio-token\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.702139 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.702134 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-data\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.702139 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.702143 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-istio-envoy\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.702333 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.702152 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eceb602d-527f-427f-b694-d0b1a29bac36-istio-podinfo\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.702333 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.702161 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7xwk\" (UniqueName: \"kubernetes.io/projected/eceb602d-527f-427f-b694-d0b1a29bac36-kube-api-access-n7xwk\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.702333 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.702169 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eceb602d-527f-427f-b694-d0b1a29bac36-istiod-ca-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:46.702333 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:46.702177 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eceb602d-527f-427f-b694-d0b1a29bac36-workload-certs\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:45:47.278353 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.278315 2575 generic.go:356] "Generic (PLEG): container finished" podID="eceb602d-527f-427f-b694-d0b1a29bac36" containerID="b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d" exitCode=0 Jul 01 16:45:47.278516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.278373 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" Jul 01 16:45:47.278516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.278405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" event={"ID":"eceb602d-527f-427f-b694-d0b1a29bac36","Type":"ContainerDied","Data":"b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d"} Jul 01 16:45:47.278516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.278512 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc" event={"ID":"eceb602d-527f-427f-b694-d0b1a29bac36","Type":"ContainerDied","Data":"2f291065aa63d25127811b548d0f1447df1d0a84e5a56816079d7998ea60e5e1"} Jul 01 16:45:47.278679 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.278544 2575 scope.go:117] "RemoveContainer" containerID="b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d" Jul 01 16:45:47.287961 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.287931 2575 scope.go:117] "RemoveContainer" containerID="b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d" Jul 01 16:45:47.288196 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:45:47.288176 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d\": container with ID starting with b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d not found: ID does not exist" containerID="b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d" Jul 01 16:45:47.288276 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.288202 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d"} err="failed to get container status \"b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d\": rpc error: code = NotFound desc = could not find container \"b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d\": container with ID starting with b109137d2f659d622550d4378de2361e8302b3e570246885862345d5bd00837d not found: ID does not exist" Jul 01 16:45:47.303372 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.303352 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc"] Jul 01 16:45:47.309478 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:47.309442 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-5nhqc"] Jul 01 16:45:49.171235 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:49.171201 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eceb602d-527f-427f-b694-d0b1a29bac36" path="/var/lib/kubelet/pods/eceb602d-527f-427f-b694-d0b1a29bac36/volumes" Jul 01 16:45:51.246124 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:45:51.246097 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66fb8c9499-cjbb6" Jul 01 16:46:25.606323 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:25.606288 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:25.699414 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:25.699379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:25.780162 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:25.780136 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:37.276153 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.276098 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-588b695df9-ppr2d"] Jul 01 16:46:37.276847 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.276785 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eceb602d-527f-427f-b694-d0b1a29bac36" containerName="istio-proxy" Jul 01 16:46:37.276847 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.276808 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eceb602d-527f-427f-b694-d0b1a29bac36" containerName="istio-proxy" Jul 01 16:46:37.277014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.276935 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eceb602d-527f-427f-b694-d0b1a29bac36" containerName="istio-proxy" Jul 01 16:46:37.281410 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.281355 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.293753 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.293719 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588b695df9-ppr2d"] Jul 01 16:46:37.329011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.328977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:37.385097 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.385072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:37.391258 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.391235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-service-ca\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.391336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.391267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b01577ae-c327-43ef-98da-cf25a5640461-console-serving-cert\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.391336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.391283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5gh\" (UniqueName: \"kubernetes.io/projected/b01577ae-c327-43ef-98da-cf25a5640461-kube-api-access-dt5gh\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.391336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.391308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-trusted-ca-bundle\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.391432 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.391360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-console-config\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.391432 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.391387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-oauth-serving-cert\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.391432 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.391415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b01577ae-c327-43ef-98da-cf25a5640461-console-oauth-config\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.467830 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.467771 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:37.492037 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-service-ca\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492126 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b01577ae-c327-43ef-98da-cf25a5640461-console-serving-cert\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492126 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5gh\" (UniqueName: \"kubernetes.io/projected/b01577ae-c327-43ef-98da-cf25a5640461-kube-api-access-dt5gh\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492126 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-trusted-ca-bundle\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-console-config\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-oauth-serving-cert\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b01577ae-c327-43ef-98da-cf25a5640461-console-oauth-config\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492818 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492793 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-service-ca\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.492984 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492958 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-trusted-ca-bundle\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.493081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.492999 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-console-config\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.493081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.493012 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b01577ae-c327-43ef-98da-cf25a5640461-oauth-serving-cert\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.494697 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.494673 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b01577ae-c327-43ef-98da-cf25a5640461-console-oauth-config\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.494769 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.494681 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b01577ae-c327-43ef-98da-cf25a5640461-console-serving-cert\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.502551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.502531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5gh\" (UniqueName: \"kubernetes.io/projected/b01577ae-c327-43ef-98da-cf25a5640461-kube-api-access-dt5gh\") pod \"console-588b695df9-ppr2d\" (UID: \"b01577ae-c327-43ef-98da-cf25a5640461\") " pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.529074 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.529056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:37.593059 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.593027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:37.738693 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:37.738667 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588b695df9-ppr2d"] Jul 01 16:46:37.740619 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:46:37.740598 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01577ae_c327_43ef_98da_cf25a5640461.slice/crio-708f69b061702764ff3647108dead5d32bc3e24045bbefce6cb748e98df224c1 WatchSource:0}: Error finding container 708f69b061702764ff3647108dead5d32bc3e24045bbefce6cb748e98df224c1: Status 404 returned error can't find the container with id 708f69b061702764ff3647108dead5d32bc3e24045bbefce6cb748e98df224c1 Jul 01 16:46:38.086062 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:38.085930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:38.144297 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:38.144271 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:38.531901 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:38.531873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588b695df9-ppr2d" event={"ID":"b01577ae-c327-43ef-98da-cf25a5640461","Type":"ContainerStarted","Data":"0ebda79f22050cfe38b8021ad833a7950f20ce30d52f04497a205ffbad1dc3d4"} Jul 01 16:46:38.532236 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:38.531922 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588b695df9-ppr2d" event={"ID":"b01577ae-c327-43ef-98da-cf25a5640461","Type":"ContainerStarted","Data":"708f69b061702764ff3647108dead5d32bc3e24045bbefce6cb748e98df224c1"} Jul 01 16:46:40.884045 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:40.883992 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-588b695df9-ppr2d" podStartSLOduration=3.883977238 podStartE2EDuration="3.883977238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:46:38.557006306 +0000 UTC m=+482.032074338" watchObservedRunningTime="2026-07-01 16:46:40.883977238 +0000 UTC m=+484.359045269" Jul 01 16:46:40.885652 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:40.885635 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w"] Jul 01 16:46:40.889522 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:40.889506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:40.892728 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:40.892703 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:46:40.892857 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:40.892749 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:46:40.894018 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:40.894002 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jgl85\"" Jul 01 16:46:40.901366 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:40.901345 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w"] Jul 01 16:46:41.023053 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.023028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.023147 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.023064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.023147 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.023084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7qt\" (UniqueName: \"kubernetes.io/projected/15ade91c-95f6-40f7-8795-4fc3742a649a-kube-api-access-tp7qt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.123650 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.123627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.123738 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.123658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7qt\" (UniqueName: \"kubernetes.io/projected/15ade91c-95f6-40f7-8795-4fc3742a649a-kube-api-access-tp7qt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.123738 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.123720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.123976 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.123962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.124011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.123992 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.135859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.135810 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7qt\" (UniqueName: \"kubernetes.io/projected/15ade91c-95f6-40f7-8795-4fc3742a649a-kube-api-access-tp7qt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.200703 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.200681 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:41.335168 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.335146 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w"] Jul 01 16:46:41.337381 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:46:41.337350 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ade91c_95f6_40f7_8795_4fc3742a649a.slice/crio-9672b3ed80be16ca952bad89341a6cc3368f46300a5eb4c663090354c4ea31d8 WatchSource:0}: Error finding container 9672b3ed80be16ca952bad89341a6cc3368f46300a5eb4c663090354c4ea31d8: Status 404 returned error can't find the container with id 9672b3ed80be16ca952bad89341a6cc3368f46300a5eb4c663090354c4ea31d8 Jul 01 16:46:41.548807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.548771 2575 generic.go:356] "Generic (PLEG): container finished" podID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerID="7fb1b62da9cc0fe643a268d85fd0420e087e22119e402da2c2effdfa5e3109a0" exitCode=0 Jul 01 16:46:41.548928 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.548853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" event={"ID":"15ade91c-95f6-40f7-8795-4fc3742a649a","Type":"ContainerDied","Data":"7fb1b62da9cc0fe643a268d85fd0420e087e22119e402da2c2effdfa5e3109a0"} Jul 01 16:46:41.548928 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.548901 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" event={"ID":"15ade91c-95f6-40f7-8795-4fc3742a649a","Type":"ContainerStarted","Data":"9672b3ed80be16ca952bad89341a6cc3368f46300a5eb4c663090354c4ea31d8"} Jul 01 16:46:41.701981 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.701898 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8"] Jul 01 16:46:41.705574 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.705551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.717491 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.717442 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8"] Jul 01 16:46:41.840330 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.840304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.840449 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.840371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.840449 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.840422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48nh4\" (UniqueName: \"kubernetes.io/projected/16901883-9d61-4452-8920-f408f801f144-kube-api-access-48nh4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.941420 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.941393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.941752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.941439 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48nh4\" (UniqueName: \"kubernetes.io/projected/16901883-9d61-4452-8920-f408f801f144-kube-api-access-48nh4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.941752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.941487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.941886 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.941805 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.941886 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.941834 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:41.955834 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:41.955786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48nh4\" (UniqueName: \"kubernetes.io/projected/16901883-9d61-4452-8920-f408f801f144-kube-api-access-48nh4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:42.014565 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.014547 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:42.163536 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.163508 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8"] Jul 01 16:46:42.166889 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:46:42.166863 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16901883_9d61_4452_8920_f408f801f144.slice/crio-99430d531173ac672b89e29061b655e003f2f9b4e4b30e499b66c3c8ad04adab WatchSource:0}: Error finding container 99430d531173ac672b89e29061b655e003f2f9b4e4b30e499b66c3c8ad04adab: Status 404 returned error can't find the container with id 99430d531173ac672b89e29061b655e003f2f9b4e4b30e499b66c3c8ad04adab Jul 01 16:46:42.295988 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.295962 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn"] Jul 01 16:46:42.299532 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.299516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.312056 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.312031 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn"] Jul 01 16:46:42.445606 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.445569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9fjb\" (UniqueName: \"kubernetes.io/projected/f84dede9-c332-419e-9a42-6b201ef4361b-kube-api-access-l9fjb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.445786 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.445726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.445855 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.445786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.547023 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.546997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9fjb\" (UniqueName: \"kubernetes.io/projected/f84dede9-c332-419e-9a42-6b201ef4361b-kube-api-access-l9fjb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.547107 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.547057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.547107 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.547084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.547397 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.547379 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.547521 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.547408 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.557331 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.557310 2575 generic.go:356] "Generic (PLEG): container finished" podID="16901883-9d61-4452-8920-f408f801f144" containerID="4d2fc169084cc6d6859b171cb42a51d376da2d7625c470114029a1bdc759050b" exitCode=0 Jul 01 16:46:42.557429 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.557400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" event={"ID":"16901883-9d61-4452-8920-f408f801f144","Type":"ContainerDied","Data":"4d2fc169084cc6d6859b171cb42a51d376da2d7625c470114029a1bdc759050b"} Jul 01 16:46:42.557518 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.557477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" event={"ID":"16901883-9d61-4452-8920-f408f801f144","Type":"ContainerStarted","Data":"99430d531173ac672b89e29061b655e003f2f9b4e4b30e499b66c3c8ad04adab"} Jul 01 16:46:42.558883 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.558865 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9fjb\" (UniqueName: \"kubernetes.io/projected/f84dede9-c332-419e-9a42-6b201ef4361b-kube-api-access-l9fjb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.637814 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.637790 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:42.697797 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.697766 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8"] Jul 01 16:46:42.703335 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.703315 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.711340 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.711303 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8"] Jul 01 16:46:42.780849 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.780823 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn"] Jul 01 16:46:42.782730 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:46:42.782710 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84dede9_c332_419e_9a42_6b201ef4361b.slice/crio-6cd82f0cd18f3a8d4b29665b74bcf4a7adf16c709c94c29acef92f268e537a3d WatchSource:0}: Error finding container 6cd82f0cd18f3a8d4b29665b74bcf4a7adf16c709c94c29acef92f268e537a3d: Status 404 returned error can't find the container with id 6cd82f0cd18f3a8d4b29665b74bcf4a7adf16c709c94c29acef92f268e537a3d Jul 01 16:46:42.849427 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.849408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.849549 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.849449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.849549 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.849489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5h66\" (UniqueName: \"kubernetes.io/projected/6c54dcdf-606c-438d-ada9-d73dc1eebac0-kube-api-access-w5h66\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.950854 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.950819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.951243 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.950869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.951243 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.950892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5h66\" (UniqueName: \"kubernetes.io/projected/6c54dcdf-606c-438d-ada9-d73dc1eebac0-kube-api-access-w5h66\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.951243 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.951161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.951243 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.951229 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:42.960123 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:42.960103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5h66\" (UniqueName: \"kubernetes.io/projected/6c54dcdf-606c-438d-ada9-d73dc1eebac0-kube-api-access-w5h66\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:43.021099 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.021076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:43.150823 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.150795 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8"] Jul 01 16:46:43.152374 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:46:43.152348 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c54dcdf_606c_438d_ada9_d73dc1eebac0.slice/crio-102ee4810693abfd13af47d55fafa77316eac1db0de0d736107510532407350c WatchSource:0}: Error finding container 102ee4810693abfd13af47d55fafa77316eac1db0de0d736107510532407350c: Status 404 returned error can't find the container with id 102ee4810693abfd13af47d55fafa77316eac1db0de0d736107510532407350c Jul 01 16:46:43.565061 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.565034 2575 generic.go:356] "Generic (PLEG): container finished" podID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerID="eb77ecff7a667028721d04089090453ebb9635247b30956415efdf35f28bf2b5" exitCode=0 Jul 01 16:46:43.565154 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.565117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" event={"ID":"15ade91c-95f6-40f7-8795-4fc3742a649a","Type":"ContainerDied","Data":"eb77ecff7a667028721d04089090453ebb9635247b30956415efdf35f28bf2b5"} Jul 01 16:46:43.566665 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.566641 2575 generic.go:356] "Generic (PLEG): container finished" podID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerID="a149690f4ba33f0eb644e55904e5c7e92bbd3af3c38c748d92309cb7802f98b2" exitCode=0 Jul 01 16:46:43.566754 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.566713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" event={"ID":"6c54dcdf-606c-438d-ada9-d73dc1eebac0","Type":"ContainerDied","Data":"a149690f4ba33f0eb644e55904e5c7e92bbd3af3c38c748d92309cb7802f98b2"} Jul 01 16:46:43.566820 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.566763 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" event={"ID":"6c54dcdf-606c-438d-ada9-d73dc1eebac0","Type":"ContainerStarted","Data":"102ee4810693abfd13af47d55fafa77316eac1db0de0d736107510532407350c"} Jul 01 16:46:43.568209 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.568188 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84dede9-c332-419e-9a42-6b201ef4361b" containerID="530f4fe74964eb8d33e7727dd7d89520fb931bb168bfa1bd352fd868e270a5af" exitCode=0 Jul 01 16:46:43.568290 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.568265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" event={"ID":"f84dede9-c332-419e-9a42-6b201ef4361b","Type":"ContainerDied","Data":"530f4fe74964eb8d33e7727dd7d89520fb931bb168bfa1bd352fd868e270a5af"} Jul 01 16:46:43.568345 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:43.568307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" event={"ID":"f84dede9-c332-419e-9a42-6b201ef4361b","Type":"ContainerStarted","Data":"6cd82f0cd18f3a8d4b29665b74bcf4a7adf16c709c94c29acef92f268e537a3d"} Jul 01 16:46:44.575413 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:44.575371 2575 generic.go:356] "Generic (PLEG): container finished" podID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerID="f4bde0d347747bc5f297cef715a07957e000bddccaa4a8cb025fc914a9f0ca80" exitCode=0 Jul 01 16:46:44.575825 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:44.575427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" event={"ID":"6c54dcdf-606c-438d-ada9-d73dc1eebac0","Type":"ContainerDied","Data":"f4bde0d347747bc5f297cef715a07957e000bddccaa4a8cb025fc914a9f0ca80"} Jul 01 16:46:44.577486 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:44.577438 2575 generic.go:356] "Generic (PLEG): container finished" podID="16901883-9d61-4452-8920-f408f801f144" containerID="03cb42ac1563666bb6a80cca1acb83e5107263800470876c73750077b65062ab" exitCode=0 Jul 01 16:46:44.577624 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:44.577491 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" event={"ID":"16901883-9d61-4452-8920-f408f801f144","Type":"ContainerDied","Data":"03cb42ac1563666bb6a80cca1acb83e5107263800470876c73750077b65062ab"} Jul 01 16:46:44.579746 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:44.579721 2575 generic.go:356] "Generic (PLEG): container finished" podID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerID="10282c0f20ae059a6250af5fe8a7f856a5e5ea60abe2ac525554efcf1e4583e5" exitCode=0 Jul 01 16:46:44.579862 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:44.579743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" event={"ID":"15ade91c-95f6-40f7-8795-4fc3742a649a","Type":"ContainerDied","Data":"10282c0f20ae059a6250af5fe8a7f856a5e5ea60abe2ac525554efcf1e4583e5"} Jul 01 16:46:45.587666 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.587576 2575 generic.go:356] "Generic (PLEG): container finished" podID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerID="d4aaf8f48060576d42d43aa1beaf1051497d4987f0f9ecfe76a88161f5e4e2fc" exitCode=0 Jul 01 16:46:45.588050 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.587665 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" event={"ID":"6c54dcdf-606c-438d-ada9-d73dc1eebac0","Type":"ContainerDied","Data":"d4aaf8f48060576d42d43aa1beaf1051497d4987f0f9ecfe76a88161f5e4e2fc"} Jul 01 16:46:45.589754 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.589728 2575 generic.go:356] "Generic (PLEG): container finished" podID="16901883-9d61-4452-8920-f408f801f144" containerID="80f5444169994a1a0993bb4a034dc30d27dfe041c10d3f5eeb75ba52ecd3b183" exitCode=0 Jul 01 16:46:45.589879 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.589789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" event={"ID":"16901883-9d61-4452-8920-f408f801f144","Type":"ContainerDied","Data":"80f5444169994a1a0993bb4a034dc30d27dfe041c10d3f5eeb75ba52ecd3b183"} Jul 01 16:46:45.591482 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.591445 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84dede9-c332-419e-9a42-6b201ef4361b" containerID="2ed32618f4f395feca0d01889b0aeb2bc650e80a56c7f89c5291e544f7b774f3" exitCode=0 Jul 01 16:46:45.591570 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.591480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" event={"ID":"f84dede9-c332-419e-9a42-6b201ef4361b","Type":"ContainerDied","Data":"2ed32618f4f395feca0d01889b0aeb2bc650e80a56c7f89c5291e544f7b774f3"} Jul 01 16:46:45.732240 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.732211 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:45.876296 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.876274 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp7qt\" (UniqueName: \"kubernetes.io/projected/15ade91c-95f6-40f7-8795-4fc3742a649a-kube-api-access-tp7qt\") pod \"15ade91c-95f6-40f7-8795-4fc3742a649a\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " Jul 01 16:46:45.876423 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.876354 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-util\") pod \"15ade91c-95f6-40f7-8795-4fc3742a649a\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " Jul 01 16:46:45.876423 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.876399 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-bundle\") pod \"15ade91c-95f6-40f7-8795-4fc3742a649a\" (UID: \"15ade91c-95f6-40f7-8795-4fc3742a649a\") " Jul 01 16:46:45.876895 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.876852 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-bundle" (OuterVolumeSpecName: "bundle") pod "15ade91c-95f6-40f7-8795-4fc3742a649a" (UID: "15ade91c-95f6-40f7-8795-4fc3742a649a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:45.878393 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.878370 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ade91c-95f6-40f7-8795-4fc3742a649a-kube-api-access-tp7qt" (OuterVolumeSpecName: "kube-api-access-tp7qt") pod "15ade91c-95f6-40f7-8795-4fc3742a649a" (UID: "15ade91c-95f6-40f7-8795-4fc3742a649a"). InnerVolumeSpecName "kube-api-access-tp7qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:46:45.881713 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.881692 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-util" (OuterVolumeSpecName: "util") pod "15ade91c-95f6-40f7-8795-4fc3742a649a" (UID: "15ade91c-95f6-40f7-8795-4fc3742a649a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:45.977261 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.977237 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:45.977261 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.977260 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp7qt\" (UniqueName: \"kubernetes.io/projected/15ade91c-95f6-40f7-8795-4fc3742a649a-kube-api-access-tp7qt\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:45.977384 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:45.977270 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ade91c-95f6-40f7-8795-4fc3742a649a-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:46.598197 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.598113 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" Jul 01 16:46:46.598197 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.598137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w" event={"ID":"15ade91c-95f6-40f7-8795-4fc3742a649a","Type":"ContainerDied","Data":"9672b3ed80be16ca952bad89341a6cc3368f46300a5eb4c663090354c4ea31d8"} Jul 01 16:46:46.598197 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.598180 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9672b3ed80be16ca952bad89341a6cc3368f46300a5eb4c663090354c4ea31d8" Jul 01 16:46:46.600159 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.600135 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84dede9-c332-419e-9a42-6b201ef4361b" containerID="2c476b98627bcc4a6ddf3493a4a805f6787da623a62b0ae4823339f265014bd1" exitCode=0 Jul 01 16:46:46.600276 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.600202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" event={"ID":"f84dede9-c332-419e-9a42-6b201ef4361b","Type":"ContainerDied","Data":"2c476b98627bcc4a6ddf3493a4a805f6787da623a62b0ae4823339f265014bd1"} Jul 01 16:46:46.759662 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.759637 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:46.761723 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.761705 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:46.886116 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886092 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-bundle\") pod \"16901883-9d61-4452-8920-f408f801f144\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " Jul 01 16:46:46.886291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886124 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5h66\" (UniqueName: \"kubernetes.io/projected/6c54dcdf-606c-438d-ada9-d73dc1eebac0-kube-api-access-w5h66\") pod \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " Jul 01 16:46:46.886291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886157 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-util\") pod \"16901883-9d61-4452-8920-f408f801f144\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " Jul 01 16:46:46.886291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886191 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48nh4\" (UniqueName: \"kubernetes.io/projected/16901883-9d61-4452-8920-f408f801f144-kube-api-access-48nh4\") pod \"16901883-9d61-4452-8920-f408f801f144\" (UID: \"16901883-9d61-4452-8920-f408f801f144\") " Jul 01 16:46:46.886291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886221 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-bundle\") pod \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " Jul 01 16:46:46.886291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886245 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-util\") pod \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\" (UID: \"6c54dcdf-606c-438d-ada9-d73dc1eebac0\") " Jul 01 16:46:46.886887 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886858 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-bundle" (OuterVolumeSpecName: "bundle") pod "16901883-9d61-4452-8920-f408f801f144" (UID: "16901883-9d61-4452-8920-f408f801f144"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:46.886976 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.886942 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-bundle" (OuterVolumeSpecName: "bundle") pod "6c54dcdf-606c-438d-ada9-d73dc1eebac0" (UID: "6c54dcdf-606c-438d-ada9-d73dc1eebac0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:46.888306 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.888280 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c54dcdf-606c-438d-ada9-d73dc1eebac0-kube-api-access-w5h66" (OuterVolumeSpecName: "kube-api-access-w5h66") pod "6c54dcdf-606c-438d-ada9-d73dc1eebac0" (UID: "6c54dcdf-606c-438d-ada9-d73dc1eebac0"). InnerVolumeSpecName "kube-api-access-w5h66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:46:46.888412 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.888312 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16901883-9d61-4452-8920-f408f801f144-kube-api-access-48nh4" (OuterVolumeSpecName: "kube-api-access-48nh4") pod "16901883-9d61-4452-8920-f408f801f144" (UID: "16901883-9d61-4452-8920-f408f801f144"). InnerVolumeSpecName "kube-api-access-48nh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:46:46.895164 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.895132 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-util" (OuterVolumeSpecName: "util") pod "16901883-9d61-4452-8920-f408f801f144" (UID: "16901883-9d61-4452-8920-f408f801f144"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:46.895314 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.895284 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-util" (OuterVolumeSpecName: "util") pod "6c54dcdf-606c-438d-ada9-d73dc1eebac0" (UID: "6c54dcdf-606c-438d-ada9-d73dc1eebac0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:46.987941 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.987913 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:46.987941 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.987942 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48nh4\" (UniqueName: \"kubernetes.io/projected/16901883-9d61-4452-8920-f408f801f144-kube-api-access-48nh4\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:46.988096 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.987952 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:46.988096 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.987961 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c54dcdf-606c-438d-ada9-d73dc1eebac0-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:46.988096 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.987968 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16901883-9d61-4452-8920-f408f801f144-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:46.988096 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:46.987976 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5h66\" (UniqueName: \"kubernetes.io/projected/6c54dcdf-606c-438d-ada9-d73dc1eebac0-kube-api-access-w5h66\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:47.593878 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.593794 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:47.593878 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.593848 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:47.598638 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.598616 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:47.607301 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.607279 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" Jul 01 16:46:47.607301 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.607293 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8" event={"ID":"6c54dcdf-606c-438d-ada9-d73dc1eebac0","Type":"ContainerDied","Data":"102ee4810693abfd13af47d55fafa77316eac1db0de0d736107510532407350c"} Jul 01 16:46:47.607494 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.607325 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="102ee4810693abfd13af47d55fafa77316eac1db0de0d736107510532407350c" Jul 01 16:46:47.609370 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.609329 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" Jul 01 16:46:47.609370 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.609357 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8" event={"ID":"16901883-9d61-4452-8920-f408f801f144","Type":"ContainerDied","Data":"99430d531173ac672b89e29061b655e003f2f9b4e4b30e499b66c3c8ad04adab"} Jul 01 16:46:47.609563 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.609410 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99430d531173ac672b89e29061b655e003f2f9b4e4b30e499b66c3c8ad04adab" Jul 01 16:46:47.614543 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.614524 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-588b695df9-ppr2d" Jul 01 16:46:47.688428 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.688394 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b4fd98bf-dpzn8"] Jul 01 16:46:47.762946 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.762923 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:47.811140 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.811098 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:47.897446 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.897418 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9fjb\" (UniqueName: \"kubernetes.io/projected/f84dede9-c332-419e-9a42-6b201ef4361b-kube-api-access-l9fjb\") pod \"f84dede9-c332-419e-9a42-6b201ef4361b\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " Jul 01 16:46:47.897642 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.897538 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-bundle\") pod \"f84dede9-c332-419e-9a42-6b201ef4361b\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " Jul 01 16:46:47.897642 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.897581 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-util\") pod \"f84dede9-c332-419e-9a42-6b201ef4361b\" (UID: \"f84dede9-c332-419e-9a42-6b201ef4361b\") " Jul 01 16:46:47.898084 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.898059 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-bundle" (OuterVolumeSpecName: "bundle") pod "f84dede9-c332-419e-9a42-6b201ef4361b" (UID: "f84dede9-c332-419e-9a42-6b201ef4361b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:47.899595 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.899511 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f84dede9-c332-419e-9a42-6b201ef4361b-kube-api-access-l9fjb" (OuterVolumeSpecName: "kube-api-access-l9fjb") pod "f84dede9-c332-419e-9a42-6b201ef4361b" (UID: "f84dede9-c332-419e-9a42-6b201ef4361b"). InnerVolumeSpecName "kube-api-access-l9fjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:46:47.903325 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.903306 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-util" (OuterVolumeSpecName: "util") pod "f84dede9-c332-419e-9a42-6b201ef4361b" (UID: "f84dede9-c332-419e-9a42-6b201ef4361b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:46:47.998637 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.998601 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:47.998637 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.998630 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f84dede9-c332-419e-9a42-6b201ef4361b-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:47.998637 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:47.998639 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9fjb\" (UniqueName: \"kubernetes.io/projected/f84dede9-c332-419e-9a42-6b201ef4361b-kube-api-access-l9fjb\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:46:48.000877 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:48.000848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:48.398915 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:48.398880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:48.621657 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:48.621626 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" Jul 01 16:46:48.621657 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:48.621645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn" event={"ID":"f84dede9-c332-419e-9a42-6b201ef4361b","Type":"ContainerDied","Data":"6cd82f0cd18f3a8d4b29665b74bcf4a7adf16c709c94c29acef92f268e537a3d"} Jul 01 16:46:48.622172 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:48.621714 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cd82f0cd18f3a8d4b29665b74bcf4a7adf16c709c94c29acef92f268e537a3d" Jul 01 16:46:49.951523 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:49.951488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:50.025231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:50.025197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:54.171434 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:54.171393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:55.083009 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:55.082975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:59.596771 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:46:59.596728 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:01.626951 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:01.626917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:02.600722 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:02.600687 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:03.436293 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:03.436260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:05.588753 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:05.588717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:06.037049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:06.036992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:09.233341 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:09.233307 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:11.196796 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:11.196748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:11.308435 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:11.308405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:11.629679 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:11.629643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:11.721399 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:11.721371 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:12.714138 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:12.714071 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68b4fd98bf-dpzn8" podUID="b4304157-158f-445e-ab42-68c3e64f8a1f" containerName="console" containerID="cri-o://a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9" gracePeriod=15 Jul 01 16:47:12.968069 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:12.968011 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:47:13.115761 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.115732 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-console-config\") pod \"b4304157-158f-445e-ab42-68c3e64f8a1f\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " Jul 01 16:47:13.115917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.115771 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-oauth-config\") pod \"b4304157-158f-445e-ab42-68c3e64f8a1f\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " Jul 01 16:47:13.115917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.115830 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxqn6\" (UniqueName: \"kubernetes.io/projected/b4304157-158f-445e-ab42-68c3e64f8a1f-kube-api-access-gxqn6\") pod \"b4304157-158f-445e-ab42-68c3e64f8a1f\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " Jul 01 16:47:13.115917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.115860 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-service-ca\") pod \"b4304157-158f-445e-ab42-68c3e64f8a1f\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " Jul 01 16:47:13.116038 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.115936 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-trusted-ca-bundle\") pod \"b4304157-158f-445e-ab42-68c3e64f8a1f\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " Jul 01 16:47:13.116038 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.115985 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-serving-cert\") pod \"b4304157-158f-445e-ab42-68c3e64f8a1f\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " Jul 01 16:47:13.116038 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116007 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-oauth-serving-cert\") pod \"b4304157-158f-445e-ab42-68c3e64f8a1f\" (UID: \"b4304157-158f-445e-ab42-68c3e64f8a1f\") " Jul 01 16:47:13.116322 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116264 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-console-config" (OuterVolumeSpecName: "console-config") pod "b4304157-158f-445e-ab42-68c3e64f8a1f" (UID: "b4304157-158f-445e-ab42-68c3e64f8a1f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:47:13.116513 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116371 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4304157-158f-445e-ab42-68c3e64f8a1f" (UID: "b4304157-158f-445e-ab42-68c3e64f8a1f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:47:13.116513 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116432 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4304157-158f-445e-ab42-68c3e64f8a1f" (UID: "b4304157-158f-445e-ab42-68c3e64f8a1f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:47:13.116513 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116438 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4304157-158f-445e-ab42-68c3e64f8a1f" (UID: "b4304157-158f-445e-ab42-68c3e64f8a1f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:47:13.116738 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116672 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-console-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:13.116738 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116685 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-service-ca\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:13.116738 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116693 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-trusted-ca-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:13.116738 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.116702 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4304157-158f-445e-ab42-68c3e64f8a1f-oauth-serving-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:13.117979 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.117957 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4304157-158f-445e-ab42-68c3e64f8a1f" (UID: "b4304157-158f-445e-ab42-68c3e64f8a1f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:47:13.118054 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.118008 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4304157-158f-445e-ab42-68c3e64f8a1f" (UID: "b4304157-158f-445e-ab42-68c3e64f8a1f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:47:13.118102 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.118076 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4304157-158f-445e-ab42-68c3e64f8a1f-kube-api-access-gxqn6" (OuterVolumeSpecName: "kube-api-access-gxqn6") pod "b4304157-158f-445e-ab42-68c3e64f8a1f" (UID: "b4304157-158f-445e-ab42-68c3e64f8a1f"). InnerVolumeSpecName "kube-api-access-gxqn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:47:13.217724 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.217698 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-oauth-config\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:13.217724 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.217725 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxqn6\" (UniqueName: \"kubernetes.io/projected/b4304157-158f-445e-ab42-68c3e64f8a1f-kube-api-access-gxqn6\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:13.217876 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.217734 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4304157-158f-445e-ab42-68c3e64f8a1f-console-serving-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:13.766349 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.766316 2575 generic.go:356] "Generic (PLEG): container finished" podID="b4304157-158f-445e-ab42-68c3e64f8a1f" containerID="a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9" exitCode=0 Jul 01 16:47:13.766782 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.766359 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b4fd98bf-dpzn8" Jul 01 16:47:13.766782 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.766405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b4fd98bf-dpzn8" event={"ID":"b4304157-158f-445e-ab42-68c3e64f8a1f","Type":"ContainerDied","Data":"a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9"} Jul 01 16:47:13.766782 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.766471 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b4fd98bf-dpzn8" event={"ID":"b4304157-158f-445e-ab42-68c3e64f8a1f","Type":"ContainerDied","Data":"74d035756e597570ab9a2e1c9283abc5843530dc0914f1854e244be31752d71a"} Jul 01 16:47:13.766782 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.766486 2575 scope.go:117] "RemoveContainer" containerID="a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9" Jul 01 16:47:13.775789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.775775 2575 scope.go:117] "RemoveContainer" containerID="a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9" Jul 01 16:47:13.776061 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:47:13.776043 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9\": container with ID starting with a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9 not found: ID does not exist" containerID="a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9" Jul 01 16:47:13.776123 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.776072 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9"} err="failed to get container status \"a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9\": rpc error: code = NotFound desc = could not find container \"a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9\": container with ID starting with a370c99a126e15a5c82d466d0372e86bdc067bddfd39c8573280e9a00f26aef9 not found: ID does not exist" Jul 01 16:47:13.786915 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.786892 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b4fd98bf-dpzn8"] Jul 01 16:47:13.791642 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:13.791621 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68b4fd98bf-dpzn8"] Jul 01 16:47:15.172311 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:15.172275 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4304157-158f-445e-ab42-68c3e64f8a1f" path="/var/lib/kubelet/pods/b4304157-158f-445e-ab42-68c3e64f8a1f/volumes" Jul 01 16:47:15.416748 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:15.416717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:15.508201 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:15.508122 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:18.415181 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:18.415147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:18.553856 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:18.553817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:19.754482 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:19.750261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:20.145675 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:20.145634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:22.744046 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:22.743994 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:22.844957 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:22.844921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:29.021701 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.021609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd"] Jul 01 16:47:29.022081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022022 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerName="extract" Jul 01 16:47:29.022081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022034 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerName="extract" Jul 01 16:47:29.022081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022045 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16901883-9d61-4452-8920-f408f801f144" containerName="pull" Jul 01 16:47:29.022081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022052 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16901883-9d61-4452-8920-f408f801f144" containerName="pull" Jul 01 16:47:29.022081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022068 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerName="pull" Jul 01 16:47:29.022081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022074 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerName="pull" Jul 01 16:47:29.022081 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022082 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84dede9-c332-419e-9a42-6b201ef4361b" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022087 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84dede9-c332-419e-9a42-6b201ef4361b" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022098 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16901883-9d61-4452-8920-f408f801f144" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022104 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16901883-9d61-4452-8920-f408f801f144" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022112 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84dede9-c332-419e-9a42-6b201ef4361b" containerName="pull" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022117 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84dede9-c332-419e-9a42-6b201ef4361b" containerName="pull" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022126 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84dede9-c332-419e-9a42-6b201ef4361b" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022130 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84dede9-c332-419e-9a42-6b201ef4361b" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022138 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4304157-158f-445e-ab42-68c3e64f8a1f" containerName="console" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022143 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4304157-158f-445e-ab42-68c3e64f8a1f" containerName="console" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022151 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022155 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022161 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022167 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022175 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerName="pull" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022179 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerName="pull" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022186 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16901883-9d61-4452-8920-f408f801f144" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022190 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16901883-9d61-4452-8920-f408f801f144" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022197 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022201 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerName="util" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022254 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ade91c-95f6-40f7-8795-4fc3742a649a" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022260 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4304157-158f-445e-ab42-68c3e64f8a1f" containerName="console" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022267 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c54dcdf-606c-438d-ada9-d73dc1eebac0" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022272 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84dede9-c332-419e-9a42-6b201ef4361b" containerName="extract" Jul 01 16:47:29.022334 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.022277 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="16901883-9d61-4452-8920-f408f801f144" containerName="extract" Jul 01 16:47:29.026681 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.026664 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.029742 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.029720 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:47:29.029841 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.029765 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:47:29.030013 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.029998 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n68tt\"" Jul 01 16:47:29.038622 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.038593 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd"] Jul 01 16:47:29.159092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.159053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.159259 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.159109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpbhr\" (UniqueName: \"kubernetes.io/projected/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-kube-api-access-dpbhr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.260538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.260499 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.260538 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.260547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpbhr\" (UniqueName: \"kubernetes.io/projected/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-kube-api-access-dpbhr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.260964 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.260935 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.274860 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.274786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpbhr\" (UniqueName: \"kubernetes.io/projected/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-kube-api-access-dpbhr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.337643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.337598 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:29.475962 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.475933 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd"] Jul 01 16:47:29.478315 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:47:29.478289 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd8d0fe_3a96_4168_a6e3_5bc8914daf0d.slice/crio-d6531591231d5695d2ae6d551dd2def40aecfccf04ec6a78899ec0fa65f8368b WatchSource:0}: Error finding container d6531591231d5695d2ae6d551dd2def40aecfccf04ec6a78899ec0fa65f8368b: Status 404 returned error can't find the container with id d6531591231d5695d2ae6d551dd2def40aecfccf04ec6a78899ec0fa65f8368b Jul 01 16:47:29.831936 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.831896 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd"] Jul 01 16:47:29.839434 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.839404 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd"] Jul 01 16:47:29.860485 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.860423 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl"] Jul 01 16:47:29.865503 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.865476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:29.880762 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.880732 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl"] Jul 01 16:47:29.966980 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.966944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9239bf5-07c7-4fe4-ba06-73a49ecab937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zn2jl\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:29.967152 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:29.967027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4xcg\" (UniqueName: \"kubernetes.io/projected/e9239bf5-07c7-4fe4-ba06-73a49ecab937-kube-api-access-n4xcg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zn2jl\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:30.067683 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.067641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9239bf5-07c7-4fe4-ba06-73a49ecab937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zn2jl\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:30.068053 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.067732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xcg\" (UniqueName: \"kubernetes.io/projected/e9239bf5-07c7-4fe4-ba06-73a49ecab937-kube-api-access-n4xcg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zn2jl\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:30.068053 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.068010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9239bf5-07c7-4fe4-ba06-73a49ecab937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zn2jl\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:30.077325 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.077291 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4xcg\" (UniqueName: \"kubernetes.io/projected/e9239bf5-07c7-4fe4-ba06-73a49ecab937-kube-api-access-n4xcg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zn2jl\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:30.180103 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.180055 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:30.336235 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.336169 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl"] Jul 01 16:47:30.338871 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:47:30.338825 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9239bf5_07c7_4fe4_ba06_73a49ecab937.slice/crio-8d8febd71d6be650d4916b5a99dd0b9f4bf9c45025fc5c7a208e944568a0bb30 WatchSource:0}: Error finding container 8d8febd71d6be650d4916b5a99dd0b9f4bf9c45025fc5c7a208e944568a0bb30: Status 404 returned error can't find the container with id 8d8febd71d6be650d4916b5a99dd0b9f4bf9c45025fc5c7a208e944568a0bb30 Jul 01 16:47:30.600758 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.600650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:30.707584 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.707550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:30.869702 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:30.869618 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" event={"ID":"e9239bf5-07c7-4fe4-ba06-73a49ecab937","Type":"ContainerStarted","Data":"8d8febd71d6be650d4916b5a99dd0b9f4bf9c45025fc5c7a208e944568a0bb30"} Jul 01 16:47:31.002313 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:31.002279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:31.139750 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:31.139719 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:31.355311 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:31.355275 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:31.464413 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:31.464329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:34.587579 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:34.587546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:34.759934 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:34.759911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:34.896170 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:34.896134 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" containerName="manager" containerID="cri-o://834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86" gracePeriod=2 Jul 01 16:47:34.897905 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:34.897882 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" event={"ID":"e9239bf5-07c7-4fe4-ba06-73a49ecab937","Type":"ContainerStarted","Data":"2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1"} Jul 01 16:47:34.898048 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:34.897934 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:34.920216 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:34.920178 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" podStartSLOduration=1.511204802 podStartE2EDuration="5.920166487s" totalImagesPullingTime="4.408961685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:34.918424788 +0000 UTC m=+538.393492821" watchObservedRunningTime="2026-07-01 16:47:34.920166487 +0000 UTC m=+538.395234520" Jul 01 16:47:35.140175 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.140148 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:35.143139 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:47:35.143114 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" is forbidden: User \"system:node:ip-10-0-143-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-15.ec2.internal' and this object" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:35.220217 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.220141 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpbhr\" (UniqueName: \"kubernetes.io/projected/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-kube-api-access-dpbhr\") pod \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " Jul 01 16:47:35.220217 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.220179 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-extensions-socket-volume\") pod \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\" (UID: \"9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d\") " Jul 01 16:47:35.220497 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.220476 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" (UID: "9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:47:35.222187 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.222167 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-kube-api-access-dpbhr" (OuterVolumeSpecName: "kube-api-access-dpbhr") pod "9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" (UID: "9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d"). InnerVolumeSpecName "kube-api-access-dpbhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:47:35.320997 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.320960 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpbhr\" (UniqueName: \"kubernetes.io/projected/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-kube-api-access-dpbhr\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:35.320997 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.320994 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d-extensions-socket-volume\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:35.904765 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.904730 2575 generic.go:356] "Generic (PLEG): container finished" podID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" containerID="834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86" exitCode=2 Jul 01 16:47:35.905251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.904779 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:35.905251 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.904828 2575 scope.go:117] "RemoveContainer" containerID="834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86" Jul 01 16:47:35.914993 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.914976 2575 scope.go:117] "RemoveContainer" containerID="834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86" Jul 01 16:47:35.915273 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:47:35.915254 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86\": container with ID starting with 834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86 not found: ID does not exist" containerID="834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86" Jul 01 16:47:35.915330 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:35.915282 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86"} err="failed to get container status \"834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86\": rpc error: code = NotFound desc = could not find container \"834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86\": container with ID starting with 834dd9c398d3bcd5ffe3a53ced5aa34bee49480ac615931646481bb7574b6d86 not found: ID does not exist" Jul 01 16:47:35.916776 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:47:35.916751 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" is forbidden: User \"system:node:ip-10-0-143-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-15.ec2.internal' and this object" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:37.172403 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:47:37.172370 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cjmqd\" is forbidden: User \"system:node:ip-10-0-143-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-15.ec2.internal' and this object" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cjmqd" Jul 01 16:47:37.173147 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:37.173128 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" path="/var/lib/kubelet/pods/9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d/volumes" Jul 01 16:47:37.202667 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:37.202641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:37.302282 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:37.302250 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:43.793310 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:43.793274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:43.871431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:43.871398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:45.907378 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:45.907346 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:46.231499 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.231450 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b"] Jul 01 16:47:46.231863 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.231851 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" containerName="manager" Jul 01 16:47:46.231920 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.231865 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" containerName="manager" Jul 01 16:47:46.231955 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.231934 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd8d0fe-3a96-4168-a6e3-5bc8914daf0d" containerName="manager" Jul 01 16:47:46.236603 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.236581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.248421 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.248387 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b"] Jul 01 16:47:46.320024 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.319988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5caa6e2-bb4d-4e7f-bbca-a865386a1b42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tfm7b\" (UID: \"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.320196 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.320094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f87jw\" (UniqueName: \"kubernetes.io/projected/c5caa6e2-bb4d-4e7f-bbca-a865386a1b42-kube-api-access-f87jw\") pod \"kuadrant-operator-controller-manager-86878c769f-tfm7b\" (UID: \"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.421636 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.421599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f87jw\" (UniqueName: \"kubernetes.io/projected/c5caa6e2-bb4d-4e7f-bbca-a865386a1b42-kube-api-access-f87jw\") pod \"kuadrant-operator-controller-manager-86878c769f-tfm7b\" (UID: \"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.421829 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.421653 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5caa6e2-bb4d-4e7f-bbca-a865386a1b42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tfm7b\" (UID: \"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.422025 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.422005 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5caa6e2-bb4d-4e7f-bbca-a865386a1b42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tfm7b\" (UID: \"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.446059 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.446026 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f87jw\" (UniqueName: \"kubernetes.io/projected/c5caa6e2-bb4d-4e7f-bbca-a865386a1b42-kube-api-access-f87jw\") pod \"kuadrant-operator-controller-manager-86878c769f-tfm7b\" (UID: \"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.547867 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.547770 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.699521 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:47:46.699491 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5caa6e2_bb4d_4e7f_bbca_a865386a1b42.slice/crio-2aba407ac71188af9d47e270b71f40f6b13a6c84901a852322859ffdfc18e97a WatchSource:0}: Error finding container 2aba407ac71188af9d47e270b71f40f6b13a6c84901a852322859ffdfc18e97a: Status 404 returned error can't find the container with id 2aba407ac71188af9d47e270b71f40f6b13a6c84901a852322859ffdfc18e97a Jul 01 16:47:46.705414 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.705386 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b"] Jul 01 16:47:46.969369 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.969333 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" event={"ID":"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42","Type":"ContainerStarted","Data":"0d8150b7c176723a1143fffd44dbe599ef7a84d83cb50b73514d52a4db3f91eb"} Jul 01 16:47:46.969975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.969389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" event={"ID":"c5caa6e2-bb4d-4e7f-bbca-a865386a1b42","Type":"ContainerStarted","Data":"2aba407ac71188af9d47e270b71f40f6b13a6c84901a852322859ffdfc18e97a"} Jul 01 16:47:46.969975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.969495 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:46.998187 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:46.998128 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" podStartSLOduration=0.998110493 podStartE2EDuration="998.110493ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:46.995589745 +0000 UTC m=+550.470657778" watchObservedRunningTime="2026-07-01 16:47:46.998110493 +0000 UTC m=+550.473178602" Jul 01 16:47:54.428750 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:54.428722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:54.552975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:54.552941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:57.977224 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:57.977191 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tfm7b" Jul 01 16:47:58.041635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.041596 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl"] Jul 01 16:47:58.041848 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.041825 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" podUID="e9239bf5-07c7-4fe4-ba06-73a49ecab937" containerName="manager" containerID="cri-o://2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1" gracePeriod=10 Jul 01 16:47:58.313371 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.313345 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:58.432657 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.432624 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9239bf5-07c7-4fe4-ba06-73a49ecab937-extensions-socket-volume\") pod \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " Jul 01 16:47:58.432876 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.432735 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4xcg\" (UniqueName: \"kubernetes.io/projected/e9239bf5-07c7-4fe4-ba06-73a49ecab937-kube-api-access-n4xcg\") pod \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\" (UID: \"e9239bf5-07c7-4fe4-ba06-73a49ecab937\") " Jul 01 16:47:58.433026 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.433002 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9239bf5-07c7-4fe4-ba06-73a49ecab937-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e9239bf5-07c7-4fe4-ba06-73a49ecab937" (UID: "e9239bf5-07c7-4fe4-ba06-73a49ecab937"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:47:58.434808 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.434782 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9239bf5-07c7-4fe4-ba06-73a49ecab937-kube-api-access-n4xcg" (OuterVolumeSpecName: "kube-api-access-n4xcg") pod "e9239bf5-07c7-4fe4-ba06-73a49ecab937" (UID: "e9239bf5-07c7-4fe4-ba06-73a49ecab937"). InnerVolumeSpecName "kube-api-access-n4xcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:47:58.534044 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.534008 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4xcg\" (UniqueName: \"kubernetes.io/projected/e9239bf5-07c7-4fe4-ba06-73a49ecab937-kube-api-access-n4xcg\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:58.534044 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:58.534040 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9239bf5-07c7-4fe4-ba06-73a49ecab937-extensions-socket-volume\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:47:59.040411 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.040377 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9239bf5-07c7-4fe4-ba06-73a49ecab937" containerID="2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1" exitCode=0 Jul 01 16:47:59.040909 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.040432 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" Jul 01 16:47:59.040909 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.040478 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" event={"ID":"e9239bf5-07c7-4fe4-ba06-73a49ecab937","Type":"ContainerDied","Data":"2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1"} Jul 01 16:47:59.040909 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.040530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl" event={"ID":"e9239bf5-07c7-4fe4-ba06-73a49ecab937","Type":"ContainerDied","Data":"8d8febd71d6be650d4916b5a99dd0b9f4bf9c45025fc5c7a208e944568a0bb30"} Jul 01 16:47:59.040909 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.040554 2575 scope.go:117] "RemoveContainer" containerID="2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1" Jul 01 16:47:59.056068 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.055953 2575 scope.go:117] "RemoveContainer" containerID="2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1" Jul 01 16:47:59.056227 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:47:59.056208 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1\": container with ID starting with 2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1 not found: ID does not exist" containerID="2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1" Jul 01 16:47:59.056272 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.056235 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1"} err="failed to get container status \"2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1\": rpc error: code = NotFound desc = could not find container \"2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1\": container with ID starting with 2d5260ad3606a1c97b24e67a7dc4edd45256d1bbb61cb6741581601fcd291af1 not found: ID does not exist" Jul 01 16:47:59.079951 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.079918 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl"] Jul 01 16:47:59.088693 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.088665 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zn2jl"] Jul 01 16:47:59.172697 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:47:59.172664 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9239bf5-07c7-4fe4-ba06-73a49ecab937" path="/var/lib/kubelet/pods/e9239bf5-07c7-4fe4-ba06-73a49ecab937/volumes" Jul 01 16:48:02.386393 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:02.386358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:02.507342 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:02.507306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:14.913139 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:14.913101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:15.031569 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.031534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:15.131144 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.131110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:15.383624 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.383594 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:48:15.384001 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.383986 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9239bf5-07c7-4fe4-ba06-73a49ecab937" containerName="manager" Jul 01 16:48:15.384051 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.384002 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9239bf5-07c7-4fe4-ba06-73a49ecab937" containerName="manager" Jul 01 16:48:15.384098 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.384090 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9239bf5-07c7-4fe4-ba06-73a49ecab937" containerName="manager" Jul 01 16:48:15.387756 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.387741 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.393508 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.393485 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 16:48:15.393648 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.393486 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jgl85\"" Jul 01 16:48:15.398274 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.398251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:48:15.438035 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.438006 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:48:15.481349 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.481317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24pzr\" (UniqueName: \"kubernetes.io/projected/cf57c79b-2398-4943-96c7-cb79db3eaf9a-kube-api-access-24pzr\") pod \"limitador-limitador-54d6d988d5-65p9w\" (UID: \"cf57c79b-2398-4943-96c7-cb79db3eaf9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.481476 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.481374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf57c79b-2398-4943-96c7-cb79db3eaf9a-config-file\") pod \"limitador-limitador-54d6d988d5-65p9w\" (UID: \"cf57c79b-2398-4943-96c7-cb79db3eaf9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.581923 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.581890 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24pzr\" (UniqueName: \"kubernetes.io/projected/cf57c79b-2398-4943-96c7-cb79db3eaf9a-kube-api-access-24pzr\") pod \"limitador-limitador-54d6d988d5-65p9w\" (UID: \"cf57c79b-2398-4943-96c7-cb79db3eaf9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.582060 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.581968 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf57c79b-2398-4943-96c7-cb79db3eaf9a-config-file\") pod \"limitador-limitador-54d6d988d5-65p9w\" (UID: \"cf57c79b-2398-4943-96c7-cb79db3eaf9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.582651 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.582629 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf57c79b-2398-4943-96c7-cb79db3eaf9a-config-file\") pod \"limitador-limitador-54d6d988d5-65p9w\" (UID: \"cf57c79b-2398-4943-96c7-cb79db3eaf9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.593382 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.593362 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24pzr\" (UniqueName: \"kubernetes.io/projected/cf57c79b-2398-4943-96c7-cb79db3eaf9a-kube-api-access-24pzr\") pod \"limitador-limitador-54d6d988d5-65p9w\" (UID: \"cf57c79b-2398-4943-96c7-cb79db3eaf9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.698442 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.698380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:15.834898 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.834859 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:48:15.838283 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:48:15.838256 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf57c79b_2398_4943_96c7_cb79db3eaf9a.slice/crio-925422c721cb1c7d3af1f02cad08a4727f1573de808c08eefe9d78af800489a5 WatchSource:0}: Error finding container 925422c721cb1c7d3af1f02cad08a4727f1573de808c08eefe9d78af800489a5: Status 404 returned error can't find the container with id 925422c721cb1c7d3af1f02cad08a4727f1573de808c08eefe9d78af800489a5 Jul 01 16:48:15.903415 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.903383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:15.961679 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:15.961592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:16.005558 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.005525 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6kgs"] Jul 01 16:48:16.008532 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.008516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6kgs" Jul 01 16:48:16.011382 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.011363 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gbs6m\"" Jul 01 16:48:16.016540 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.016522 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6kgs"] Jul 01 16:48:16.085424 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.085395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmtvp\" (UniqueName: \"kubernetes.io/projected/61043072-24c0-4564-8283-6c33e06011ab-kube-api-access-rmtvp\") pod \"authorino-75d556bd77-s6kgs\" (UID: \"61043072-24c0-4564-8283-6c33e06011ab\") " pod="kuadrant-system/authorino-75d556bd77-s6kgs" Jul 01 16:48:16.138381 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.138356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" event={"ID":"cf57c79b-2398-4943-96c7-cb79db3eaf9a","Type":"ContainerStarted","Data":"925422c721cb1c7d3af1f02cad08a4727f1573de808c08eefe9d78af800489a5"} Jul 01 16:48:16.185917 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.185894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmtvp\" (UniqueName: \"kubernetes.io/projected/61043072-24c0-4564-8283-6c33e06011ab-kube-api-access-rmtvp\") pod \"authorino-75d556bd77-s6kgs\" (UID: \"61043072-24c0-4564-8283-6c33e06011ab\") " pod="kuadrant-system/authorino-75d556bd77-s6kgs" Jul 01 16:48:16.196410 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.196382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmtvp\" (UniqueName: \"kubernetes.io/projected/61043072-24c0-4564-8283-6c33e06011ab-kube-api-access-rmtvp\") pod \"authorino-75d556bd77-s6kgs\" (UID: \"61043072-24c0-4564-8283-6c33e06011ab\") " pod="kuadrant-system/authorino-75d556bd77-s6kgs" Jul 01 16:48:16.318840 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.318788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6kgs" Jul 01 16:48:16.456911 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:16.456886 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6kgs"] Jul 01 16:48:16.458530 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:48:16.458505 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61043072_24c0_4564_8283_6c33e06011ab.slice/crio-79a6e695a5c935fd53c1382efd247df24b810b4c27652c653a8b9df0a91dd279 WatchSource:0}: Error finding container 79a6e695a5c935fd53c1382efd247df24b810b4c27652c653a8b9df0a91dd279: Status 404 returned error can't find the container with id 79a6e695a5c935fd53c1382efd247df24b810b4c27652c653a8b9df0a91dd279 Jul 01 16:48:17.146432 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:17.146390 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6kgs" event={"ID":"61043072-24c0-4564-8283-6c33e06011ab","Type":"ContainerStarted","Data":"79a6e695a5c935fd53c1382efd247df24b810b4c27652c653a8b9df0a91dd279"} Jul 01 16:48:21.174253 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:21.174220 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6kgs" event={"ID":"61043072-24c0-4564-8283-6c33e06011ab","Type":"ContainerStarted","Data":"8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d"} Jul 01 16:48:21.175739 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:21.175715 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" event={"ID":"cf57c79b-2398-4943-96c7-cb79db3eaf9a","Type":"ContainerStarted","Data":"ebcb53a4bbbe81ec37557cb197a6d75a4892b07249a23831a5bc153e0798041c"} Jul 01 16:48:21.175859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:21.175835 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:21.193031 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:21.192987 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-s6kgs" podStartSLOduration=2.00970942 podStartE2EDuration="6.192975062s" totalImagesPullingTime="4.183265642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:48:21.192443919 +0000 UTC m=+584.667511954" watchObservedRunningTime="2026-07-01 16:48:21.192975062 +0000 UTC m=+584.668043096" Jul 01 16:48:21.219213 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:21.219160 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" podStartSLOduration=1.423892902 podStartE2EDuration="6.219140032s" totalImagesPullingTime="4.79524713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:48:21.217027826 +0000 UTC m=+584.692095859" watchObservedRunningTime="2026-07-01 16:48:21.219140032 +0000 UTC m=+584.694208067" Jul 01 16:48:32.183411 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:32.183377 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-65p9w" Jul 01 16:48:35.546357 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:35.546325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:37.158779 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:37.158750 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:48:37.159234 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:37.159044 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:48:37.163353 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:37.163330 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:48:37.163506 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:37.163439 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:48:38.137708 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:38.137665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:53.858821 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:53.858773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:54.952311 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:54.952273 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2"] Jul 01 16:48:54.954886 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:54.954869 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:54.957704 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:54.957659 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 16:48:54.957828 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:54.957659 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 16:48:54.958712 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:54.958698 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ndvlp\"" Jul 01 16:48:54.965326 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:54.965305 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2"] Jul 01 16:48:55.113058 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.113029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.113178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.113066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8fv\" (UniqueName: \"kubernetes.io/projected/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-kube-api-access-gp8fv\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.113178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.113086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.214021 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.213962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.214021 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.213995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8fv\" (UniqueName: \"kubernetes.io/projected/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-kube-api-access-gp8fv\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.214021 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.214014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.214410 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.214389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.214410 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.214401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.224704 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.224684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8fv\" (UniqueName: \"kubernetes.io/projected/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-kube-api-access-gp8fv\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.265566 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.265546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:55.403571 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.403541 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2"] Jul 01 16:48:55.404693 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:48:55.404666 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44426d1_839c_4a79_bfe9_d3a7a02aff8c.slice/crio-d51471738e7f2e31bdcc4489b4a0177c7bd3a936ef33fd0ce358c3debc0b93da WatchSource:0}: Error finding container d51471738e7f2e31bdcc4489b4a0177c7bd3a936ef33fd0ce358c3debc0b93da: Status 404 returned error can't find the container with id d51471738e7f2e31bdcc4489b4a0177c7bd3a936ef33fd0ce358c3debc0b93da Jul 01 16:48:55.479051 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:55.478946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:48:56.373472 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:56.373420 2575 generic.go:356] "Generic (PLEG): container finished" podID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerID="f1070fc25b0025fbb7e954b12f7f0db5b0988bb7920a80be80adef61560200e1" exitCode=0 Jul 01 16:48:56.373854 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:56.373503 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" event={"ID":"c44426d1-839c-4a79-bfe9-d3a7a02aff8c","Type":"ContainerDied","Data":"f1070fc25b0025fbb7e954b12f7f0db5b0988bb7920a80be80adef61560200e1"} Jul 01 16:48:56.373854 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:56.373553 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" event={"ID":"c44426d1-839c-4a79-bfe9-d3a7a02aff8c","Type":"ContainerStarted","Data":"d51471738e7f2e31bdcc4489b4a0177c7bd3a936ef33fd0ce358c3debc0b93da"} Jul 01 16:48:56.374474 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:56.374442 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:48:57.380717 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:57.380687 2575 generic.go:356] "Generic (PLEG): container finished" podID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerID="e384d9d1ffa5b4a8bd1d3665332051ac90fa032213ede03ab0bc6d122d00f22c" exitCode=0 Jul 01 16:48:57.381095 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:57.380774 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" event={"ID":"c44426d1-839c-4a79-bfe9-d3a7a02aff8c","Type":"ContainerDied","Data":"e384d9d1ffa5b4a8bd1d3665332051ac90fa032213ede03ab0bc6d122d00f22c"} Jul 01 16:48:58.388602 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:58.388568 2575 generic.go:356] "Generic (PLEG): container finished" podID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerID="cebbb2262c5afb29ba2318fa5caf539703c1008c83ee5edcd389259a9cd0dd3a" exitCode=0 Jul 01 16:48:58.388969 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:58.388706 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" event={"ID":"c44426d1-839c-4a79-bfe9-d3a7a02aff8c","Type":"ContainerDied","Data":"cebbb2262c5afb29ba2318fa5caf539703c1008c83ee5edcd389259a9cd0dd3a"} Jul 01 16:48:59.532202 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.532177 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:48:59.650695 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.650632 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-util\") pod \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " Jul 01 16:48:59.650695 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.650694 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-bundle\") pod \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " Jul 01 16:48:59.650883 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.650717 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp8fv\" (UniqueName: \"kubernetes.io/projected/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-kube-api-access-gp8fv\") pod \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\" (UID: \"c44426d1-839c-4a79-bfe9-d3a7a02aff8c\") " Jul 01 16:48:59.651195 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.651175 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-bundle" (OuterVolumeSpecName: "bundle") pod "c44426d1-839c-4a79-bfe9-d3a7a02aff8c" (UID: "c44426d1-839c-4a79-bfe9-d3a7a02aff8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:48:59.652839 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.652814 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-kube-api-access-gp8fv" (OuterVolumeSpecName: "kube-api-access-gp8fv") pod "c44426d1-839c-4a79-bfe9-d3a7a02aff8c" (UID: "c44426d1-839c-4a79-bfe9-d3a7a02aff8c"). InnerVolumeSpecName "kube-api-access-gp8fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:48:59.656041 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.656006 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-util" (OuterVolumeSpecName: "util") pod "c44426d1-839c-4a79-bfe9-d3a7a02aff8c" (UID: "c44426d1-839c-4a79-bfe9-d3a7a02aff8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:48:59.751823 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.751801 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-bundle\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:48:59.751823 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.751823 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp8fv\" (UniqueName: \"kubernetes.io/projected/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-kube-api-access-gp8fv\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:48:59.751975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:48:59.751833 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c44426d1-839c-4a79-bfe9-d3a7a02aff8c-util\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:49:00.402662 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:00.402633 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" Jul 01 16:49:00.402821 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:00.402664 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8fwqj2" event={"ID":"c44426d1-839c-4a79-bfe9-d3a7a02aff8c","Type":"ContainerDied","Data":"d51471738e7f2e31bdcc4489b4a0177c7bd3a936ef33fd0ce358c3debc0b93da"} Jul 01 16:49:00.402821 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:00.402706 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d51471738e7f2e31bdcc4489b4a0177c7bd3a936ef33fd0ce358c3debc0b93da" Jul 01 16:49:23.740083 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:23.740050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:49:23.838180 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:23.838154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:49:24.152756 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.152725 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:49:24.153105 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.153093 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerName="extract" Jul 01 16:49:24.153149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.153106 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerName="extract" Jul 01 16:49:24.153149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.153127 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerName="pull" Jul 01 16:49:24.153149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.153133 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerName="pull" Jul 01 16:49:24.153149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.153140 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerName="util" Jul 01 16:49:24.153149 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.153145 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerName="util" Jul 01 16:49:24.153298 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.153209 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c44426d1-839c-4a79-bfe9-d3a7a02aff8c" containerName="extract" Jul 01 16:49:24.156306 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.156291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:24.159049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.159027 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 16:49:24.159049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.159043 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 16:49:24.159189 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.159069 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 16:49:24.160274 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.160259 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-9hrjb\"" Jul 01 16:49:24.167942 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.167920 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:49:24.232641 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.232613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bxrf\" (UniqueName: \"kubernetes.io/projected/a1601249-1483-407b-bda6-ca778d9070ae-kube-api-access-2bxrf\") pod \"maas-keycloak-0\" (UID: \"a1601249-1483-407b-bda6-ca778d9070ae\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:24.333075 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.333052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bxrf\" (UniqueName: \"kubernetes.io/projected/a1601249-1483-407b-bda6-ca778d9070ae-kube-api-access-2bxrf\") pod \"maas-keycloak-0\" (UID: \"a1601249-1483-407b-bda6-ca778d9070ae\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:24.342867 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.342843 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bxrf\" (UniqueName: \"kubernetes.io/projected/a1601249-1483-407b-bda6-ca778d9070ae-kube-api-access-2bxrf\") pod \"maas-keycloak-0\" (UID: \"a1601249-1483-407b-bda6-ca778d9070ae\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:24.466101 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.466046 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:24.595555 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:24.595529 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:49:24.597940 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:49:24.597909 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1601249_1483_407b_bda6_ca778d9070ae.slice/crio-16fd41841157cda51c3573fce088ae401f1bedad0659eff1167c10905b9832db WatchSource:0}: Error finding container 16fd41841157cda51c3573fce088ae401f1bedad0659eff1167c10905b9832db: Status 404 returned error can't find the container with id 16fd41841157cda51c3573fce088ae401f1bedad0659eff1167c10905b9832db Jul 01 16:49:25.546788 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:25.546757 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a1601249-1483-407b-bda6-ca778d9070ae","Type":"ContainerStarted","Data":"16fd41841157cda51c3573fce088ae401f1bedad0659eff1167c10905b9832db"} Jul 01 16:49:31.437617 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:31.437577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:49:31.587495 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:31.587370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a1601249-1483-407b-bda6-ca778d9070ae","Type":"ContainerStarted","Data":"0fba61fe886031a90da4e16963f7b66fa17ea0083da9eeca9d65b12c7e252d79"} Jul 01 16:49:31.609197 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:31.609148 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.963945434 podStartE2EDuration="7.609133456s" totalImagesPullingTime="6.645188022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:49:31.606492967 +0000 UTC m=+655.081561001" watchObservedRunningTime="2026-07-01 16:49:31.609133456 +0000 UTC m=+655.084201517" Jul 01 16:49:32.467084 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:32.467048 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:32.468974 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:32.468940 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:33.467604 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:33.467551 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:34.466769 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:34.466718 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:34.467163 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:34.467125 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:35.466791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:35.466738 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:36.467085 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:36.467040 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:37.467202 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:37.467156 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:38.466943 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:38.466896 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:39.467072 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:39.467034 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:40.467066 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:40.467021 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:41.466998 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:41.466947 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:42.466640 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:42.466573 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Jul 01 16:49:43.566392 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:43.566358 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:43.580175 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:43.580125 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:49:53.572258 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:53.572218 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:49:54.229369 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:54.229339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:49:54.450871 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:54.450839 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:49:56.892955 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:56.892921 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6kgs"] Jul 01 16:49:56.893410 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:56.893146 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-s6kgs" podUID="61043072-24c0-4564-8283-6c33e06011ab" containerName="authorino" containerID="cri-o://8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d" gracePeriod=30 Jul 01 16:49:57.137279 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.137251 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6kgs" Jul 01 16:49:57.267279 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.267193 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmtvp\" (UniqueName: \"kubernetes.io/projected/61043072-24c0-4564-8283-6c33e06011ab-kube-api-access-rmtvp\") pod \"61043072-24c0-4564-8283-6c33e06011ab\" (UID: \"61043072-24c0-4564-8283-6c33e06011ab\") " Jul 01 16:49:57.269322 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.269287 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61043072-24c0-4564-8283-6c33e06011ab-kube-api-access-rmtvp" (OuterVolumeSpecName: "kube-api-access-rmtvp") pod "61043072-24c0-4564-8283-6c33e06011ab" (UID: "61043072-24c0-4564-8283-6c33e06011ab"). InnerVolumeSpecName "kube-api-access-rmtvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:49:57.367813 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.367787 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmtvp\" (UniqueName: \"kubernetes.io/projected/61043072-24c0-4564-8283-6c33e06011ab-kube-api-access-rmtvp\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:49:57.782291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.782258 2575 generic.go:356] "Generic (PLEG): container finished" podID="61043072-24c0-4564-8283-6c33e06011ab" containerID="8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d" exitCode=0 Jul 01 16:49:57.782291 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.782299 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6kgs" Jul 01 16:49:57.782568 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.782347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6kgs" event={"ID":"61043072-24c0-4564-8283-6c33e06011ab","Type":"ContainerDied","Data":"8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d"} Jul 01 16:49:57.782568 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.782399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6kgs" event={"ID":"61043072-24c0-4564-8283-6c33e06011ab","Type":"ContainerDied","Data":"79a6e695a5c935fd53c1382efd247df24b810b4c27652c653a8b9df0a91dd279"} Jul 01 16:49:57.782568 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.782418 2575 scope.go:117] "RemoveContainer" containerID="8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d" Jul 01 16:49:57.791523 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.791502 2575 scope.go:117] "RemoveContainer" containerID="8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d" Jul 01 16:49:57.791804 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:49:57.791786 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d\": container with ID starting with 8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d not found: ID does not exist" containerID="8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d" Jul 01 16:49:57.791851 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.791814 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d"} err="failed to get container status \"8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d\": rpc error: code = NotFound desc = could not find container \"8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d\": container with ID starting with 8733ca8d30ab0d04d006600fe580b526df0a1adcfd7783a970a398ee50c8160d not found: ID does not exist" Jul 01 16:49:57.805583 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.805559 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6kgs"] Jul 01 16:49:57.811278 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:57.811256 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6kgs"] Jul 01 16:49:59.172904 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:49:59.172870 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61043072-24c0-4564-8283-6c33e06011ab" path="/var/lib/kubelet/pods/61043072-24c0-4564-8283-6c33e06011ab/volumes" Jul 01 16:50:01.202682 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.202650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:01.215541 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.215513 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5794555c7c-ffcv2"] Jul 01 16:50:01.215894 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.215883 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61043072-24c0-4564-8283-6c33e06011ab" containerName="authorino" Jul 01 16:50:01.215938 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.215895 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="61043072-24c0-4564-8283-6c33e06011ab" containerName="authorino" Jul 01 16:50:01.215969 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.215956 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="61043072-24c0-4564-8283-6c33e06011ab" containerName="authorino" Jul 01 16:50:01.218386 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.218370 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.221235 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.221214 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 16:50:01.221421 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.221213 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 16:50:01.222363 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.222341 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mpkn5\"" Jul 01 16:50:01.228049 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.228026 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5794555c7c-ffcv2"] Jul 01 16:50:01.299882 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.299848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:01.300996 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.300975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c6ba88e-b815-4b50-99ad-92628b20697a-webhook-cert\") pod \"maas-controller-5794555c7c-ffcv2\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.301110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.301015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvcf\" (UniqueName: \"kubernetes.io/projected/7c6ba88e-b815-4b50-99ad-92628b20697a-kube-api-access-7dvcf\") pod \"maas-controller-5794555c7c-ffcv2\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.377542 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.377493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:01.382329 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.382298 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d5888c769-hrf6f"] Jul 01 16:50:01.387250 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.387229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.395125 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.395051 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d5888c769-hrf6f"] Jul 01 16:50:01.401546 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.401524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c6ba88e-b815-4b50-99ad-92628b20697a-webhook-cert\") pod \"maas-controller-5794555c7c-ffcv2\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.401663 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.401564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvcf\" (UniqueName: \"kubernetes.io/projected/7c6ba88e-b815-4b50-99ad-92628b20697a-kube-api-access-7dvcf\") pod \"maas-controller-5794555c7c-ffcv2\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.401663 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.401589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/863ea4ac-cf83-4788-9160-42237e3b629b-webhook-cert\") pod \"maas-controller-7d5888c769-hrf6f\" (UID: \"863ea4ac-cf83-4788-9160-42237e3b629b\") " pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.401663 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.401619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qb6b\" (UniqueName: \"kubernetes.io/projected/863ea4ac-cf83-4788-9160-42237e3b629b-kube-api-access-5qb6b\") pod \"maas-controller-7d5888c769-hrf6f\" (UID: \"863ea4ac-cf83-4788-9160-42237e3b629b\") " pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.403951 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.403928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c6ba88e-b815-4b50-99ad-92628b20697a-webhook-cert\") pod \"maas-controller-5794555c7c-ffcv2\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.410535 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.410511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvcf\" (UniqueName: \"kubernetes.io/projected/7c6ba88e-b815-4b50-99ad-92628b20697a-kube-api-access-7dvcf\") pod \"maas-controller-5794555c7c-ffcv2\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.443930 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.443902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:01.502751 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.502680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/863ea4ac-cf83-4788-9160-42237e3b629b-webhook-cert\") pod \"maas-controller-7d5888c769-hrf6f\" (UID: \"863ea4ac-cf83-4788-9160-42237e3b629b\") " pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.502751 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.502754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qb6b\" (UniqueName: \"kubernetes.io/projected/863ea4ac-cf83-4788-9160-42237e3b629b-kube-api-access-5qb6b\") pod \"maas-controller-7d5888c769-hrf6f\" (UID: \"863ea4ac-cf83-4788-9160-42237e3b629b\") " pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.504981 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.504962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/863ea4ac-cf83-4788-9160-42237e3b629b-webhook-cert\") pod \"maas-controller-7d5888c769-hrf6f\" (UID: \"863ea4ac-cf83-4788-9160-42237e3b629b\") " pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.514191 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.514171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qb6b\" (UniqueName: \"kubernetes.io/projected/863ea4ac-cf83-4788-9160-42237e3b629b-kube-api-access-5qb6b\") pod \"maas-controller-7d5888c769-hrf6f\" (UID: \"863ea4ac-cf83-4788-9160-42237e3b629b\") " pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.530042 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.530022 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:01.666015 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.665987 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5794555c7c-ffcv2"] Jul 01 16:50:01.667349 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:50:01.667329 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6ba88e_b815_4b50_99ad_92628b20697a.slice/crio-d3df1de24b27cb50656f8863cc2e2898f7f5f94bf1d06c45e236447ce0de8c59 WatchSource:0}: Error finding container d3df1de24b27cb50656f8863cc2e2898f7f5f94bf1d06c45e236447ce0de8c59: Status 404 returned error can't find the container with id d3df1de24b27cb50656f8863cc2e2898f7f5f94bf1d06c45e236447ce0de8c59 Jul 01 16:50:01.699414 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.699390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:01.808875 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.808836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794555c7c-ffcv2" event={"ID":"7c6ba88e-b815-4b50-99ad-92628b20697a","Type":"ContainerStarted","Data":"d3df1de24b27cb50656f8863cc2e2898f7f5f94bf1d06c45e236447ce0de8c59"} Jul 01 16:50:01.843570 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:01.843545 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d5888c769-hrf6f"] Jul 01 16:50:01.844977 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:50:01.844955 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863ea4ac_cf83_4788_9160_42237e3b629b.slice/crio-91d04d8f8678e9c35779c364467dee816b9edeb6509e506383bb5ee276a72b36 WatchSource:0}: Error finding container 91d04d8f8678e9c35779c364467dee816b9edeb6509e506383bb5ee276a72b36: Status 404 returned error can't find the container with id 91d04d8f8678e9c35779c364467dee816b9edeb6509e506383bb5ee276a72b36 Jul 01 16:50:02.822634 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:02.822597 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d5888c769-hrf6f" event={"ID":"863ea4ac-cf83-4788-9160-42237e3b629b","Type":"ContainerStarted","Data":"91d04d8f8678e9c35779c364467dee816b9edeb6509e506383bb5ee276a72b36"} Jul 01 16:50:04.752927 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.752881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:04.839651 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.839553 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794555c7c-ffcv2" event={"ID":"7c6ba88e-b815-4b50-99ad-92628b20697a","Type":"ContainerStarted","Data":"37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e"} Jul 01 16:50:04.839651 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.839622 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:04.841431 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.841405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d5888c769-hrf6f" event={"ID":"863ea4ac-cf83-4788-9160-42237e3b629b","Type":"ContainerStarted","Data":"749f0d5a88bd06ae45530da5992915cc90dcc065407532fc9b95d83856c14260"} Jul 01 16:50:04.841580 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.841491 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:04.845518 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.845491 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:04.862382 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.862336 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5794555c7c-ffcv2" podStartSLOduration=0.983666382 podStartE2EDuration="3.862323956s" totalImagesPullingTime="2.878657574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:50:04.860041566 +0000 UTC m=+688.335109618" watchObservedRunningTime="2026-07-01 16:50:04.862323956 +0000 UTC m=+688.337391989" Jul 01 16:50:04.880364 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:04.880322 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d5888c769-hrf6f" podStartSLOduration=1.167942445 podStartE2EDuration="3.880308855s" totalImagesPullingTime="2.71236641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:50:04.880096319 +0000 UTC m=+688.355164352" watchObservedRunningTime="2026-07-01 16:50:04.880308855 +0000 UTC m=+688.355376887" Jul 01 16:50:07.361199 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:07.361158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:07.461929 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:07.461869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:15.853970 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:15.853936 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d5888c769-hrf6f" Jul 01 16:50:15.854347 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:15.854010 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:15.924059 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:15.924028 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5794555c7c-ffcv2"] Jul 01 16:50:15.924263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:15.924238 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5794555c7c-ffcv2" podUID="7c6ba88e-b815-4b50-99ad-92628b20697a" containerName="manager" containerID="cri-o://37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e" gracePeriod=30 Jul 01 16:50:16.135389 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.135350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:16.169807 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.169787 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:16.233702 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.233671 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dvcf\" (UniqueName: \"kubernetes.io/projected/7c6ba88e-b815-4b50-99ad-92628b20697a-kube-api-access-7dvcf\") pod \"7c6ba88e-b815-4b50-99ad-92628b20697a\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " Jul 01 16:50:16.233851 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.233801 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c6ba88e-b815-4b50-99ad-92628b20697a-webhook-cert\") pod \"7c6ba88e-b815-4b50-99ad-92628b20697a\" (UID: \"7c6ba88e-b815-4b50-99ad-92628b20697a\") " Jul 01 16:50:16.235778 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.235748 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6ba88e-b815-4b50-99ad-92628b20697a-kube-api-access-7dvcf" (OuterVolumeSpecName: "kube-api-access-7dvcf") pod "7c6ba88e-b815-4b50-99ad-92628b20697a" (UID: "7c6ba88e-b815-4b50-99ad-92628b20697a"). InnerVolumeSpecName "kube-api-access-7dvcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:50:16.235876 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.235825 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c6ba88e-b815-4b50-99ad-92628b20697a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7c6ba88e-b815-4b50-99ad-92628b20697a" (UID: "7c6ba88e-b815-4b50-99ad-92628b20697a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:50:16.334609 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.334584 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c6ba88e-b815-4b50-99ad-92628b20697a-webhook-cert\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:50:16.334609 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.334608 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dvcf\" (UniqueName: \"kubernetes.io/projected/7c6ba88e-b815-4b50-99ad-92628b20697a-kube-api-access-7dvcf\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:50:16.910516 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.910487 2575 generic.go:356] "Generic (PLEG): container finished" podID="7c6ba88e-b815-4b50-99ad-92628b20697a" containerID="37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e" exitCode=0 Jul 01 16:50:16.910937 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.910534 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794555c7c-ffcv2" Jul 01 16:50:16.910937 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.910574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794555c7c-ffcv2" event={"ID":"7c6ba88e-b815-4b50-99ad-92628b20697a","Type":"ContainerDied","Data":"37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e"} Jul 01 16:50:16.910937 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.910628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794555c7c-ffcv2" event={"ID":"7c6ba88e-b815-4b50-99ad-92628b20697a","Type":"ContainerDied","Data":"d3df1de24b27cb50656f8863cc2e2898f7f5f94bf1d06c45e236447ce0de8c59"} Jul 01 16:50:16.910937 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.910656 2575 scope.go:117] "RemoveContainer" containerID="37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e" Jul 01 16:50:16.920623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.920586 2575 scope.go:117] "RemoveContainer" containerID="37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e" Jul 01 16:50:16.920879 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:50:16.920858 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e\": container with ID starting with 37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e not found: ID does not exist" containerID="37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e" Jul 01 16:50:16.920940 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.920888 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e"} err="failed to get container status \"37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e\": rpc error: code = NotFound desc = could not find container \"37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e\": container with ID starting with 37a806e0ac430f1de6b81ada01b688816e303920d51c8f4b661d4f30b10c9b7e not found: ID does not exist" Jul 01 16:50:16.936175 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.936153 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5794555c7c-ffcv2"] Jul 01 16:50:16.942504 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:16.942483 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5794555c7c-ffcv2"] Jul 01 16:50:17.172252 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:17.172181 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c6ba88e-b815-4b50-99ad-92628b20697a" path="/var/lib/kubelet/pods/7c6ba88e-b815-4b50-99ad-92628b20697a/volumes" Jul 01 16:50:35.567052 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:35.566927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:35.964734 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:35.964700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:36.003443 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.003408 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-85c8b6c6b9-kql5s"] Jul 01 16:50:36.003844 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.003830 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c6ba88e-b815-4b50-99ad-92628b20697a" containerName="manager" Jul 01 16:50:36.003903 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.003845 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c6ba88e-b815-4b50-99ad-92628b20697a" containerName="manager" Jul 01 16:50:36.003940 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.003907 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c6ba88e-b815-4b50-99ad-92628b20697a" containerName="manager" Jul 01 16:50:36.009952 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.009920 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.012764 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.012736 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 01 16:50:36.012898 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.012855 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2w775\"" Jul 01 16:50:36.019746 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.019721 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-85c8b6c6b9-kql5s"] Jul 01 16:50:36.115576 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.115543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/919629a5-4bef-4ec6-b156-6034c7d952ee-maas-api-tls\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.115751 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.115598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68ts8\" (UniqueName: \"kubernetes.io/projected/919629a5-4bef-4ec6-b156-6034c7d952ee-kube-api-access-68ts8\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.115751 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.115686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/919629a5-4bef-4ec6-b156-6034c7d952ee-openshift-service-ca\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.217026 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.216935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/919629a5-4bef-4ec6-b156-6034c7d952ee-maas-api-tls\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.217026 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.216986 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68ts8\" (UniqueName: \"kubernetes.io/projected/919629a5-4bef-4ec6-b156-6034c7d952ee-kube-api-access-68ts8\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.217026 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.217018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/919629a5-4bef-4ec6-b156-6034c7d952ee-openshift-service-ca\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.217272 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:50:36.217094 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 01 16:50:36.217272 ip-10-0-143-15 kubenswrapper[2575]: E0701 16:50:36.217166 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/919629a5-4bef-4ec6-b156-6034c7d952ee-maas-api-tls podName:919629a5-4bef-4ec6-b156-6034c7d952ee nodeName:}" failed. No retries permitted until 2026-07-01 16:50:36.717148995 +0000 UTC m=+720.192217007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/919629a5-4bef-4ec6-b156-6034c7d952ee-maas-api-tls") pod "maas-api-85c8b6c6b9-kql5s" (UID: "919629a5-4bef-4ec6-b156-6034c7d952ee") : secret "maas-api-serving-cert" not found Jul 01 16:50:36.217708 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.217691 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/919629a5-4bef-4ec6-b156-6034c7d952ee-openshift-service-ca\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.226849 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.226824 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68ts8\" (UniqueName: \"kubernetes.io/projected/919629a5-4bef-4ec6-b156-6034c7d952ee-kube-api-access-68ts8\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.434794 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.434759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:36.527986 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.527891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:36.615171 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.615141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:36.615933 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.615911 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk"] Jul 01 16:50:36.620299 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.620278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:36.623001 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.622978 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 16:50:36.623118 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.622986 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gskxw\"" Jul 01 16:50:36.630260 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.630234 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk"] Jul 01 16:50:36.659316 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.659278 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:50:36.721690 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.721643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqq7\" (UniqueName: \"kubernetes.io/projected/01c7e7e7-897c-4254-83ea-df503aa6304e-kube-api-access-pgqq7\") pod \"payload-pre-processing-59f49fd4f6-r5kgk\" (UID: \"01c7e7e7-897c-4254-83ea-df503aa6304e\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:36.721883 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.721701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01c7e7e7-897c-4254-83ea-df503aa6304e-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-r5kgk\" (UID: \"01c7e7e7-897c-4254-83ea-df503aa6304e\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:36.721883 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.721801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/919629a5-4bef-4ec6-b156-6034c7d952ee-maas-api-tls\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.724436 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.724405 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/919629a5-4bef-4ec6-b156-6034c7d952ee-maas-api-tls\") pod \"maas-api-85c8b6c6b9-kql5s\" (UID: \"919629a5-4bef-4ec6-b156-6034c7d952ee\") " pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.823287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.823189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqq7\" (UniqueName: \"kubernetes.io/projected/01c7e7e7-897c-4254-83ea-df503aa6304e-kube-api-access-pgqq7\") pod \"payload-pre-processing-59f49fd4f6-r5kgk\" (UID: \"01c7e7e7-897c-4254-83ea-df503aa6304e\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:36.823287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.823239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01c7e7e7-897c-4254-83ea-df503aa6304e-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-r5kgk\" (UID: \"01c7e7e7-897c-4254-83ea-df503aa6304e\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:36.824066 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.824041 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01c7e7e7-897c-4254-83ea-df503aa6304e-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-r5kgk\" (UID: \"01c7e7e7-897c-4254-83ea-df503aa6304e\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:36.834076 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.834052 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqq7\" (UniqueName: \"kubernetes.io/projected/01c7e7e7-897c-4254-83ea-df503aa6304e-kube-api-access-pgqq7\") pod \"payload-pre-processing-59f49fd4f6-r5kgk\" (UID: \"01c7e7e7-897c-4254-83ea-df503aa6304e\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:36.922108 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.922068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:36.932085 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:36.932054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:37.084744 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:37.084717 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-85c8b6c6b9-kql5s"] Jul 01 16:50:37.086055 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:50:37.086017 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919629a5_4bef_4ec6_b156_6034c7d952ee.slice/crio-2091a16e87a6df8dd22b68babda306ba30881ad386af6c391da234aa8dfc3959 WatchSource:0}: Error finding container 2091a16e87a6df8dd22b68babda306ba30881ad386af6c391da234aa8dfc3959: Status 404 returned error can't find the container with id 2091a16e87a6df8dd22b68babda306ba30881ad386af6c391da234aa8dfc3959 Jul 01 16:50:37.102967 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:37.102941 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk"] Jul 01 16:50:37.104764 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:50:37.104739 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c7e7e7_897c_4254_83ea_df503aa6304e.slice/crio-8fe986d8bea139fe57a9f910645de1c7a62dfcbe587ea8afd495501e33d95ce4 WatchSource:0}: Error finding container 8fe986d8bea139fe57a9f910645de1c7a62dfcbe587ea8afd495501e33d95ce4: Status 404 returned error can't find the container with id 8fe986d8bea139fe57a9f910645de1c7a62dfcbe587ea8afd495501e33d95ce4 Jul 01 16:50:37.176293 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:37.176263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:50:38.032977 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:38.032942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" event={"ID":"01c7e7e7-897c-4254-83ea-df503aa6304e","Type":"ContainerStarted","Data":"8fe986d8bea139fe57a9f910645de1c7a62dfcbe587ea8afd495501e33d95ce4"} Jul 01 16:50:38.034099 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:38.034076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85c8b6c6b9-kql5s" event={"ID":"919629a5-4bef-4ec6-b156-6034c7d952ee","Type":"ContainerStarted","Data":"2091a16e87a6df8dd22b68babda306ba30881ad386af6c391da234aa8dfc3959"} Jul 01 16:50:41.055036 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:41.054993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" event={"ID":"01c7e7e7-897c-4254-83ea-df503aa6304e","Type":"ContainerStarted","Data":"10b75e7814f5332657dbd5aedee4668426284f629c4e3463796b54497327c292"} Jul 01 16:50:41.055647 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:41.055095 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:50:41.057113 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:41.057082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85c8b6c6b9-kql5s" event={"ID":"919629a5-4bef-4ec6-b156-6034c7d952ee","Type":"ContainerStarted","Data":"1ad2e5b010f4acd8178658fcf4f88f4b61358f801c1d19d9f988f1fac008c18a"} Jul 01 16:50:41.057465 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:41.057148 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:41.075600 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:41.075550 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" podStartSLOduration=1.997398851 podStartE2EDuration="5.07553464s" totalImagesPullingTime="3.078135789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:50:41.073377538 +0000 UTC m=+724.548445568" watchObservedRunningTime="2026-07-01 16:50:41.07553464 +0000 UTC m=+724.550602651" Jul 01 16:50:41.095196 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:41.095133 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-85c8b6c6b9-kql5s" podStartSLOduration=3.022265132 podStartE2EDuration="6.09511348s" totalImagesPullingTime="3.072848348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:50:41.092364238 +0000 UTC m=+724.567432270" watchObservedRunningTime="2026-07-01 16:50:41.09511348 +0000 UTC m=+724.570181514" Jul 01 16:50:47.069535 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:47.069505 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-85c8b6c6b9-kql5s" Jul 01 16:50:48.544245 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:48.544204 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:50:48.544677 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:48.544427 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" containerID="cri-o://0fba61fe886031a90da4e16963f7b66fa17ea0083da9eeca9d65b12c7e252d79" gracePeriod=30 Jul 01 16:50:50.115915 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:50.115875 2575 generic.go:356] "Generic (PLEG): container finished" podID="a1601249-1483-407b-bda6-ca778d9070ae" containerID="0fba61fe886031a90da4e16963f7b66fa17ea0083da9eeca9d65b12c7e252d79" exitCode=143 Jul 01 16:50:50.115915 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:50.115911 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a1601249-1483-407b-bda6-ca778d9070ae","Type":"ContainerDied","Data":"0fba61fe886031a90da4e16963f7b66fa17ea0083da9eeca9d65b12c7e252d79"} Jul 01 16:50:50.598183 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:50.598158 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:50.658433 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:50.658401 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bxrf\" (UniqueName: \"kubernetes.io/projected/a1601249-1483-407b-bda6-ca778d9070ae-kube-api-access-2bxrf\") pod \"a1601249-1483-407b-bda6-ca778d9070ae\" (UID: \"a1601249-1483-407b-bda6-ca778d9070ae\") " Jul 01 16:50:50.660776 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:50.660741 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1601249-1483-407b-bda6-ca778d9070ae-kube-api-access-2bxrf" (OuterVolumeSpecName: "kube-api-access-2bxrf") pod "a1601249-1483-407b-bda6-ca778d9070ae" (UID: "a1601249-1483-407b-bda6-ca778d9070ae"). InnerVolumeSpecName "kube-api-access-2bxrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:50:50.759129 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:50.759046 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bxrf\" (UniqueName: \"kubernetes.io/projected/a1601249-1483-407b-bda6-ca778d9070ae-kube-api-access-2bxrf\") on node \"ip-10-0-143-15.ec2.internal\" DevicePath \"\"" Jul 01 16:50:51.123246 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.123168 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.123246 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.123203 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a1601249-1483-407b-bda6-ca778d9070ae","Type":"ContainerDied","Data":"16fd41841157cda51c3573fce088ae401f1bedad0659eff1167c10905b9832db"} Jul 01 16:50:51.123803 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.123281 2575 scope.go:117] "RemoveContainer" containerID="0fba61fe886031a90da4e16963f7b66fa17ea0083da9eeca9d65b12c7e252d79" Jul 01 16:50:51.146814 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.146790 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:50:51.151346 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.151325 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:50:51.173330 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.173309 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1601249-1483-407b-bda6-ca778d9070ae" path="/var/lib/kubelet/pods/a1601249-1483-407b-bda6-ca778d9070ae/volumes" Jul 01 16:50:51.174386 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.174367 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:50:51.174789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.174776 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" Jul 01 16:50:51.174834 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.174791 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" Jul 01 16:50:51.174886 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.174877 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1601249-1483-407b-bda6-ca778d9070ae" containerName="keycloak" Jul 01 16:50:51.177530 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.177516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.180430 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.180405 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 16:50:51.180551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.180488 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 16:50:51.180551 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.180512 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 16:50:51.180666 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.180513 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-9hrjb\"" Jul 01 16:50:51.180666 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.180563 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 16:50:51.188210 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.188191 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:50:51.263197 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.263166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/66a3e886-7737-4f5f-bf83-29d37a723b20-test-realms\") pod \"maas-keycloak-0\" (UID: \"66a3e886-7737-4f5f-bf83-29d37a723b20\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.263336 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.263210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptd9g\" (UniqueName: \"kubernetes.io/projected/66a3e886-7737-4f5f-bf83-29d37a723b20-kube-api-access-ptd9g\") pod \"maas-keycloak-0\" (UID: \"66a3e886-7737-4f5f-bf83-29d37a723b20\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.364503 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.364470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/66a3e886-7737-4f5f-bf83-29d37a723b20-test-realms\") pod \"maas-keycloak-0\" (UID: \"66a3e886-7737-4f5f-bf83-29d37a723b20\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.364635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.364513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptd9g\" (UniqueName: \"kubernetes.io/projected/66a3e886-7737-4f5f-bf83-29d37a723b20-kube-api-access-ptd9g\") pod \"maas-keycloak-0\" (UID: \"66a3e886-7737-4f5f-bf83-29d37a723b20\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.365104 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.365083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/66a3e886-7737-4f5f-bf83-29d37a723b20-test-realms\") pod \"maas-keycloak-0\" (UID: \"66a3e886-7737-4f5f-bf83-29d37a723b20\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.374443 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.374388 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptd9g\" (UniqueName: \"kubernetes.io/projected/66a3e886-7737-4f5f-bf83-29d37a723b20-kube-api-access-ptd9g\") pod \"maas-keycloak-0\" (UID: \"66a3e886-7737-4f5f-bf83-29d37a723b20\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.487651 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.487627 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:51.620759 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:51.620730 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:50:51.622148 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:50:51.622122 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a3e886_7737_4f5f_bf83_29d37a723b20.slice/crio-872d7b39ccff925378fbbc06f276becf80a6a793d449f88fc789c352ceb3d636 WatchSource:0}: Error finding container 872d7b39ccff925378fbbc06f276becf80a6a793d449f88fc789c352ceb3d636: Status 404 returned error can't find the container with id 872d7b39ccff925378fbbc06f276becf80a6a793d449f88fc789c352ceb3d636 Jul 01 16:50:52.066305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:52.066218 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" podUID="01c7e7e7-897c-4254-83ea-df503aa6304e" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: connect: connection refused" Jul 01 16:50:52.130739 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:52.130703 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66a3e886-7737-4f5f-bf83-29d37a723b20","Type":"ContainerStarted","Data":"872d7b39ccff925378fbbc06f276becf80a6a793d449f88fc789c352ceb3d636"} Jul 01 16:50:53.140539 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:53.140499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"66a3e886-7737-4f5f-bf83-29d37a723b20","Type":"ContainerStarted","Data":"b2a7d8ca421e9bc19029ccd2f467ff28d0b75ed40afa4a36cb51e10cbcb150dc"} Jul 01 16:50:53.170358 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:53.170287 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.557169762 podStartE2EDuration="2.17026504s" totalImagesPullingTime="613.095278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:50:53.168372708 +0000 UTC m=+736.643440736" watchObservedRunningTime="2026-07-01 16:50:53.17026504 +0000 UTC m=+736.645333076" Jul 01 16:50:53.488013 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:53.487919 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 16:50:53.489951 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:53.489916 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:50:54.488784 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:54.488737 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:50:55.488145 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:55.488094 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:50:56.488305 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:56.488257 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:50:57.488565 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:57.488495 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:50:58.489418 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:58.489352 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:50:59.489007 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:50:59.488953 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:51:00.488751 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:00.488695 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:51:01.487789 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:01.487748 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:51:01.488097 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:01.488063 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:51:02.064979 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:02.064948 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-r5kgk" Jul 01 16:51:02.488388 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:02.488346 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:51:03.488699 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:03.488653 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:51:04.488879 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:04.488833 2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jul 01 16:51:05.611895 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:05.611861 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 16:51:05.630033 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:05.629739 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="66a3e886-7737-4f5f-bf83-29d37a723b20" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:51:15.619446 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:15.619411 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:51:18.298120 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:18.298089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:51:18.356875 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:18.356844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:51:24.187223 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:24.187188 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:51:28.959844 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:28.959811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:51:29.062034 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:29.062002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:51:48.348178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.348149 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-8pljp"] Jul 01 16:51:48.353063 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.353040 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.355859 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.355838 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5ml5b\"" Jul 01 16:51:48.356146 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.355839 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 16:51:48.356270 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.355843 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 16:51:48.357144 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.357122 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 16:51:48.360271 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.360251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-8pljp"] Jul 01 16:51:48.380073 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.380050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:51:48.490058 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.490030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.490170 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.490059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c28d6a81-9913-42bf-8888-390746c104b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.490170 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.490116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c4v2\" (UniqueName: \"kubernetes.io/projected/c28d6a81-9913-42bf-8888-390746c104b8-kube-api-access-7c4v2\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.490170 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.490138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.490170 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.490158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.590623 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.590590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.590787 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.590633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c28d6a81-9913-42bf-8888-390746c104b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.590787 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.590666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c4v2\" (UniqueName: \"kubernetes.io/projected/c28d6a81-9913-42bf-8888-390746c104b8-kube-api-access-7c4v2\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.590787 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.590688 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.590787 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.590709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.591050 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.590977 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.591117 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.591080 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.593038 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.593007 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c28d6a81-9913-42bf-8888-390746c104b8-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.593141 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.593049 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c28d6a81-9913-42bf-8888-390746c104b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.620635 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.620580 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c4v2\" (UniqueName: \"kubernetes.io/projected/c28d6a81-9913-42bf-8888-390746c104b8-kube-api-access-7c4v2\") pod \"e2e-distinct-simulated-kserve-ff95456df-8pljp\" (UID: \"c28d6a81-9913-42bf-8888-390746c104b8\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.665437 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.665410 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:48.808745 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.806689 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-8pljp"] Jul 01 16:51:48.910533 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:48.910504 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:51:49.521658 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:49.521607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" event={"ID":"c28d6a81-9913-42bf-8888-390746c104b8","Type":"ContainerStarted","Data":"530a8a41c06d3ed932374755935ed95b38014a0d2044065c6b0cffff34272bc4"} Jul 01 16:51:50.529287 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:50.529247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" event={"ID":"c28d6a81-9913-42bf-8888-390746c104b8","Type":"ContainerStarted","Data":"220b5a40a3242ce63245aaeabbeda9ab34c82565b2d74847b4cbed316f6856a7"} Jul 01 16:51:50.551837 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:50.551791 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" podStartSLOduration=1.520600196 podStartE2EDuration="2.551775224s" totalImagesPullingTime="1.031175028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:51:50.548340808 +0000 UTC m=+794.023408842" watchObservedRunningTime="2026-07-01 16:51:50.551775224 +0000 UTC m=+794.026843293" Jul 01 16:51:55.288071 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:55.288039 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:51:55.773705 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:55.773676 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:51:58.666154 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:58.666120 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:58.666549 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:58.666186 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:58.678696 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:58.678676 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:51:59.591526 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:51:59.591500 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-8pljp" Jul 01 16:52:04.147177 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.147145 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76"] Jul 01 16:52:04.150659 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.150633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.153907 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.153890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 16:52:04.161565 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.161544 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76"] Jul 01 16:52:04.180355 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.180334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:52:04.326356 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.326328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q625b\" (UniqueName: \"kubernetes.io/projected/c0734613-8aba-47a3-8370-ac15ed60d953-kube-api-access-q625b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.326544 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.326509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.326634 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.326541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0734613-8aba-47a3-8370-ac15ed60d953-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.326634 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.326573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.326634 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.326627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.427237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.427151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q625b\" (UniqueName: \"kubernetes.io/projected/c0734613-8aba-47a3-8370-ac15ed60d953-kube-api-access-q625b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.427237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.427217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.427470 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.427246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0734613-8aba-47a3-8370-ac15ed60d953-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.427470 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.427272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.427470 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.427315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.427740 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.427720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.427791 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.427752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.429330 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.429312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0734613-8aba-47a3-8370-ac15ed60d953-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.429629 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.429613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0734613-8aba-47a3-8370-ac15ed60d953-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.437752 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.437733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q625b\" (UniqueName: \"kubernetes.io/projected/c0734613-8aba-47a3-8370-ac15ed60d953-kube-api-access-q625b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76\" (UID: \"c0734613-8aba-47a3-8370-ac15ed60d953\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.460732 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.460708 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:04.596348 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.596323 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76"] Jul 01 16:52:04.598637 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:52:04.598610 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0734613_8aba_47a3_8370_ac15ed60d953.slice/crio-55f8a0c14395ed3a2c3085251cb0969feb5723c7a3bfb31ddf02efc616cae7db WatchSource:0}: Error finding container 55f8a0c14395ed3a2c3085251cb0969feb5723c7a3bfb31ddf02efc616cae7db: Status 404 returned error can't find the container with id 55f8a0c14395ed3a2c3085251cb0969feb5723c7a3bfb31ddf02efc616cae7db Jul 01 16:52:04.609871 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:04.609845 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" event={"ID":"c0734613-8aba-47a3-8370-ac15ed60d953","Type":"ContainerStarted","Data":"55f8a0c14395ed3a2c3085251cb0969feb5723c7a3bfb31ddf02efc616cae7db"} Jul 01 16:52:05.115296 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:05.115220 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:52:05.617972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:05.617934 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" event={"ID":"c0734613-8aba-47a3-8370-ac15ed60d953","Type":"ContainerStarted","Data":"61b38701894d8c7b879c655145677c8bce6b9ec6740c3011450ab2e08c8fbb71"} Jul 01 16:52:05.643463 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:05.643415 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" podStartSLOduration=1.472875645 podStartE2EDuration="1.643400788s" totalImagesPullingTime="170.525143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:52:05.640929238 +0000 UTC m=+809.115997281" watchObservedRunningTime="2026-07-01 16:52:05.643400788 +0000 UTC m=+809.118468819" Jul 01 16:52:11.278120 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:11.278088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:52:12.220771 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:12.220739 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:52:14.461526 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:14.461487 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:14.461891 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:14.461559 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:14.474314 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:14.474287 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:14.680656 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:14.680627 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76" Jul 01 16:52:22.485314 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:22.485283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:52:23.414390 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:23.414362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:52:39.189220 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:39.189175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:52:39.923383 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:52:39.923352 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-65p9w"] Jul 01 16:53:14.961764 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:14.961731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:53:15.045314 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:15.045284 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:53:16.177542 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:16.177502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:53:16.519966 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:16.519877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:53:37.199685 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:37.199597 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:53:37.202378 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:37.202345 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:53:37.204642 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:37.204619 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:53:37.206745 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:37.206726 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d8vw7_ab81a402-ca3f-417c-8127-f3f7291fd491/ovn-acl-logging/0.log" Jul 01 16:53:59.069286 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:59.069254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-996f85ff6-g7hr6_49b05101-74d4-4c8c-b79d-cf6a5439f40b/nginx/0.log" Jul 01 16:53:59.398692 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:59.398665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:53:59.578914 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:59.578873 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-85c8b6c6b9-kql5s_919629a5-4bef-4ec6-b156-6034c7d952ee/maas-api/0.log" Jul 01 16:53:59.703437 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:53:59.703359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d5888c769-hrf6f_863ea4ac-cf83-4788-9160-42237e3b629b/manager/0.log" Jul 01 16:54:00.067847 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:00.067769 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-dz6g5_41045c75-97eb-4954-b022-02baa7c9f5d7/copy-manifests/0.log" Jul 01 16:54:00.081952 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:00.081925 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-dz6g5_41045c75-97eb-4954-b022-02baa7c9f5d7/manager/0.log" Jul 01 16:54:01.229288 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.229242 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w_15ade91c-95f6-40f7-8795-4fc3742a649a/util/0.log" Jul 01 16:54:01.237668 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.237640 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w_15ade91c-95f6-40f7-8795-4fc3742a649a/pull/0.log" Jul 01 16:54:01.245853 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.245829 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w_15ade91c-95f6-40f7-8795-4fc3742a649a/extract/0.log" Jul 01 16:54:01.324654 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.324623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:54:01.356526 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.356501 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8_6c54dcdf-606c-438d-ada9-d73dc1eebac0/extract/0.log" Jul 01 16:54:01.364110 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.364086 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8_6c54dcdf-606c-438d-ada9-d73dc1eebac0/util/0.log" Jul 01 16:54:01.371257 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.371238 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8_6c54dcdf-606c-438d-ada9-d73dc1eebac0/pull/0.log" Jul 01 16:54:01.480005 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.479928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8_16901883-9d61-4452-8920-f408f801f144/pull/0.log" Jul 01 16:54:01.488189 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.488158 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8_16901883-9d61-4452-8920-f408f801f144/extract/0.log" Jul 01 16:54:01.496045 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.496019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8_16901883-9d61-4452-8920-f408f801f144/util/0.log" Jul 01 16:54:01.612986 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.612954 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn_f84dede9-c332-419e-9a42-6b201ef4361b/util/0.log" Jul 01 16:54:01.623068 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.623023 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn_f84dede9-c332-419e-9a42-6b201ef4361b/pull/0.log" Jul 01 16:54:01.631735 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:01.631686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn_f84dede9-c332-419e-9a42-6b201ef4361b/extract/0.log" Jul 01 16:54:02.318962 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:02.318930 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tfm7b_c5caa6e2-bb4d-4e7f-bbca-a865386a1b42/manager/0.log" Jul 01 16:54:02.445177 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:02.445146 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-65p9w_cf57c79b-2398-4943-96c7-cb79db3eaf9a/limitador/0.log" Jul 01 16:54:02.910268 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:02.910244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ptt92_4a4cc670-c1af-4bfd-9007-46f2301450d1/istio-proxy/0.log" Jul 01 16:54:03.498851 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:03.498819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-r5kgk_01c7e7e7-897c-4254-83ea-df503aa6304e/payload-pre-processing/0.log" Jul 01 16:54:03.741322 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:03.741297 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b55764c-6x7db_88b9dce7-4158-4086-8894-e3ecb1d642fa/router/0.log" Jul 01 16:54:04.212263 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:04.212237 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-8pljp_c28d6a81-9913-42bf-8888-390746c104b8/main/0.log" Jul 01 16:54:04.443159 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:04.443123 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ggh76_c0734613-8aba-47a3-8370-ac15ed60d953/main/0.log" Jul 01 16:54:08.680033 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:08.680003 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:54:08.751084 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:08.751053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:54:11.862805 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:11.862754 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7s446_71d69444-0428-4688-9001-3b5697c4fd16/global-pull-secret-syncer/0.log" Jul 01 16:54:12.168213 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:12.168186 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" Jul 01 16:54:12.450715 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:12.450636 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-15.ec2.internal_ecacabbf6c7581c4fa7099252af4d71e/haproxy/0.log" Jul 01 16:54:16.304006 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:16.303917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-86n6c_d3941034-4536-4110-92dc-9604beaadb93/konnectivity-agent/0.log" limit=1024 Jul 01 16:54:17.046583 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.046554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w_15ade91c-95f6-40f7-8795-4fc3742a649a/extract/0.log" Jul 01 16:54:17.087867 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.087844 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w_15ade91c-95f6-40f7-8795-4fc3742a649a/util/0.log" Jul 01 16:54:17.114946 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.114920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597h69w_15ade91c-95f6-40f7-8795-4fc3742a649a/pull/0.log" Jul 01 16:54:17.153349 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.153320 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8_6c54dcdf-606c-438d-ada9-d73dc1eebac0/extract/0.log" Jul 01 16:54:17.189794 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.189769 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8_6c54dcdf-606c-438d-ada9-d73dc1eebac0/util/0.log" Jul 01 16:54:17.226332 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.226301 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e029zn8_6c54dcdf-606c-438d-ada9-d73dc1eebac0/pull/0.log" Jul 01 16:54:17.257098 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.257073 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8_16901883-9d61-4452-8920-f408f801f144/extract/0.log" Jul 01 16:54:17.293890 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.293865 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8_16901883-9d61-4452-8920-f408f801f144/util/0.log" Jul 01 16:54:17.324978 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.324907 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73k9tq8_16901883-9d61-4452-8920-f408f801f144/pull/0.log" Jul 01 16:54:17.376808 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.376779 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn_f84dede9-c332-419e-9a42-6b201ef4361b/extract/0.log" Jul 01 16:54:17.406085 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.406055 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn_f84dede9-c332-419e-9a42-6b201ef4361b/util/0.log" Jul 01 16:54:17.433315 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.433287 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fbxtn_f84dede9-c332-419e-9a42-6b201ef4361b/pull/0.log" Jul 01 16:54:17.674788 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.674756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tfm7b_c5caa6e2-bb4d-4e7f-bbca-a865386a1b42/manager/0.log" Jul 01 16:54:17.703970 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:17.703944 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-65p9w_cf57c79b-2398-4943-96c7-cb79db3eaf9a/limitador/0.log" Jul 01 16:54:19.489537 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.489507 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2214cb0-d6fb-4204-9ccf-5bf75a59a20e/alertmanager/0.log" Jul 01 16:54:19.525775 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.525739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2214cb0-d6fb-4204-9ccf-5bf75a59a20e/config-reloader/0.log" Jul 01 16:54:19.563755 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.563728 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2214cb0-d6fb-4204-9ccf-5bf75a59a20e/kube-rbac-proxy-web/0.log" Jul 01 16:54:19.590601 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.590575 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2214cb0-d6fb-4204-9ccf-5bf75a59a20e/kube-rbac-proxy/0.log" Jul 01 16:54:19.624244 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.624219 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2214cb0-d6fb-4204-9ccf-5bf75a59a20e/kube-rbac-proxy-metric/0.log" Jul 01 16:54:19.661661 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.661630 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2214cb0-d6fb-4204-9ccf-5bf75a59a20e/prom-label-proxy/0.log" Jul 01 16:54:19.699612 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.699588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2214cb0-d6fb-4204-9ccf-5bf75a59a20e/init-config-reloader/0.log" Jul 01 16:54:19.742371 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.742295 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-sksmc_56acd41c-facb-493d-8eac-8cff2fac85ec/cluster-monitoring-operator/0.log" Jul 01 16:54:19.901242 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:19.901214 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-dj2h7_1572a7d0-4d57-4199-97e3-c2fdccae72b0/monitoring-plugin/0.log" Jul 01 16:54:20.038352 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.038284 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jp8wr_42fd24f6-705e-4070-87d3-29d7a7d9b1e5/node-exporter/0.log" Jul 01 16:54:20.069722 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.069686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jp8wr_42fd24f6-705e-4070-87d3-29d7a7d9b1e5/kube-rbac-proxy/0.log" Jul 01 16:54:20.098645 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.098623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jp8wr_42fd24f6-705e-4070-87d3-29d7a7d9b1e5/init-textfile/0.log" Jul 01 16:54:20.228484 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.228422 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-2gnx5_efe94e17-5431-4014-b952-46dfd31caa19/kube-rbac-proxy-main/0.log" Jul 01 16:54:20.268975 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.268946 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-2gnx5_efe94e17-5431-4014-b952-46dfd31caa19/kube-rbac-proxy-self/0.log" Jul 01 16:54:20.300370 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.300286 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-2gnx5_efe94e17-5431-4014-b952-46dfd31caa19/openshift-state-metrics/0.log" Jul 01 16:54:20.629428 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.629397 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7db564d566-259nf_f14e2d1b-0d4d-4b42-a02d-d5875ff8b691/telemeter-client/0.log" Jul 01 16:54:20.655280 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.655256 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7db564d566-259nf_f14e2d1b-0d4d-4b42-a02d-d5875ff8b691/reload/0.log" Jul 01 16:54:20.680184 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.680154 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7db564d566-259nf_f14e2d1b-0d4d-4b42-a02d-d5875ff8b691/kube-rbac-proxy/0.log" Jul 01 16:54:20.715447 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.715418 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7cd46bf4-j47nb_9c5c0831-5dbe-4d9c-871d-89aefcfc60a0/thanos-query/0.log" Jul 01 16:54:20.738059 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.738021 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7cd46bf4-j47nb_9c5c0831-5dbe-4d9c-871d-89aefcfc60a0/kube-rbac-proxy-web/0.log" Jul 01 16:54:20.761178 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.761155 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7cd46bf4-j47nb_9c5c0831-5dbe-4d9c-871d-89aefcfc60a0/kube-rbac-proxy/0.log" Jul 01 16:54:20.791888 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.791861 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7cd46bf4-j47nb_9c5c0831-5dbe-4d9c-871d-89aefcfc60a0/prom-label-proxy/0.log" Jul 01 16:54:20.820788 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.820764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7cd46bf4-j47nb_9c5c0831-5dbe-4d9c-871d-89aefcfc60a0/kube-rbac-proxy-rules/0.log" Jul 01 16:54:20.843670 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:20.843649 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7cd46bf4-j47nb_9c5c0831-5dbe-4d9c-871d-89aefcfc60a0/kube-rbac-proxy-metrics/0.log" Jul 01 16:54:22.570371 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.570328 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h"] Jul 01 16:54:22.573092 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.573075 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.575972 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.575949 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4sr87\"/\"default-dockercfg-q4lsd\"" Jul 01 16:54:22.576071 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.575950 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sr87\"/\"openshift-service-ca.crt\"" Jul 01 16:54:22.577231 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.577211 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sr87\"/\"kube-root-ca.crt\"" Jul 01 16:54:22.584307 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.584285 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h"] Jul 01 16:54:22.626329 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.626295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25rcv\" (UniqueName: \"kubernetes.io/projected/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-kube-api-access-25rcv\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.626513 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.626338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-podres\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.626513 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.626422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-proc\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.626602 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.626527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-lib-modules\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.626602 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.626555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-sys\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727028 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.726994 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-lib-modules\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727196 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-sys\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727196 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25rcv\" (UniqueName: \"kubernetes.io/projected/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-kube-api-access-25rcv\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727196 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-podres\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727196 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-proc\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727196 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-lib-modules\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727378 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-sys\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727378 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727234 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-podres\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.727378 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.727242 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-proc\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.737824 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.737797 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25rcv\" (UniqueName: \"kubernetes.io/projected/e2108afc-dfeb-4518-b1b1-8da6a0293ab1-kube-api-access-25rcv\") pod \"perf-node-gather-daemonset-fcn5h\" (UID: \"e2108afc-dfeb-4518-b1b1-8da6a0293ab1\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:22.809782 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.809756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/2.log" Jul 01 16:54:22.813708 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.813679 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-ngb6g_80894daf-00f6-4e9d-8175-82e07decf98b/console-operator/3.log" Jul 01 16:54:22.884208 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:22.884177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:23.030597 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:23.030572 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h"] Jul 01 16:54:23.033176 ip-10-0-143-15 kubenswrapper[2575]: W0701 16:54:23.033148 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode2108afc_dfeb_4518_b1b1_8da6a0293ab1.slice/crio-867730caaea883a1f239154e4bd237f75aa0a9425e3afdd63b8f0f8c511a180a WatchSource:0}: Error finding container 867730caaea883a1f239154e4bd237f75aa0a9425e3afdd63b8f0f8c511a180a: Status 404 returned error can't find the container with id 867730caaea883a1f239154e4bd237f75aa0a9425e3afdd63b8f0f8c511a180a Jul 01 16:54:23.386414 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:23.386388 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-588b695df9-ppr2d_b01577ae-c327-43ef-98da-cf25a5640461/console/0.log" Jul 01 16:54:23.421933 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:23.421850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" event={"ID":"e2108afc-dfeb-4518-b1b1-8da6a0293ab1","Type":"ContainerStarted","Data":"1887ab650e01d5ef342d82eae929ccdd1a821438c81157d2092d11ba47344609"} Jul 01 16:54:23.421933 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:23.421905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" event={"ID":"e2108afc-dfeb-4518-b1b1-8da6a0293ab1","Type":"ContainerStarted","Data":"867730caaea883a1f239154e4bd237f75aa0a9425e3afdd63b8f0f8c511a180a"} Jul 01 16:54:23.422148 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:23.421963 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:23.446011 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:23.445964 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" podStartSLOduration=1.4459512110000001 podStartE2EDuration="1.445951211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:54:23.44237233 +0000 UTC m=+946.917440363" watchObservedRunningTime="2026-07-01 16:54:23.445951211 +0000 UTC m=+946.921019243" Jul 01 16:54:24.073338 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:24.073315 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-pl8w5_89614adb-1dea-4074-96d9-d57bf1b2a851/volume-data-source-validator/0.log" Jul 01 16:54:25.239237 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:25.239155 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7csvz_dedd0bef-bd30-4e3a-8b98-201a6210b591/dns/0.log" Jul 01 16:54:25.268391 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:25.268361 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7csvz_dedd0bef-bd30-4e3a-8b98-201a6210b591/kube-rbac-proxy/0.log" Jul 01 16:54:25.399577 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:25.399551 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8mz4h_0d0befff-cf3a-4d24-ac5f-42a2fc40d8f7/dns-node-resolver/0.log" Jul 01 16:54:26.084314 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:26.084284 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rcbfd_533e899c-b8a1-430f-b439-82348701874e/node-ca/0.log" Jul 01 16:54:27.120181 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:27.120154 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ptt92_4a4cc670-c1af-4bfd-9007-46f2301450d1/istio-proxy/0.log" Jul 01 16:54:27.286542 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:27.286515 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-r5kgk_01c7e7e7-897c-4254-83ea-df503aa6304e/payload-pre-processing/0.log" Jul 01 16:54:27.338722 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:27.338694 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b55764c-6x7db_88b9dce7-4158-4086-8894-e3ecb1d642fa/router/0.log" Jul 01 16:54:28.023331 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:28.023300 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x5lf2_00f88e95-65b6-475c-a2bd-3aaf91fd734b/serve-healthcheck-canary/0.log" Jul 01 16:54:28.672154 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:28.672119 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-q97x2_d7f59688-84f5-4e0e-93a5-df9a3353ced0/insights-operator/1.log" Jul 01 16:54:28.672549 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:28.672168 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-q97x2_d7f59688-84f5-4e0e-93a5-df9a3353ced0/insights-operator/0.log" Jul 01 16:54:28.778813 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:28.778785 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bhnz_4ba56669-bfef-46f0-b85a-efc91307b482/kube-rbac-proxy/0.log" Jul 01 16:54:28.803401 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:28.803376 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bhnz_4ba56669-bfef-46f0-b85a-efc91307b482/exporter/0.log" Jul 01 16:54:28.826095 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:28.826071 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bhnz_4ba56669-bfef-46f0-b85a-efc91307b482/extractor/0.log" Jul 01 16:54:29.437643 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:29.437618 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-fcn5h" Jul 01 16:54:31.269044 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:31.269020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-996f85ff6-g7hr6_49b05101-74d4-4c8c-b79d-cf6a5439f40b/nginx/0.log" Jul 01 16:54:31.398109 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:31.398068 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-85c8b6c6b9-kql5s_919629a5-4bef-4ec6-b156-6034c7d952ee/maas-api/0.log" Jul 01 16:54:31.434316 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:31.434285 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d5888c769-hrf6f_863ea4ac-cf83-4788-9160-42237e3b629b/manager/0.log" Jul 01 16:54:31.561244 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:31.561217 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-dz6g5_41045c75-97eb-4954-b022-02baa7c9f5d7/manager/0.log" Jul 01 16:54:31.594979 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:31.594950 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-dz6g5_41045c75-97eb-4954-b022-02baa7c9f5d7/copy-manifests/0.log" Jul 01 16:54:32.952719 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:32.952694 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ptt92_4a4cc670-c1af-4bfd-9007-46f2301450d1/istio-proxy/0.log" Jul 01 16:54:33.047227 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:33.047199 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-r5kgk_01c7e7e7-897c-4254-83ea-df503aa6304e/payload-pre-processing/0.log" Jul 01 16:54:33.075014 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:33.074994 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b55764c-6x7db_88b9dce7-4158-4086-8894-e3ecb1d642fa/router/0.log" Jul 01 16:54:33.360154 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:33.360059 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66fb8c9499-cjbb6_5bf5764e-09fd-4544-9494-ae7fac52149b/manager/0.log" Jul 01 16:54:33.416782 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:33.416758 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5k68n_8ec9c158-d9fc-4ff1-8639-358d52992527/openshift-lws-operator/0.log" Jul 01 16:54:34.230677 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:34.230650 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ptt92_4a4cc670-c1af-4bfd-9007-46f2301450d1/istio-proxy/0.log" Jul 01 16:54:34.359571 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:34.359543 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-r5kgk_01c7e7e7-897c-4254-83ea-df503aa6304e/payload-pre-processing/0.log" Jul 01 16:54:34.405902 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:34.405872 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b55764c-6x7db_88b9dce7-4158-4086-8894-e3ecb1d642fa/router/0.log" Jul 01 16:54:39.062890 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:39.062853 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-vg9pz_c5229590-685f-4e84-a11c-cab27a0f4728/kube-storage-version-migrator-operator/1.log" Jul 01 16:54:39.063763 ip-10-0-143-15 kubenswrapper[2575]: I0701 16:54:39.063745 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-vg9pz_c5229590-685f-4e84-a11c-cab27a0f4728/kube-storage-version-migrator-operator/0.log"