Sep 10 04:26:18.709234 ip-10-0-129-39 systemd[1]: Starting Kubernetes Kubelet... Sep 10 04:26:19.110730 ip-10-0-129-39 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 04:26:19.110730 ip-10-0-129-39 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 04:26:19.110730 ip-10-0-129-39 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 04:26:19.111653 ip-10-0-129-39 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 04:26:19.111653 ip-10-0-129-39 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 04:26:19.111821 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.111709 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 04:26:19.115557 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115541 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:19.115557 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115557 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115560 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115566 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115571 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115574 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115577 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115580 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115582 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115585 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115588 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115590 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115594 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115597 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115599 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115602 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115605 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115607 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115610 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115612 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:19.115621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115615 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115618 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115620 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115623 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115626 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115629 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115632 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115635 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115637 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115640 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115642 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115645 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115648 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115651 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115653 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115656 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115658 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115661 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115663 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115665 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:19.116102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115668 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115670 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115673 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115675 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115678 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115681 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115683 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115686 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115688 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115691 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115693 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115696 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115698 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115701 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115704 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115707 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115710 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115713 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115716 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115718 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:19.116585 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115721 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115725 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115729 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115732 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115735 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115738 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115741 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115745 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115747 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115750 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115753 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115755 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115758 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115760 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115763 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115765 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115768 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115770 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115773 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115775 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:19.117102 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115778 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115780 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115783 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115786 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115788 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115791 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115794 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115797 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115799 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115802 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115805 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115808 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115812 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115815 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115818 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115820 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115823 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115826 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.115829 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:19.117584 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116526 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116533 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116536 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116539 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116542 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116545 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116548 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116550 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116553 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116556 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116558 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116561 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116563 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116566 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116568 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116571 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116574 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116576 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116579 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:19.118085 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116582 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116585 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116588 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116591 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116593 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116596 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116598 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116601 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116603 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116606 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116608 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116611 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116614 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116616 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116619 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116621 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116624 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116627 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116630 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116632 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:19.118560 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116635 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116637 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116640 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116642 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116645 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116648 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116650 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116653 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116656 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116658 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116661 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116665 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116667 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116670 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116672 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116675 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116677 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116680 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116682 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116684 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:19.119069 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116687 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116690 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116692 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116694 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116697 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116702 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116705 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116708 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116711 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116714 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116717 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116719 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116722 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116724 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116727 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116730 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116732 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116735 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116738 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116741 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:19.119555 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116744 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116746 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116749 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116752 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116754 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116757 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116760 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116763 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116765 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116768 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116770 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116773 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116775 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116778 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116780 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116783 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116786 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116790 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116794 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:19.120045 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.116797 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117204 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117210 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117212 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117215 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117218 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117221 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117223 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117227 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117232 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117235 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117239 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117242 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117246 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117248 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117253 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117257 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117260 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117263 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:19.120515 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117266 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117269 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117272 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117276 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117278 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117281 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117284 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117286 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117289 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117292 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117294 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117297 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117303 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117306 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117308 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117311 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117314 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117316 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117320 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:19.121000 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117322 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117325 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117328 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117331 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117333 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117336 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117338 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117341 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117343 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117346 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117349 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117352 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117354 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117357 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117359 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117362 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117364 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117367 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117369 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117372 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:19.121464 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117374 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117376 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117379 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117382 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117385 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117387 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117391 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117393 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117396 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117398 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117401 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117403 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117406 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117408 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117411 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117413 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117416 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117419 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117421 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117424 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:19.121962 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117426 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117429 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117432 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117434 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117437 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117439 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117442 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117444 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117447 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117449 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117452 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117454 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117457 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117459 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117461 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117464 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117466 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117469 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117471 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117475 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:19.122443 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117477 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.117495 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117565 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117598 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117605 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117610 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117614 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117618 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117622 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117626 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117629 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117632 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117635 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117639 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117642 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117645 2578 flags.go:64] FLAG: --cgroup-root="" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117648 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117651 2578 flags.go:64] FLAG: --client-ca-file="" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117654 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117657 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117661 2578 flags.go:64] FLAG: --cluster-domain="" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117664 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117667 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117670 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 04:26:19.122988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117673 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117677 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117680 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117683 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117686 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117689 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117692 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117695 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117699 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117701 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117705 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117708 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117711 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117714 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117717 2578 flags.go:64] FLAG: --enable-server="true" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117722 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117727 2578 flags.go:64] FLAG: --event-burst="100" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117730 2578 flags.go:64] FLAG: --event-qps="50" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117733 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117736 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117740 2578 flags.go:64] FLAG: --eviction-hard="" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117744 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117747 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117750 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117753 2578 flags.go:64] FLAG: --eviction-soft="" Sep 10 04:26:19.123568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117756 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117759 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117762 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117764 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117767 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117770 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117773 2578 flags.go:64] FLAG: --feature-gates="" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117777 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117779 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117782 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117785 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117788 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117791 2578 flags.go:64] FLAG: --help="false" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117794 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117797 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117800 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117803 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117806 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117810 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117812 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117815 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117818 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117825 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 04:26:19.124184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117828 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117831 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117834 2578 flags.go:64] FLAG: --kube-reserved="" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117837 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117841 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117844 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117847 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117850 2578 flags.go:64] FLAG: --lock-file="" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117852 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117856 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117859 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117864 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117866 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117869 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117872 2578 flags.go:64] FLAG: --logging-format="text" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117875 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117878 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117881 2578 flags.go:64] FLAG: --manifest-url="" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117884 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117888 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117891 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117895 2578 flags.go:64] FLAG: --max-pods="110" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117898 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117901 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117904 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 04:26:19.124806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117906 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117915 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117919 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117922 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117929 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117932 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117948 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117952 2578 flags.go:64] FLAG: --pod-cidr="" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117955 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117960 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117963 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117966 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117970 2578 flags.go:64] FLAG: --port="10250" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117974 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117977 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-057b6e38333ef10cd" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117980 2578 flags.go:64] FLAG: --qos-reserved="" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117983 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117986 2578 flags.go:64] FLAG: --register-node="true" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117989 2578 flags.go:64] FLAG: --register-with-taints="" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117992 2578 flags.go:64] FLAG: --registry-burst="10" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117995 2578 flags.go:64] FLAG: --registry-qps="5" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.117998 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118001 2578 flags.go:64] FLAG: --reserved-memory="" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118004 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118007 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 04:26:19.125525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118010 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118013 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118016 2578 flags.go:64] FLAG: --runonce="false" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118019 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118022 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118025 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118028 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118031 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118034 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118042 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118046 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118049 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118051 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118056 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118058 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118062 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118064 2578 flags.go:64] FLAG: --system-cgroups="" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118067 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118073 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118077 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118079 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118084 2578 flags.go:64] FLAG: --tls-min-version="" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118087 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118089 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118092 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 04:26:19.126548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118095 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118098 2578 flags.go:64] FLAG: --v="2" Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118102 2578 flags.go:64] FLAG: --version="false" Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118106 2578 flags.go:64] FLAG: --vmodule="" Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118109 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118112 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118225 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118229 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118232 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118234 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118238 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118240 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118244 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118246 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118249 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118251 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118254 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118263 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118266 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118269 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118273 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:19.127368 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118276 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118278 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118281 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118283 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118286 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118291 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118294 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118296 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118299 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118301 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118304 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118306 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118309 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118312 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118314 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118318 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118322 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118325 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118328 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:19.127965 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118331 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118334 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118336 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118339 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118342 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118344 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118347 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118349 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118352 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118354 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118362 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118366 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118371 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118374 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118376 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118379 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118382 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118384 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118388 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:19.128473 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118391 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118394 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118398 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118401 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118403 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118406 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118408 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118411 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118413 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118416 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118419 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118421 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118424 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118426 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118429 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118432 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118434 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118437 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118439 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:19.129314 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118442 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118444 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118447 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118449 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118452 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118460 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118464 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118467 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118469 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118472 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118474 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118477 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118481 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118483 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118486 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118489 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118491 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118494 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118496 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118499 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:19.130120 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118501 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118504 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118506 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118516 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118519 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118522 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.118524 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.118986 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.126689 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.126709 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.128492 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.128514 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128615 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128625 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:19.130730 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128633 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128639 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128645 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128650 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128655 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128659 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128663 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128668 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128672 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128678 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128682 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128686 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128690 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128695 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128698 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128703 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128707 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128711 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128715 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128720 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:19.131276 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128724 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128728 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128733 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128737 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128741 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128745 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128749 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128771 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128776 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128781 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128785 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128790 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128794 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128798 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128803 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128807 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128811 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128815 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128819 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128823 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:19.131913 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128827 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128831 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128836 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128840 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128844 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128848 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128853 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128857 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128861 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128865 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128870 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128874 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128878 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128882 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128886 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128891 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128895 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128899 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128904 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128909 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:19.132727 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128913 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128917 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128921 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128926 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128930 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128934 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128956 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128961 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128965 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128969 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.128973 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129001 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129008 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129012 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129016 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129021 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129027 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129033 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129038 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129043 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:19.133387 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129047 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129051 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129055 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129059 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129063 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129067 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129071 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129075 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129082 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129087 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129092 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129096 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129101 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129105 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129109 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129113 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:19.133967 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129117 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.129126 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129304 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129310 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129315 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129319 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129323 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129327 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129331 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129335 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129339 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129343 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129347 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129351 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129357 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 04:26:19.134360 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129361 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129365 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129370 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129374 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129378 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129382 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129387 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129392 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129396 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129401 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129405 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129409 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129413 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129418 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129422 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129426 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129432 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129439 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129443 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 04:26:19.134788 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129448 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129455 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129460 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129465 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129469 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129474 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129478 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129482 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129486 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129491 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129495 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129499 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129503 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129509 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129513 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129517 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129521 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129525 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129529 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 04:26:19.135309 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129533 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129538 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129542 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129546 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129550 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129554 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129558 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129563 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129567 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129571 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129575 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129579 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129583 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129587 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129591 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129595 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129600 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129604 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129607 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129612 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 04:26:19.135786 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129616 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129620 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129624 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129629 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129633 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129637 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129641 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129646 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129650 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129655 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129659 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129665 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129671 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129675 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129679 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129683 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129687 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129691 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129695 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129700 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 04:26:19.136323 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129704 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129708 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129712 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129716 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129720 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129725 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129729 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:19.129733 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.129742 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.129905 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.133365 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.134543 2578 server.go:1019] "Starting client certificate rotation" Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.134651 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 04:26:19.137035 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.135465 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 04:26:19.137718 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.137702 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 04:26:19.138908 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.138885 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 04:26:19.147624 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.147606 2578 log.go:25] "Validated CRI v1 runtime API" Sep 10 04:26:19.150375 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.150359 2578 log.go:25] "Validated CRI v1 image API" Sep 10 04:26:19.151186 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.151171 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 04:26:19.154165 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.154146 2578 fs.go:135] Filesystem UUIDs: map[6d82dc7e-288e-4571-aaf4-3b2fd440c63c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e6af66a6-9743-406e-9e7f-98d8e568d714:/dev/nvme0n1p3] Sep 10 04:26:19.154239 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.154164 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 04:26:19.160704 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.160514 2578 manager.go:216] Machine: {Timestamp:2026-09-10 04:26:19.16003734 +0000 UTC m=+0.339243069 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103149 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f1b1ed1110d3a2e745c4640f55f00 SystemUUID:ec2f1b1e-d111-0d3a-2e74-5c4640f55f00 BootID:144e3a9f-83de-4f0c-86b5-a8bbef179136 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:83:bf:82:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:83:bf:82:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:cb:ff:88:1f:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 04:26:19.160704 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.160702 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 04:26:19.160807 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.160773 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 04:26:19.162281 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.162248 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 04:26:19.162460 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.162287 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 04:26:19.163028 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.163018 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 04:26:19.163063 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.163031 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 04:26:19.163063 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.163039 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 04:26:19.163496 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.163485 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 04:26:19.164048 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.164032 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 04:26:19.164254 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.164242 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 04:26:19.167178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.167167 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 10 04:26:19.167290 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.167281 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 04:26:19.167321 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.167312 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 10 04:26:19.167353 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.167327 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 04:26:19.167353 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.167343 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 04:26:19.167353 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.167352 2578 kubelet.go:398] "Adding apiserver pod source" Sep 10 04:26:19.167473 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.167381 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 04:26:19.168121 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.168101 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 04:26:19.168203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.168134 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 04:26:19.171342 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.171317 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 04:26:19.173401 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.173389 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 04:26:19.173445 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.173418 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 04:26:19.174350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174338 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 04:26:19.174395 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174356 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 04:26:19.174395 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174362 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 04:26:19.174395 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174367 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 04:26:19.174395 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174377 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 04:26:19.174395 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174386 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 04:26:19.174528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174402 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 04:26:19.174528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174410 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 04:26:19.174528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174419 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 04:26:19.174528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174424 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 04:26:19.174528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174433 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 04:26:19.174528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.174439 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 04:26:19.175203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.175183 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 04:26:19.175203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.175205 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 04:26:19.177766 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.177737 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 04:26:19.177828 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.177771 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 04:26:19.177828 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.177777 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 04:26:19.178851 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.178837 2578 server.go:1268] "Started kubelet" Sep 10 04:26:19.179060 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.179026 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 04:26:19.179154 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.179077 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 04:26:19.179525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.179490 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 04:26:19.179710 ip-10-0-129-39 systemd[1]: Started Kubernetes Kubelet. Sep 10 04:26:19.180267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.180249 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 04:26:19.181979 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.181964 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 10 04:26:19.182838 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.182819 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 04:26:19.184604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.184589 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 04:26:19.184665 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.184607 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 04:26:19.184725 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.184703 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.185166 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185154 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 04:26:19.185330 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185308 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 04:26:19.185419 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185339 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 04:26:19.185483 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185440 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 10 04:26:19.185483 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185452 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 10 04:26:19.185483 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185473 2578 factory.go:55] Registering systemd factory Sep 10 04:26:19.185588 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185492 2578 factory.go:223] Registration of the systemd container factory successfully Sep 10 04:26:19.185681 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185665 2578 factory.go:153] Registering CRI-O factory Sep 10 04:26:19.185681 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185682 2578 factory.go:223] Registration of the crio container factory successfully Sep 10 04:26:19.185804 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185729 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 04:26:19.185804 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185747 2578 factory.go:103] Registering Raw factory Sep 10 04:26:19.185804 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.185761 2578 manager.go:1196] Started watching for new ooms in manager Sep 10 04:26:19.186143 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.186128 2578 manager.go:349] Starting recovery of all containers Sep 10 04:26:19.187952 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.187428 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4wcgq" Sep 10 04:26:19.192413 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.192377 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 04:26:19.192900 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.192859 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 04:26:19.195637 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.192499 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-39.ec2.internal.18d3db196904c72d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-39.ec2.internal,UID:ip-10-0-129-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-39.ec2.internal,},FirstTimestamp:2026-09-10 04:26:19.178805037 +0000 UTC m=+0.358010770,LastTimestamp:2026-09-10 04:26:19.178805037 +0000 UTC m=+0.358010770,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-39.ec2.internal,}" Sep 10 04:26:19.195920 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.195900 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4wcgq" Sep 10 04:26:19.201242 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.201225 2578 manager.go:354] Recovery completed Sep 10 04:26:19.205447 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.205381 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:19.207093 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.207076 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:19.207182 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.207108 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:19.207182 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.207123 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:19.207727 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.207712 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 04:26:19.207727 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.207725 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 04:26:19.207828 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.207739 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 10 04:26:19.207828 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.207764 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:19.208477 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.208463 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:19.208554 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.208486 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:19.208554 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.208513 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:19.208821 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.208738 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-39.ec2.internal.18d3db196ab46adf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-39.ec2.internal,UID:ip-10-0-129-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-39.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-39.ec2.internal,},FirstTimestamp:2026-09-10 04:26:19.207092959 +0000 UTC m=+0.386298695,LastTimestamp:2026-09-10 04:26:19.207092959 +0000 UTC m=+0.386298695,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-39.ec2.internal,}" Sep 10 04:26:19.209215 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.209204 2578 policy_none.go:49] "None policy: Start" Sep 10 04:26:19.209274 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.209220 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 04:26:19.209274 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.209230 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 04:26:19.210244 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.210233 2578 policy_none.go:47] "Start" Sep 10 04:26:19.237567 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.237552 2578 manager.go:337] "Starting Device Plugin manager" Sep 10 04:26:19.237647 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.237595 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 04:26:19.237647 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.237608 2578 server.go:87] "Starting device plugin registration server" Sep 10 04:26:19.238000 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.237984 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 04:26:19.238083 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.238008 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 04:26:19.238441 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.238210 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 04:26:19.238441 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.238292 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 04:26:19.238441 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.238301 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 04:26:19.238754 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.238735 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 04:26:19.238888 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.238788 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.287263 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.287236 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 04:26:19.288382 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.288364 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 04:26:19.288448 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.288426 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 04:26:19.288491 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.288451 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 04:26:19.288538 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.288488 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 04:26:19.291012 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.290993 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:19.338978 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.338958 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:19.340608 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.340590 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:19.340687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.340622 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:19.340687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.340633 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:19.340687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.340667 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.346866 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.346851 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.346920 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.346873 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-39.ec2.internal\": node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.360084 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.360067 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.389410 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.389339 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal"] Sep 10 04:26:19.389468 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.389423 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:19.390704 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.390689 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:19.390771 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.390718 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:19.390771 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.390728 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:19.391856 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.391844 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:19.391978 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.391964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.392023 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.391991 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:19.392476 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.392463 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:19.392476 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.392473 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:19.392582 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.392486 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:19.392582 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.392496 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:19.392582 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.392501 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:19.392582 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.392511 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:19.393761 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.393748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.393812 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.393770 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 04:26:19.394399 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.394385 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientMemory" Sep 10 04:26:19.394459 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.394410 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 04:26:19.394459 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.394421 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeHasSufficientPID" Sep 10 04:26:19.426540 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.426522 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-39.ec2.internal\" not found" node="ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.430772 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.430758 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-39.ec2.internal\" not found" node="ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.460688 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.460666 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.487021 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.486990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4fdea23c45a90d63301cf2598441ff7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"b4fdea23c45a90d63301cf2598441ff7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.487113 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.487028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ddc035b1f6b36816b1b1df70406f05f5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-39.ec2.internal\" (UID: \"ddc035b1f6b36816b1b1df70406f05f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.487113 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.487046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4fdea23c45a90d63301cf2598441ff7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"b4fdea23c45a90d63301cf2598441ff7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.561080 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.561056 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.587492 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.587458 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4fdea23c45a90d63301cf2598441ff7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"b4fdea23c45a90d63301cf2598441ff7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.587583 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.587498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4fdea23c45a90d63301cf2598441ff7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"b4fdea23c45a90d63301cf2598441ff7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.587583 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.587541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4fdea23c45a90d63301cf2598441ff7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"b4fdea23c45a90d63301cf2598441ff7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.587583 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.587559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ddc035b1f6b36816b1b1df70406f05f5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-39.ec2.internal\" (UID: \"ddc035b1f6b36816b1b1df70406f05f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.587583 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.587583 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ddc035b1f6b36816b1b1df70406f05f5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-39.ec2.internal\" (UID: \"ddc035b1f6b36816b1b1df70406f05f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.587712 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.587610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4fdea23c45a90d63301cf2598441ff7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal\" (UID: \"b4fdea23c45a90d63301cf2598441ff7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.661771 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.661702 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.728402 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.728366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.734051 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.734032 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Sep 10 04:26:19.762734 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.762710 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.863306 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.863275 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.963775 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:19.963717 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:19.996850 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:19.996828 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:20.064787 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:20.064752 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:20.134245 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.134213 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 04:26:20.134720 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.134375 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 04:26:20.134720 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.134391 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 04:26:20.166654 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:20.166611 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:20.200339 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.200297 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 04:21:19 +0000 UTC" deadline="2028-05-04 01:22:38.342591444 +0000 UTC" Sep 10 04:26:20.200339 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.200331 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14444h56m18.142265485s" Sep 10 04:26:20.267219 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:20.267146 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:20.336304 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:20.336058 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc035b1f6b36816b1b1df70406f05f5.slice/crio-92a29de786bbf3e8336911a783dae460cb28ec7b5b8a27652bcc3645d1462425 WatchSource:0}: Error finding container 92a29de786bbf3e8336911a783dae460cb28ec7b5b8a27652bcc3645d1462425: Status 404 returned error can't find the container with id 92a29de786bbf3e8336911a783dae460cb28ec7b5b8a27652bcc3645d1462425 Sep 10 04:26:20.336564 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:20.336538 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fdea23c45a90d63301cf2598441ff7.slice/crio-aa7d8cabb5693680b402456b368c8759e1177f30bbdc9d3985ef2cc7d0d36d98 WatchSource:0}: Error finding container aa7d8cabb5693680b402456b368c8759e1177f30bbdc9d3985ef2cc7d0d36d98: Status 404 returned error can't find the container with id aa7d8cabb5693680b402456b368c8759e1177f30bbdc9d3985ef2cc7d0d36d98 Sep 10 04:26:20.342605 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.342587 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 04:26:20.368249 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:20.368220 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:20.379498 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.379475 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:20.472016 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:20.471962 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:20.572187 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:20.572119 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-39.ec2.internal\" not found" Sep 10 04:26:20.648254 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.648221 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:20.685483 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.685454 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" Sep 10 04:26:20.695964 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.695931 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 04:26:20.698739 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.698317 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" Sep 10 04:26:20.708011 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:20.707986 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 04:26:21.169986 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.169910 2578 apiserver.go:52] "Watching apiserver" Sep 10 04:26:21.175721 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.175691 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 04:26:21.176273 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.176246 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-s9btl","openshift-image-registry/node-ca-wxq8f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal","openshift-multus/multus-additional-cni-plugins-6jcps","openshift-multus/multus-kpbl6","kube-system/global-pull-secret-syncer-mfb5v","openshift-dns/node-resolver-9klcc","openshift-multus/network-metrics-daemon-65vps","openshift-network-diagnostics/network-check-target-zb5qd","openshift-network-operator/iptables-alerter-mcs4h","openshift-ovn-kubernetes/ovnkube-node-48n48","kube-system/konnectivity-agent-8dnfh","kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw"] Sep 10 04:26:21.178008 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.177978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.179487 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.179466 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.180561 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.180310 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 04:26:21.180561 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.180350 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:26:21.180734 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.180600 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gr6mf\"" Sep 10 04:26:21.180935 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.180817 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 04:26:21.181719 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.181214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.182325 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182294 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 04:26:21.182425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182332 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 04:26:21.182497 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182432 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwnp5\"" Sep 10 04:26:21.182551 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182510 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 04:26:21.182551 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182336 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 04:26:21.182756 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 04:26:21.182832 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182778 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:21.182892 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.182865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 04:26:21.182941 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.182899 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:21.183114 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.183093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 04:26:21.183210 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.183177 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 04:26:21.183408 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.183389 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kh7zf\"" Sep 10 04:26:21.184159 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.183733 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 04:26:21.184159 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.183821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.184828 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.184809 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 04:26:21.185585 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.185242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.186318 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.185723 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7l8xk\"" Sep 10 04:26:21.186318 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.185771 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 04:26:21.186318 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.185891 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 04:26:21.186318 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.185891 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 04:26:21.186318 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.186104 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 04:26:21.186778 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.186756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:21.186934 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.186830 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:21.187101 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.187083 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 04:26:21.187589 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.187475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cr4dg\"" Sep 10 04:26:21.187836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.187816 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 04:26:21.189243 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.188925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.191234 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.190703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.191234 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.191223 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-57klp\"" Sep 10 04:26:21.191399 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.191272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 04:26:21.191463 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.191441 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 04:26:21.193348 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.193195 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 04:26:21.193611 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.193591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 04:26:21.194062 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.194041 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 04:26:21.194146 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.194134 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pvnt7\"" Sep 10 04:26:21.197003 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.196985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.197228 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-conf-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.197306 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:21.197306 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-kubelet\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.197415 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-var-lib-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.197415 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-system-cni-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.197415 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-cni-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.197570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tgr5\" (UniqueName: \"kubernetes.io/projected/6746c33b-e34e-455c-b81c-36a4fff92671-kube-api-access-8tgr5\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.197570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a177953c-a1a4-45f5-9387-160fe1319eaa-agent-certs\") pod \"konnectivity-agent-8dnfh\" (UID: \"a177953c-a1a4-45f5-9387-160fe1319eaa\") " pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.197570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a177953c-a1a4-45f5-9387-160fe1319eaa-konnectivity-ca\") pod \"konnectivity-agent-8dnfh\" (UID: \"a177953c-a1a4-45f5-9387-160fe1319eaa\") " pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.197570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-run-netns\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.197570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.197570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-ovn\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a316b1fd-211c-4baf-9900-7f1e624ee57b-host-slash\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-netns\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197623 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-etc-kubernetes\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66sgr\" (UniqueName: \"kubernetes.io/projected/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-kube-api-access-66sgr\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-registration-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w4zr\" (UniqueName: \"kubernetes.io/projected/10463e2a-9946-4f71-b491-384228493a8a-kube-api-access-8w4zr\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.197879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-cni-bin\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-multus-certs\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-systemd\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.197976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-cni-netd\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-env-overrides\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.198110 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovn-node-metrics-cert\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.198320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-device-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-k8s-cni-cncf-io\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-cni-multus\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6746c33b-e34e-455c-b81c-36a4fff92671-multus-daemon-config\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-etc-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-log-socket\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovnkube-config\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.198777 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-socket-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.199255 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5wf\" (UniqueName: \"kubernetes.io/projected/a316b1fd-211c-4baf-9900-7f1e624ee57b-kube-api-access-gs5wf\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.199255 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-socket-dir-parent\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.199255 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.198961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-kubelet\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.199255 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-systemd-units\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.199255 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-slash\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.199255 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-sys-fs\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.199577 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a316b1fd-211c-4baf-9900-7f1e624ee57b-iptables-alerter-script\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.199577 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-cnibin\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.199683 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-hostroot\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.199683 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-node-log\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.199683 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-cni-bin\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.199683 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199655 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jc52b\"" Sep 10 04:26:21.199883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.199883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovnkube-script-lib\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.199883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:21.199883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-226th\" (UniqueName: \"kubernetes.io/projected/5f180f4c-4210-41ef-8601-951bece8a406-kube-api-access-226th\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:21.199883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199792 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 04:26:21.199883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.199794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6746c33b-e34e-455c-b81c-36a4fff92671-cni-binary-copy\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.200207 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.200033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.200207 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.200045 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:26:21.202347 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.202324 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 04:26:21.202443 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.202386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 04:26:21.202706 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.202688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pgljq\"" Sep 10 04:26:21.213473 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.213446 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnfbc" Sep 10 04:26:21.224331 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.224300 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnfbc" Sep 10 04:26:21.264991 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.264961 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:21.287291 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.287266 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 04:26:21.295254 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.295191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" event={"ID":"ddc035b1f6b36816b1b1df70406f05f5","Type":"ContainerStarted","Data":"92a29de786bbf3e8336911a783dae460cb28ec7b5b8a27652bcc3645d1462425"} Sep 10 04:26:21.297857 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.297828 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" event={"ID":"b4fdea23c45a90d63301cf2598441ff7","Type":"ContainerStarted","Data":"aa7d8cabb5693680b402456b368c8759e1177f30bbdc9d3985ef2cc7d0d36d98"} Sep 10 04:26:21.300278 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-cni-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.300380 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tgr5\" (UniqueName: \"kubernetes.io/projected/6746c33b-e34e-455c-b81c-36a4fff92671-kube-api-access-8tgr5\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.300380 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-run-netns\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.300380 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-sys\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.300618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-lib-modules\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.300618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-tuned\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.300618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a316b1fd-211c-4baf-9900-7f1e624ee57b-host-slash\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.300618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-netns\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.300618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300574 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-netns\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.300618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-run-netns\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.300618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysctl-d\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a316b1fd-211c-4baf-9900-7f1e624ee57b-host-slash\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-cni-bin\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-multus-certs\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-systemd\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-cni-bin\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-cni-netd\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-multus-certs\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300814 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-cni-netd\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-device-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysctl-conf\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-systemd\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-host\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-device-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6fd51def-abce-4b16-b3fe-5726ed40beea-dbus\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-k8s-cni-cncf-io\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301036 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6746c33b-e34e-455c-b81c-36a4fff92671-multus-daemon-config\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.300555 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-cni-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-log-socket\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysconfig\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-run-k8s-cni-cncf-io\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnpd\" (UniqueName: \"kubernetes.io/projected/5477004b-baed-4260-ba6a-0dac6f89fd0b-kube-api-access-jfnpd\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a316b1fd-211c-4baf-9900-7f1e624ee57b-iptables-alerter-script\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-hostroot\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovnkube-script-lib\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/168b05f1-90ad-4efa-90b0-58fbc982ff48-serviceca\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-tmp-dir\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-sys-fs\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/168b05f1-90ad-4efa-90b0-58fbc982ff48-host\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6746c33b-e34e-455c-b81c-36a4fff92671-cni-binary-copy\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-conf-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-var-lib-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.301875 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-log-socket\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-ovn\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-ovn\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-env-overrides\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301563 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6746c33b-e34e-455c-b81c-36a4fff92671-multus-daemon-config\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-system-cni-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a177953c-a1a4-45f5-9387-160fe1319eaa-agent-certs\") pod \"konnectivity-agent-8dnfh\" (UID: \"a177953c-a1a4-45f5-9387-160fe1319eaa\") " pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301682 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-sys-fs\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301791 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a316b1fd-211c-4baf-9900-7f1e624ee57b-iptables-alerter-script\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301866 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-conf-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.301907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-var-lib-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302029 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-env-overrides\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302065 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-hostroot\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a177953c-a1a4-45f5-9387-160fe1319eaa-konnectivity-ca\") pod \"konnectivity-agent-8dnfh\" (UID: \"a177953c-a1a4-45f5-9387-160fe1319eaa\") " pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn62c\" (UniqueName: \"kubernetes.io/projected/168b05f1-90ad-4efa-90b0-58fbc982ff48-kube-api-access-kn62c\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.302655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mllp\" (UniqueName: \"kubernetes.io/projected/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-kube-api-access-2mllp\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302157 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovnkube-script-lib\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-var-lib-kubelet\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302178 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-system-cni-dir\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5477004b-baed-4260-ba6a-0dac6f89fd0b-tmp\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302208 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6746c33b-e34e-455c-b81c-36a4fff92671-cni-binary-copy\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-system-cni-dir\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-etc-kubernetes\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-run\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-etc-kubernetes\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302421 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cnibin\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-systemd\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-cni-multus\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.303514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-etc-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302577 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a177953c-a1a4-45f5-9387-160fe1319eaa-konnectivity-ca\") pod \"konnectivity-agent-8dnfh\" (UID: \"a177953c-a1a4-45f5-9387-160fe1319eaa\") " pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-cni-multus\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovnkube-config\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302653 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-etc-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-socket-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-modprobe-d\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-kubernetes\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptptw\" (UniqueName: \"kubernetes.io/projected/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-kube-api-access-ptptw\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302826 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-socket-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5wf\" (UniqueName: \"kubernetes.io/projected/a316b1fd-211c-4baf-9900-7f1e624ee57b-kube-api-access-gs5wf\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-socket-dir-parent\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302854 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-kubelet\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-systemd-units\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.304405 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-slash\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.302997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6fd51def-abce-4b16-b3fe-5726ed40beea-kubelet-config\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-cnibin\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-node-log\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-cni-bin\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303152 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-cni-bin\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303165 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-slash\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303208 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-cnibin\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303221 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovnkube-config\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66sgr\" (UniqueName: \"kubernetes.io/projected/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-kube-api-access-66sgr\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-node-log\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-registration-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w4zr\" (UniqueName: \"kubernetes.io/projected/10463e2a-9946-4f71-b491-384228493a8a-kube-api-access-8w4zr\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-systemd-units\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-multus-socket-dir-parent\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.305238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303303 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6746c33b-e34e-455c-b81c-36a4fff92671-host-var-lib-kubelet\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-226th\" (UniqueName: \"kubernetes.io/projected/5f180f4c-4210-41ef-8601-951bece8a406-kube-api-access-226th\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-kubelet\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10463e2a-9946-4f71-b491-384228493a8a-registration-dir\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovn-node-metrics-cert\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-hosts-file\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.303538 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-host-kubelet\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.303572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-run-openvswitch\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.306032 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.303603 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:21.803583662 +0000 UTC m=+2.982789381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:21.309041 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.308780 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a177953c-a1a4-45f5-9387-160fe1319eaa-agent-certs\") pod \"konnectivity-agent-8dnfh\" (UID: \"a177953c-a1a4-45f5-9387-160fe1319eaa\") " pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.309041 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.308983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-ovn-node-metrics-cert\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.310532 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.310432 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tgr5\" (UniqueName: \"kubernetes.io/projected/6746c33b-e34e-455c-b81c-36a4fff92671-kube-api-access-8tgr5\") pod \"multus-kpbl6\" (UID: \"6746c33b-e34e-455c-b81c-36a4fff92671\") " pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.314665 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.314638 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:21.314768 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.314681 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:21.314768 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.314696 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6txts for pod openshift-network-diagnostics/network-check-target-zb5qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:21.314875 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.314776 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts podName:42b6e19f-71b1-43ba-be33-795b8d5dd2b3 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:21.8147572 +0000 UTC m=+2.993962922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6txts" (UniqueName: "kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts") pod "network-check-target-zb5qd" (UID: "42b6e19f-71b1-43ba-be33-795b8d5dd2b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:21.315119 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.314911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5wf\" (UniqueName: \"kubernetes.io/projected/a316b1fd-211c-4baf-9900-7f1e624ee57b-kube-api-access-gs5wf\") pod \"iptables-alerter-mcs4h\" (UID: \"a316b1fd-211c-4baf-9900-7f1e624ee57b\") " pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.315772 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.315747 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w4zr\" (UniqueName: \"kubernetes.io/projected/10463e2a-9946-4f71-b491-384228493a8a-kube-api-access-8w4zr\") pod \"aws-ebs-csi-driver-node-cbwlw\" (UID: \"10463e2a-9946-4f71-b491-384228493a8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.320334 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.320310 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-226th\" (UniqueName: \"kubernetes.io/projected/5f180f4c-4210-41ef-8601-951bece8a406-kube-api-access-226th\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:21.321049 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.321006 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66sgr\" (UniqueName: \"kubernetes.io/projected/a018a8b0-0d3a-4663-925e-8bcbb50ec5b5-kube-api-access-66sgr\") pod \"ovnkube-node-48n48\" (UID: \"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.404863 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.404826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/168b05f1-90ad-4efa-90b0-58fbc982ff48-serviceca\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.404863 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.404859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-tmp-dir\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.404878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.404901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/168b05f1-90ad-4efa-90b0-58fbc982ff48-host\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.404930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62c\" (UniqueName: \"kubernetes.io/projected/168b05f1-90ad-4efa-90b0-58fbc982ff48-kube-api-access-kn62c\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.404956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mllp\" (UniqueName: \"kubernetes.io/projected/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-kube-api-access-2mllp\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.404996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-var-lib-kubelet\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5477004b-baed-4260-ba6a-0dac6f89fd0b-tmp\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-system-cni-dir\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-run\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.405122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cnibin\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-systemd\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-modprobe-d\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-kubernetes\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptptw\" (UniqueName: \"kubernetes.io/projected/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-kube-api-access-ptptw\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-tmp-dir\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6fd51def-abce-4b16-b3fe-5726ed40beea-kubelet-config\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-hosts-file\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.405396 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/168b05f1-90ad-4efa-90b0-58fbc982ff48-serviceca\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-sys\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-lib-modules\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.405463 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret podName:6fd51def-abce-4b16-b3fe-5726ed40beea nodeName:}" failed. No retries permitted until 2026-09-10 04:26:21.905445916 +0000 UTC m=+3.084651656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret") pod "global-pull-secret-syncer-mfb5v" (UID: "6fd51def-abce-4b16-b3fe-5726ed40beea") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-kubernetes\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-tuned\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.405542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405514 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cnibin\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysctl-d\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-lib-modules\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysctl-conf\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-host\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405609 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysctl-d\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6fd51def-abce-4b16-b3fe-5726ed40beea-dbus\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405634 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6fd51def-abce-4b16-b3fe-5726ed40beea-kubelet-config\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/168b05f1-90ad-4efa-90b0-58fbc982ff48-host\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysconfig\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysconfig\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnpd\" (UniqueName: \"kubernetes.io/projected/5477004b-baed-4260-ba6a-0dac6f89fd0b-kube-api-access-jfnpd\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405762 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-modprobe-d\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405776 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-hosts-file\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405792 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-sys\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-host\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.406212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.405999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406015 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-sysctl-conf\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406002 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-system-cni-dir\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406070 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-var-lib-kubelet\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-systemd\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6fd51def-abce-4b16-b3fe-5726ed40beea-dbus\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406248 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5477004b-baed-4260-ba6a-0dac6f89fd0b-run\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.407033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.406726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.408834 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.408812 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5477004b-baed-4260-ba6a-0dac6f89fd0b-etc-tuned\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.409089 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.409068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5477004b-baed-4260-ba6a-0dac6f89fd0b-tmp\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.417371 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.417323 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnpd\" (UniqueName: \"kubernetes.io/projected/5477004b-baed-4260-ba6a-0dac6f89fd0b-kube-api-access-jfnpd\") pod \"tuned-s9btl\" (UID: \"5477004b-baed-4260-ba6a-0dac6f89fd0b\") " pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.417492 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.417388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptptw\" (UniqueName: \"kubernetes.io/projected/4133922b-1aea-4f2b-a8e7-b3aaa93485d6-kube-api-access-ptptw\") pod \"multus-additional-cni-plugins-6jcps\" (UID: \"4133922b-1aea-4f2b-a8e7-b3aaa93485d6\") " pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.417865 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.417842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mllp\" (UniqueName: \"kubernetes.io/projected/dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778-kube-api-access-2mllp\") pod \"node-resolver-9klcc\" (UID: \"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778\") " pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.420559 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.420501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn62c\" (UniqueName: \"kubernetes.io/projected/168b05f1-90ad-4efa-90b0-58fbc982ff48-kube-api-access-kn62c\") pod \"node-ca-wxq8f\" (UID: \"168b05f1-90ad-4efa-90b0-58fbc982ff48\") " pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.495375 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.495336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mcs4h" Sep 10 04:26:21.505789 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.505762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:21.508580 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:21.508550 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda316b1fd_211c_4baf_9900_7f1e624ee57b.slice/crio-a5a8ac6a30ea5d1fdb24f8cfe58642c6b019fc162e2de48a260a5f33c4fbdfcd WatchSource:0}: Error finding container a5a8ac6a30ea5d1fdb24f8cfe58642c6b019fc162e2de48a260a5f33c4fbdfcd: Status 404 returned error can't find the container with id a5a8ac6a30ea5d1fdb24f8cfe58642c6b019fc162e2de48a260a5f33c4fbdfcd Sep 10 04:26:21.514624 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:21.514596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda018a8b0_0d3a_4663_925e_8bcbb50ec5b5.slice/crio-896369e9d87e3286ced23b513898e9f752ab12e5513f25ba3aaf493d5e410025 WatchSource:0}: Error finding container 896369e9d87e3286ced23b513898e9f752ab12e5513f25ba3aaf493d5e410025: Status 404 returned error can't find the container with id 896369e9d87e3286ced23b513898e9f752ab12e5513f25ba3aaf493d5e410025 Sep 10 04:26:21.515532 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.515509 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" Sep 10 04:26:21.522410 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.522239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpbl6" Sep 10 04:26:21.525338 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:21.525310 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10463e2a_9946_4f71_b491_384228493a8a.slice/crio-36a6c0cf6b9d55696c034c077bbd1db48bfa317e1a23b9fd2106fe4a00ddf757 WatchSource:0}: Error finding container 36a6c0cf6b9d55696c034c077bbd1db48bfa317e1a23b9fd2106fe4a00ddf757: Status 404 returned error can't find the container with id 36a6c0cf6b9d55696c034c077bbd1db48bfa317e1a23b9fd2106fe4a00ddf757 Sep 10 04:26:21.531192 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.530988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:21.531413 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:21.531392 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6746c33b_e34e_455c_b81c_36a4fff92671.slice/crio-834906160c986d1e971306edc07a0a8fd382ecf2dd4a3589886fd838657bf7ae WatchSource:0}: Error finding container 834906160c986d1e971306edc07a0a8fd382ecf2dd4a3589886fd838657bf7ae: Status 404 returned error can't find the container with id 834906160c986d1e971306edc07a0a8fd382ecf2dd4a3589886fd838657bf7ae Sep 10 04:26:21.539538 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.539514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9klcc" Sep 10 04:26:21.539998 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:21.539961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda177953c_a1a4_45f5_9387_160fe1319eaa.slice/crio-661633a8bb6bcd45f30c1de2175d85e706abf90ea0b7c7db174c37aea24473e6 WatchSource:0}: Error finding container 661633a8bb6bcd45f30c1de2175d85e706abf90ea0b7c7db174c37aea24473e6: Status 404 returned error can't find the container with id 661633a8bb6bcd45f30c1de2175d85e706abf90ea0b7c7db174c37aea24473e6 Sep 10 04:26:21.548254 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.548230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxq8f" Sep 10 04:26:21.559128 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.559107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9btl" Sep 10 04:26:21.566075 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.566048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jcps" Sep 10 04:26:21.809345 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.809256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:21.809528 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.809433 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:21.809528 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.809510 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:22.80949041 +0000 UTC m=+3.988696141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:21.910470 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.910430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:21.910644 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:21.910486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:21.910644 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.910583 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:21.910644 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.910621 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:21.910644 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.910638 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret podName:6fd51def-abce-4b16-b3fe-5726ed40beea nodeName:}" failed. No retries permitted until 2026-09-10 04:26:22.910623539 +0000 UTC m=+4.089829268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret") pod "global-pull-secret-syncer-mfb5v" (UID: "6fd51def-abce-4b16-b3fe-5726ed40beea") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:21.910644 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.910646 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:21.910871 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.910663 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6txts for pod openshift-network-diagnostics/network-check-target-zb5qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:21.910871 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:21.910718 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts podName:42b6e19f-71b1-43ba-be33-795b8d5dd2b3 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:22.910700699 +0000 UTC m=+4.089906430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6txts" (UniqueName: "kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts") pod "network-check-target-zb5qd" (UID: "42b6e19f-71b1-43ba-be33-795b8d5dd2b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:22.227077 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.226998 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:21:21 +0000 UTC" deadline="2028-04-06 16:39:00.569194286 +0000 UTC" Sep 10 04:26:22.227077 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.227032 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13788h12m38.342166796s" Sep 10 04:26:22.289634 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.289596 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:22.289634 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.289632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:22.289846 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.289765 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:22.289915 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.289895 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:22.300472 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.300441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8dnfh" event={"ID":"a177953c-a1a4-45f5-9387-160fe1319eaa","Type":"ContainerStarted","Data":"661633a8bb6bcd45f30c1de2175d85e706abf90ea0b7c7db174c37aea24473e6"} Sep 10 04:26:22.301796 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.301765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpbl6" event={"ID":"6746c33b-e34e-455c-b81c-36a4fff92671","Type":"ContainerStarted","Data":"834906160c986d1e971306edc07a0a8fd382ecf2dd4a3589886fd838657bf7ae"} Sep 10 04:26:22.303206 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.303176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" event={"ID":"10463e2a-9946-4f71-b491-384228493a8a","Type":"ContainerStarted","Data":"36a6c0cf6b9d55696c034c077bbd1db48bfa317e1a23b9fd2106fe4a00ddf757"} Sep 10 04:26:22.304751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.304716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"896369e9d87e3286ced23b513898e9f752ab12e5513f25ba3aaf493d5e410025"} Sep 10 04:26:22.306195 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.306171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mcs4h" event={"ID":"a316b1fd-211c-4baf-9900-7f1e624ee57b","Type":"ContainerStarted","Data":"a5a8ac6a30ea5d1fdb24f8cfe58642c6b019fc162e2de48a260a5f33c4fbdfcd"} Sep 10 04:26:22.779898 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:22.779866 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5477004b_baed_4260_ba6a_0dac6f89fd0b.slice/crio-4eac5a228e7c23a8fb2a214a590990dc9325ce68ef3514f05740d200730cd95c WatchSource:0}: Error finding container 4eac5a228e7c23a8fb2a214a590990dc9325ce68ef3514f05740d200730cd95c: Status 404 returned error can't find the container with id 4eac5a228e7c23a8fb2a214a590990dc9325ce68ef3514f05740d200730cd95c Sep 10 04:26:22.780578 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:22.780549 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4133922b_1aea_4f2b_a8e7_b3aaa93485d6.slice/crio-b2a3b84f8e0cd86f91de01b3918d311b80e07a1ccd557287bc967b396ac1876b WatchSource:0}: Error finding container b2a3b84f8e0cd86f91de01b3918d311b80e07a1ccd557287bc967b396ac1876b: Status 404 returned error can't find the container with id b2a3b84f8e0cd86f91de01b3918d311b80e07a1ccd557287bc967b396ac1876b Sep 10 04:26:22.804417 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:22.804382 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba58b6d_a2a6_408d_a3e8_2ce8aa3d3778.slice/crio-cd69e875adf006cf9d1c0f2780ce60e4b012113e7accebdf0e32e8ac3f9dd662 WatchSource:0}: Error finding container cd69e875adf006cf9d1c0f2780ce60e4b012113e7accebdf0e32e8ac3f9dd662: Status 404 returned error can't find the container with id cd69e875adf006cf9d1c0f2780ce60e4b012113e7accebdf0e32e8ac3f9dd662 Sep 10 04:26:22.804870 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:22.804838 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168b05f1_90ad_4efa_90b0_58fbc982ff48.slice/crio-3aedf85ec7250261ae0d0be92a46ebc43456f572edbccc322f10eb586d1cc36c WatchSource:0}: Error finding container 3aedf85ec7250261ae0d0be92a46ebc43456f572edbccc322f10eb586d1cc36c: Status 404 returned error can't find the container with id 3aedf85ec7250261ae0d0be92a46ebc43456f572edbccc322f10eb586d1cc36c Sep 10 04:26:22.817716 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.817687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:22.817900 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.817880 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:22.817982 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.817943 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:24.817924855 +0000 UTC m=+5.997130578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:22.918349 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.918305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:22.918488 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:22.918411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:22.918627 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.918548 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:22.918627 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.918593 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:22.918627 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.918622 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret podName:6fd51def-abce-4b16-b3fe-5726ed40beea nodeName:}" failed. No retries permitted until 2026-09-10 04:26:24.918602925 +0000 UTC m=+6.097808645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret") pod "global-pull-secret-syncer-mfb5v" (UID: "6fd51def-abce-4b16-b3fe-5726ed40beea") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:22.918627 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.918623 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:22.918837 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.918643 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6txts for pod openshift-network-diagnostics/network-check-target-zb5qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:22.918837 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:22.918698 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts podName:42b6e19f-71b1-43ba-be33-795b8d5dd2b3 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:24.918679807 +0000 UTC m=+6.097885543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6txts" (UniqueName: "kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts") pod "network-check-target-zb5qd" (UID: "42b6e19f-71b1-43ba-be33-795b8d5dd2b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:23.044285 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.044200 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 04:26:23.227304 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.227197 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:21:21 +0000 UTC" deadline="2028-05-03 07:40:44.333940007 +0000 UTC" Sep 10 04:26:23.227304 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.227268 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14427h14m21.106676489s" Sep 10 04:26:23.292098 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.291980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:23.292271 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:23.292143 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:23.314206 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.314167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxq8f" event={"ID":"168b05f1-90ad-4efa-90b0-58fbc982ff48","Type":"ContainerStarted","Data":"3aedf85ec7250261ae0d0be92a46ebc43456f572edbccc322f10eb586d1cc36c"} Sep 10 04:26:23.321518 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.321485 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerStarted","Data":"b2a3b84f8e0cd86f91de01b3918d311b80e07a1ccd557287bc967b396ac1876b"} Sep 10 04:26:23.338404 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.338361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" event={"ID":"b4fdea23c45a90d63301cf2598441ff7","Type":"ContainerStarted","Data":"172132a1018f0c9b4844f92885c1d5824586ef5355d0d5a38d05383e3a8cf65b"} Sep 10 04:26:23.359053 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.357080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9btl" event={"ID":"5477004b-baed-4260-ba6a-0dac6f89fd0b","Type":"ContainerStarted","Data":"4eac5a228e7c23a8fb2a214a590990dc9325ce68ef3514f05740d200730cd95c"} Sep 10 04:26:23.371785 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.371752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9klcc" event={"ID":"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778","Type":"ContainerStarted","Data":"cd69e875adf006cf9d1c0f2780ce60e4b012113e7accebdf0e32e8ac3f9dd662"} Sep 10 04:26:23.381583 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:23.381550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" event={"ID":"ddc035b1f6b36816b1b1df70406f05f5","Type":"ContainerStarted","Data":"3adf7e32a1f2d8d28958393e4dc6fd2c35180707d252bd2ad21618b266135901"} Sep 10 04:26:24.290277 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.289687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:24.290277 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.289832 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:24.290277 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.290117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:24.290277 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.290232 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:24.388934 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.388310 2578 generic.go:356] "Generic (PLEG): container finished" podID="b4fdea23c45a90d63301cf2598441ff7" containerID="172132a1018f0c9b4844f92885c1d5824586ef5355d0d5a38d05383e3a8cf65b" exitCode=0 Sep 10 04:26:24.388934 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.388858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" event={"ID":"b4fdea23c45a90d63301cf2598441ff7","Type":"ContainerDied","Data":"172132a1018f0c9b4844f92885c1d5824586ef5355d0d5a38d05383e3a8cf65b"} Sep 10 04:26:24.405591 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.403900 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-39.ec2.internal" podStartSLOduration=3.403878863 podStartE2EDuration="3.403878863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:23.397173178 +0000 UTC m=+4.576378920" watchObservedRunningTime="2026-09-10 04:26:24.403878863 +0000 UTC m=+5.583084607" Sep 10 04:26:24.836896 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.836246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:24.836896 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.836423 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:24.836896 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.836499 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:28.83647908 +0000 UTC m=+10.015684821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.936703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:24.936780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.936932 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.936954 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.936967 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6txts for pod openshift-network-diagnostics/network-check-target-zb5qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.937046 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts podName:42b6e19f-71b1-43ba-be33-795b8d5dd2b3 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:28.937026917 +0000 UTC m=+10.116232640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6txts" (UniqueName: "kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts") pod "network-check-target-zb5qd" (UID: "42b6e19f-71b1-43ba-be33-795b8d5dd2b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.937483 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:24.937580 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:24.937547 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret podName:6fd51def-abce-4b16-b3fe-5726ed40beea nodeName:}" failed. No retries permitted until 2026-09-10 04:26:28.937530492 +0000 UTC m=+10.116736211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret") pod "global-pull-secret-syncer-mfb5v" (UID: "6fd51def-abce-4b16-b3fe-5726ed40beea") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:25.292145 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:25.291567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:25.292145 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:25.291709 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:26.289352 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:26.289316 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:26.289536 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:26.289458 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:26.289920 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:26.289898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:26.290057 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:26.290039 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:27.289157 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:27.289052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:27.289605 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:27.289191 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:28.289573 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:28.289494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:28.290024 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.289640 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:28.290024 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:28.289687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:28.290024 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.289815 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:28.870121 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:28.870074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:28.870376 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.870243 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:28.870376 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.870313 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:36.870291962 +0000 UTC m=+18.049497700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:28.970635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:28.970725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.970813 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.970843 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.970849 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.970857 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6txts for pod openshift-network-diagnostics/network-check-target-zb5qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.970911 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret podName:6fd51def-abce-4b16-b3fe-5726ed40beea nodeName:}" failed. No retries permitted until 2026-09-10 04:26:36.970892632 +0000 UTC m=+18.150098364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret") pod "global-pull-secret-syncer-mfb5v" (UID: "6fd51def-abce-4b16-b3fe-5726ed40beea") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:28.971258 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:28.970929 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts podName:42b6e19f-71b1-43ba-be33-795b8d5dd2b3 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:36.970920055 +0000 UTC m=+18.150125775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6txts" (UniqueName: "kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts") pod "network-check-target-zb5qd" (UID: "42b6e19f-71b1-43ba-be33-795b8d5dd2b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:29.291133 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:29.289969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:29.291133 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:29.290088 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:30.289230 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:30.289178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:30.289406 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:30.289177 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:30.289406 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:30.289316 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:30.289526 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:30.289499 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:31.289293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:31.289255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:31.289754 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:31.289393 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:32.288741 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:32.288709 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:32.288929 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:32.288745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:32.288929 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:32.288841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:32.289054 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:32.288982 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:33.289026 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:33.288987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:33.289479 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:33.289128 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:34.289672 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:34.289631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:34.290164 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:34.289681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:34.290164 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:34.289767 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:34.290164 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:34.289898 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:35.292473 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:35.292438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:35.292874 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:35.292546 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:36.289152 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:36.289117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:36.289389 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:36.289117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:36.289389 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:36.289270 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:36.289389 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:36.289298 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:36.930122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:36.930082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:36.930578 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:36.930232 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:36.930578 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:36.930299 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:52.930282604 +0000 UTC m=+34.109488331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:37.030979 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:37.030922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:37.031161 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:37.031007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:37.031161 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:37.031061 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:37.031161 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:37.031124 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:37.031161 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:37.031142 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret podName:6fd51def-abce-4b16-b3fe-5726ed40beea nodeName:}" failed. No retries permitted until 2026-09-10 04:26:53.031121763 +0000 UTC m=+34.210327493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret") pod "global-pull-secret-syncer-mfb5v" (UID: "6fd51def-abce-4b16-b3fe-5726ed40beea") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:37.031161 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:37.031145 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:37.031161 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:37.031159 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6txts for pod openshift-network-diagnostics/network-check-target-zb5qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:37.031450 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:37.031202 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts podName:42b6e19f-71b1-43ba-be33-795b8d5dd2b3 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:53.031187306 +0000 UTC m=+34.210393027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6txts" (UniqueName: "kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts") pod "network-check-target-zb5qd" (UID: "42b6e19f-71b1-43ba-be33-795b8d5dd2b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:37.289239 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:37.289152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:37.289401 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:37.289272 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:38.288984 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:38.288932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:38.289393 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:38.289005 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:38.289393 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:38.289078 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:38.289393 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:38.289190 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:39.290166 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:39.290137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:39.290597 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:39.290243 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:40.289236 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.289095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:40.289324 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.289164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:40.289378 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:40.289315 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:40.289427 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:40.289410 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:40.421000 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.420969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" event={"ID":"10463e2a-9946-4f71-b491-384228493a8a","Type":"ContainerStarted","Data":"12be62e7bbc839e3c28fdc870354dfb2f23095a3513f54b6567cd610483265cd"} Sep 10 04:26:40.422981 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.422962 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:26:40.423362 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.423344 2578 generic.go:356] "Generic (PLEG): container finished" podID="a018a8b0-0d3a-4663-925e-8bcbb50ec5b5" containerID="7764007e867e117e755d26ea7a137ca6d2af5bd884b79c7fcb5f7727661be1b5" exitCode=1 Sep 10 04:26:40.423432 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.423383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"764c0cee60cb15e7ef4b8d20436bac9cdf1711f3de2d77ac718c19e76e40e32c"} Sep 10 04:26:40.423485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.423471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerDied","Data":"7764007e867e117e755d26ea7a137ca6d2af5bd884b79c7fcb5f7727661be1b5"} Sep 10 04:26:40.423549 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.423530 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"695b409834801d5f7e2029ec0026b29a252243b7ae8c02d54cb965dbabc90d29"} Sep 10 04:26:40.424911 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.424888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxq8f" event={"ID":"168b05f1-90ad-4efa-90b0-58fbc982ff48","Type":"ContainerStarted","Data":"ae78d42b1a7917a8d412c540a4e87c89bc2fa37545545a907d012f45adf58c73"} Sep 10 04:26:40.426466 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.426445 2578 generic.go:356] "Generic (PLEG): container finished" podID="4133922b-1aea-4f2b-a8e7-b3aaa93485d6" containerID="95feefaef0d962e1dffcdc5182669ddebee8ea06c7e1b8bfb02c38d263c34d86" exitCode=0 Sep 10 04:26:40.426544 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.426511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerDied","Data":"95feefaef0d962e1dffcdc5182669ddebee8ea06c7e1b8bfb02c38d263c34d86"} Sep 10 04:26:40.428553 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.428529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" event={"ID":"b4fdea23c45a90d63301cf2598441ff7","Type":"ContainerStarted","Data":"e8eba5a9a9a2f40f4e36f342f6b07526daf462c080255374845f7abda0913423"} Sep 10 04:26:40.430544 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.430523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpbl6" event={"ID":"6746c33b-e34e-455c-b81c-36a4fff92671","Type":"ContainerStarted","Data":"63a8e43e005390148911143eec791c1d2781295e426cf48d98f9a3e69325e1f2"} Sep 10 04:26:40.432262 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.432228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9btl" event={"ID":"5477004b-baed-4260-ba6a-0dac6f89fd0b","Type":"ContainerStarted","Data":"40ea6b8c165dfe5ef388fd0ba2be252af001f389cd7ee30fc5f7dc00d827d0b0"} Sep 10 04:26:40.433838 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.433788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9klcc" event={"ID":"dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778","Type":"ContainerStarted","Data":"6eca7077e08e18c27959535adafde7108105c493557e42cb3a42fc510e481c40"} Sep 10 04:26:40.435328 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.435310 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8dnfh" event={"ID":"a177953c-a1a4-45f5-9387-160fe1319eaa","Type":"ContainerStarted","Data":"47a92525ffba1103db83005d4624fe577fee7030ec0656930d47e985437cc494"} Sep 10 04:26:40.437284 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.437243 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wxq8f" podStartSLOduration=3.285100993 podStartE2EDuration="20.437231617s" totalImagesPullingTime="17.152130624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:40.437173696 +0000 UTC m=+21.616379433" watchObservedRunningTime="2026-09-10 04:26:40.437231617 +0000 UTC m=+21.616437368" Sep 10 04:26:40.451530 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.451468 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8dnfh" podStartSLOduration=3.031247283 podStartE2EDuration="21.451446336s" totalImagesPullingTime="18.420199053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:40.450567943 +0000 UTC m=+21.629773680" watchObservedRunningTime="2026-09-10 04:26:40.451446336 +0000 UTC m=+21.630652081" Sep 10 04:26:40.465727 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.465665 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9klcc" podStartSLOduration=4.313425182 podStartE2EDuration="21.4656419s" totalImagesPullingTime="17.152216718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:40.465037176 +0000 UTC m=+21.644242913" watchObservedRunningTime="2026-09-10 04:26:40.4656419 +0000 UTC m=+21.644847638" Sep 10 04:26:40.481497 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.481455 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s9btl" podStartSLOduration=3.321992314 podStartE2EDuration="20.481439008s" totalImagesPullingTime="17.159446694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:40.480802236 +0000 UTC m=+21.660007977" watchObservedRunningTime="2026-09-10 04:26:40.481439008 +0000 UTC m=+21.660644744" Sep 10 04:26:40.497246 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.497204 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-39.ec2.internal" podStartSLOduration=19.497188543 podStartE2EDuration="19.497188543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:40.496894523 +0000 UTC m=+21.676100260" watchObservedRunningTime="2026-09-10 04:26:40.497188543 +0000 UTC m=+21.676394280" Sep 10 04:26:40.512572 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.512501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kpbl6" podStartSLOduration=2.714597845 podStartE2EDuration="21.512482871s" totalImagesPullingTime="18.797885026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:40.512105503 +0000 UTC m=+21.691311322" watchObservedRunningTime="2026-09-10 04:26:40.512482871 +0000 UTC m=+21.691688608" Sep 10 04:26:40.515904 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.515872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:40.606146 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.606120 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:40.660328 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.660303 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:40.660759 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.660744 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:40.677486 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.677463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:40.735127 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:40.735090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:41.288864 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.288830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:41.289039 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:41.289016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:41.441247 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.441219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:26:41.441915 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.441702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"e13e104751934bab319c00142ff8f9b8aaae075bc157f451fc953015728ab1cc"} Sep 10 04:26:41.441915 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.441796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"5b10c8cc428c04ce6697687bf9d07e6e40d46ee0ff19357a70a91bd13fe1bfc5"} Sep 10 04:26:41.441915 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.441850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"e9f021ac8df344d27ab9ac2bcb73d7200d5d4d29e6fd4065548775ef4ba27ccc"} Sep 10 04:26:41.443469 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.443443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mcs4h" event={"ID":"a316b1fd-211c-4baf-9900-7f1e624ee57b","Type":"ContainerStarted","Data":"f2e2139c61abf30cac3c200f72153055dba6d32d92abc6f8e4262a29626c865c"} Sep 10 04:26:41.459253 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.459175 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mcs4h" podStartSLOduration=7.88656059 podStartE2EDuration="22.459161861s" totalImagesPullingTime="14.572601271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:41.458764622 +0000 UTC m=+22.637970360" watchObservedRunningTime="2026-09-10 04:26:41.459161861 +0000 UTC m=+22.638367598" Sep 10 04:26:41.576849 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.576813 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:41.677314 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.677278 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:41.731502 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:41.731473 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 04:26:42.251750 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:42.251656 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T04:26:41.73149625Z","UUID":"4217c634-69fa-4dc1-a9f4-fb3ba6f59c53","Handler":null,"Name":"","Endpoint":""} Sep 10 04:26:42.253052 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:42.253037 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 04:26:42.253216 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:42.253063 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 04:26:42.289341 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:42.289303 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:42.289474 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:42.289430 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:42.289728 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:42.289308 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:42.289842 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:42.289821 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:42.448011 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:42.447975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" event={"ID":"10463e2a-9946-4f71-b491-384228493a8a","Type":"ContainerStarted","Data":"3d2a3073501752e6f64f7472e64bc7283b56d2261aed34f8bfc1298eaaf4205b"} Sep 10 04:26:42.448011 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:42.448017 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 04:26:43.289245 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:43.289209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:43.289407 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:43.289343 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:43.455655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:43.455610 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" event={"ID":"10463e2a-9946-4f71-b491-384228493a8a","Type":"ContainerStarted","Data":"59eedc33f5f3bf96f4e8ebc81eac229bb84fb8c3279729ac83342fb272fd6073"} Sep 10 04:26:43.458856 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:43.458832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:26:43.459260 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:43.459240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"68f25f3c843c7fdadddee25ed1b1164600f8f091832f57a6cd631b70fd0c1712"} Sep 10 04:26:43.472116 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:43.472082 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbwlw" podStartSLOduration=7.167728047 podStartE2EDuration="24.472071158s" totalImagesPullingTime="17.304343111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:43.471753875 +0000 UTC m=+24.650959611" watchObservedRunningTime="2026-09-10 04:26:43.472071158 +0000 UTC m=+24.651276895" Sep 10 04:26:44.111120 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:44.111084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:44.163802 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:44.163756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:44.289197 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:44.289164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:44.289365 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:44.289207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:44.289365 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:44.289297 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:44.289484 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:44.289448 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:45.289031 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.288852 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:45.289453 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:45.289109 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:45.468687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.468663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:26:45.469146 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.469115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"f3b5b9ae37ded58744eb194c493e680acdb23ff5cf1c9195f4cccde8dc1370d2"} Sep 10 04:26:45.469542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.469346 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:45.469542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.469430 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:45.469542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.469482 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:45.469542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.469537 2578 scope.go:117] "RemoveContainer" containerID="7764007e867e117e755d26ea7a137ca6d2af5bd884b79c7fcb5f7727661be1b5" Sep 10 04:26:45.471678 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.471652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerStarted","Data":"d33ff8d496af067b7ffd65e897602e724cfc534af6a6c1679639cf339ca38bb2"} Sep 10 04:26:45.485167 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.485145 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:45.485311 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.485294 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:26:45.578341 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.578316 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:45.630864 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:45.630831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:46.289235 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:46.289205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:46.289834 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:46.289209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:46.289834 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:46.289310 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:46.289834 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:46.289390 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:46.478348 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:46.477607 2578 generic.go:356] "Generic (PLEG): container finished" podID="4133922b-1aea-4f2b-a8e7-b3aaa93485d6" containerID="d33ff8d496af067b7ffd65e897602e724cfc534af6a6c1679639cf339ca38bb2" exitCode=0 Sep 10 04:26:46.478348 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:46.477964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerDied","Data":"d33ff8d496af067b7ffd65e897602e724cfc534af6a6c1679639cf339ca38bb2"} Sep 10 04:26:46.487434 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:46.487228 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:26:46.487953 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:46.487906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" event={"ID":"a018a8b0-0d3a-4663-925e-8bcbb50ec5b5","Type":"ContainerStarted","Data":"e14ab125a9b5abdd8794a6c6b2e4f26b2d77f31e115582c02899ec583e9c4a9c"} Sep 10 04:26:46.521520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:46.521475 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" podStartSLOduration=9.03416963 podStartE2EDuration="27.521459564s" totalImagesPullingTime="18.487289934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:46.520471138 +0000 UTC m=+27.699676876" watchObservedRunningTime="2026-09-10 04:26:46.521459564 +0000 UTC m=+27.700665300" Sep 10 04:26:47.171641 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.171534 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mfb5v"] Sep 10 04:26:47.171641 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.171656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:47.171867 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:47.171765 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:47.174860 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.174820 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-65vps"] Sep 10 04:26:47.175046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.174931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:47.175143 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:47.175057 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:47.175518 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.175498 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb5qd"] Sep 10 04:26:47.175656 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.175579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:47.175656 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:47.175643 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:47.459008 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.458979 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:47.459399 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.459092 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 04:26:47.459645 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.459626 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8dnfh" Sep 10 04:26:47.520494 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:47.520460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:48.289216 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:48.289182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:48.289372 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:48.289281 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:48.289372 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:48.289335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:48.289446 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:48.289416 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:48.494144 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:48.494114 2578 generic.go:356] "Generic (PLEG): container finished" podID="4133922b-1aea-4f2b-a8e7-b3aaa93485d6" containerID="1349e18a9cedbc6a810a6dfa0ce88b850cf14d58c19ad17fe3a0d0214c267717" exitCode=0 Sep 10 04:26:48.494486 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:48.494167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerDied","Data":"1349e18a9cedbc6a810a6dfa0ce88b850cf14d58c19ad17fe3a0d0214c267717"} Sep 10 04:26:49.159964 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:49.159917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:49.289655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:49.289626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:49.289786 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:49.289706 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:49.651819 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:49.651623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:49.710932 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:49.710903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:49.923208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:49.922934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:50.024188 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:50.024139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:50.289199 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:50.289167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:50.289375 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:50.289274 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:50.289375 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:50.289299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:50.289375 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:50.289350 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:50.500774 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:50.500741 2578 generic.go:356] "Generic (PLEG): container finished" podID="4133922b-1aea-4f2b-a8e7-b3aaa93485d6" containerID="f87918f38845ca99e72a78dbf734f241fc3a583b6e7a58da39e1ceeb51f95964" exitCode=0 Sep 10 04:26:50.500899 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:50.500785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerDied","Data":"f87918f38845ca99e72a78dbf734f241fc3a583b6e7a58da39e1ceeb51f95964"} Sep 10 04:26:51.288773 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:51.288744 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:51.289383 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:51.288867 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb5qd" podUID="42b6e19f-71b1-43ba-be33-795b8d5dd2b3" Sep 10 04:26:52.288702 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:52.288670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:52.288958 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:52.288803 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-65vps" podUID="5f180f4c-4210-41ef-8601-951bece8a406" Sep 10 04:26:52.288958 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:52.288836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:52.288958 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:52.288907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mfb5v" podUID="6fd51def-abce-4b16-b3fe-5726ed40beea" Sep 10 04:26:52.946672 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:52.946641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:52.946862 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:52.946814 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:52.946927 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:52.946893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:24.946871464 +0000 UTC m=+66.126077198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 04:26:53.047922 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.047891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:53.048099 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.047959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:53.048099 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.048048 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:53.048099 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.048089 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 04:26:53.048224 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.048105 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 04:26:53.048224 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.048119 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6txts for pod openshift-network-diagnostics/network-check-target-zb5qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:53.048224 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.048118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret podName:6fd51def-abce-4b16-b3fe-5726ed40beea nodeName:}" failed. No retries permitted until 2026-09-10 04:27:25.048099845 +0000 UTC m=+66.227305566 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret") pod "global-pull-secret-syncer-mfb5v" (UID: "6fd51def-abce-4b16-b3fe-5726ed40beea") : object "kube-system"/"original-pull-secret" not registered Sep 10 04:26:53.048224 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.048175 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts podName:42b6e19f-71b1-43ba-be33-795b8d5dd2b3 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:25.048160802 +0000 UTC m=+66.227366522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6txts" (UniqueName: "kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts") pod "network-check-target-zb5qd" (UID: "42b6e19f-71b1-43ba-be33-795b8d5dd2b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 04:26:53.101798 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.101769 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-39.ec2.internal" event="NodeReady" Sep 10 04:26:53.101970 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.101922 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 04:26:53.146772 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.146746 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h6vhr"] Sep 10 04:26:53.150020 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.149997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.150170 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.150149 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bx6zz"] Sep 10 04:26:53.151996 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.151978 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 04:26:53.152112 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.152016 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 04:26:53.152112 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.152033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w9vrw\"" Sep 10 04:26:53.153588 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.153566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.155458 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.155438 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 04:26:53.155590 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.155520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 04:26:53.155661 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.155588 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 04:26:53.155827 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.155809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-228jb\"" Sep 10 04:26:53.158774 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.158757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h6vhr"] Sep 10 04:26:53.162069 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.162045 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bx6zz"] Sep 10 04:26:53.250321 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.250257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8391c7a9-ac44-4c5c-81ef-294def14a6a8-config-volume\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.250321 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.250298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8391c7a9-ac44-4c5c-81ef-294def14a6a8-tmp-dir\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.250520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.250338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.250520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.250408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99b96eb5-9593-4741-b02f-4fa003bc30ea-cert\") pod \"ingress-canary-bx6zz\" (UID: \"99b96eb5-9593-4741-b02f-4fa003bc30ea\") " pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.250520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.250435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhwj\" (UniqueName: \"kubernetes.io/projected/8391c7a9-ac44-4c5c-81ef-294def14a6a8-kube-api-access-jxhwj\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.250520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.250459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x5lc\" (UniqueName: \"kubernetes.io/projected/99b96eb5-9593-4741-b02f-4fa003bc30ea-kube-api-access-4x5lc\") pod \"ingress-canary-bx6zz\" (UID: \"99b96eb5-9593-4741-b02f-4fa003bc30ea\") " pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.263280 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.263254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:53.289333 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.289297 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:26:53.291848 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.291817 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 04:26:53.291989 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.291926 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9c7m\"" Sep 10 04:26:53.292062 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.291825 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 04:26:53.351768 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.351741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8391c7a9-ac44-4c5c-81ef-294def14a6a8-config-volume\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.351897 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.351772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8391c7a9-ac44-4c5c-81ef-294def14a6a8-tmp-dir\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.351986 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.351920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.352047 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.352030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99b96eb5-9593-4741-b02f-4fa003bc30ea-cert\") pod \"ingress-canary-bx6zz\" (UID: \"99b96eb5-9593-4741-b02f-4fa003bc30ea\") " pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.352087 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.352049 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:53.352087 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.352065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhwj\" (UniqueName: \"kubernetes.io/projected/8391c7a9-ac44-4c5c-81ef-294def14a6a8-kube-api-access-jxhwj\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.352161 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.352090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x5lc\" (UniqueName: \"kubernetes.io/projected/99b96eb5-9593-4741-b02f-4fa003bc30ea-kube-api-access-4x5lc\") pod \"ingress-canary-bx6zz\" (UID: \"99b96eb5-9593-4741-b02f-4fa003bc30ea\") " pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.352161 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.352100 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls podName:8391c7a9-ac44-4c5c-81ef-294def14a6a8 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:53.852086066 +0000 UTC m=+35.031291796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls") pod "dns-default-h6vhr" (UID: "8391c7a9-ac44-4c5c-81ef-294def14a6a8") : secret "dns-default-metrics-tls" not found Sep 10 04:26:53.352161 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.352112 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8391c7a9-ac44-4c5c-81ef-294def14a6a8-tmp-dir\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.352448 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.352423 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8391c7a9-ac44-4c5c-81ef-294def14a6a8-config-volume\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.357480 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.357457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99b96eb5-9593-4741-b02f-4fa003bc30ea-cert\") pod \"ingress-canary-bx6zz\" (UID: \"99b96eb5-9593-4741-b02f-4fa003bc30ea\") " pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.360927 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.360882 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhwj\" (UniqueName: \"kubernetes.io/projected/8391c7a9-ac44-4c5c-81ef-294def14a6a8-kube-api-access-jxhwj\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.361068 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.361041 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x5lc\" (UniqueName: \"kubernetes.io/projected/99b96eb5-9593-4741-b02f-4fa003bc30ea-kube-api-access-4x5lc\") pod \"ingress-canary-bx6zz\" (UID: \"99b96eb5-9593-4741-b02f-4fa003bc30ea\") " pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.363682 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.363650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:53.467298 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.467262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bx6zz" Sep 10 04:26:53.647678 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.647578 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:53.703851 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.703810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:53.855278 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:53.855240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:53.855443 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.855404 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:53.855491 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:53.855475 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls podName:8391c7a9-ac44-4c5c-81ef-294def14a6a8 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:54.855456129 +0000 UTC m=+36.034661864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls") pod "dns-default-h6vhr" (UID: "8391c7a9-ac44-4c5c-81ef-294def14a6a8") : secret "dns-default-metrics-tls" not found Sep 10 04:26:54.289058 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:54.289026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:26:54.289291 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:54.289025 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:26:54.291931 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:54.291687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 04:26:54.291931 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:54.291734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 04:26:54.291931 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:54.291843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lmcvv\"" Sep 10 04:26:54.864199 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:54.864166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:54.864377 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:54.864354 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:54.864454 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:54.864440 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls podName:8391c7a9-ac44-4c5c-81ef-294def14a6a8 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:56.864417475 +0000 UTC m=+38.043623192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls") pod "dns-default-h6vhr" (UID: "8391c7a9-ac44-4c5c-81ef-294def14a6a8") : secret "dns-default-metrics-tls" not found Sep 10 04:26:54.914241 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:54.914157 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bx6zz"] Sep 10 04:26:54.921707 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:26:54.921672 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b96eb5_9593_4741_b02f_4fa003bc30ea.slice/crio-60617df8807f5d616cab7a7e34bd6370d1f2b445d6ed4ac366d92591a4d37bf9 WatchSource:0}: Error finding container 60617df8807f5d616cab7a7e34bd6370d1f2b445d6ed4ac366d92591a4d37bf9: Status 404 returned error can't find the container with id 60617df8807f5d616cab7a7e34bd6370d1f2b445d6ed4ac366d92591a4d37bf9 Sep 10 04:26:55.515243 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:55.515206 2578 generic.go:356] "Generic (PLEG): container finished" podID="4133922b-1aea-4f2b-a8e7-b3aaa93485d6" containerID="430c2f69a645b2ab7c43f591679eea0dbf89b2847ac63f43055a540ad5ad01fc" exitCode=0 Sep 10 04:26:55.515649 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:55.515262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerDied","Data":"430c2f69a645b2ab7c43f591679eea0dbf89b2847ac63f43055a540ad5ad01fc"} Sep 10 04:26:55.516441 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:55.516419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bx6zz" event={"ID":"99b96eb5-9593-4741-b02f-4fa003bc30ea","Type":"ContainerStarted","Data":"60617df8807f5d616cab7a7e34bd6370d1f2b445d6ed4ac366d92591a4d37bf9"} Sep 10 04:26:56.521698 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:56.521670 2578 generic.go:356] "Generic (PLEG): container finished" podID="4133922b-1aea-4f2b-a8e7-b3aaa93485d6" containerID="91a648219410383aacdf735b5a0c1ddd1fd3302728af90caeb0dcc68c1fd8c5f" exitCode=0 Sep 10 04:26:56.522118 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:56.521712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerDied","Data":"91a648219410383aacdf735b5a0c1ddd1fd3302728af90caeb0dcc68c1fd8c5f"} Sep 10 04:26:56.880233 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:56.880133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:26:56.880404 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:56.880306 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:26:56.880404 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:26:56.880370 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls podName:8391c7a9-ac44-4c5c-81ef-294def14a6a8 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:00.88035348 +0000 UTC m=+42.059559209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls") pod "dns-default-h6vhr" (UID: "8391c7a9-ac44-4c5c-81ef-294def14a6a8") : secret "dns-default-metrics-tls" not found Sep 10 04:26:57.527046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:57.526861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jcps" event={"ID":"4133922b-1aea-4f2b-a8e7-b3aaa93485d6","Type":"ContainerStarted","Data":"3ba2b04a4e159a5560940bb2ca9c505e257b60a5cda98f7c0066b3f252d37cbb"} Sep 10 04:26:57.553818 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:57.553724 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6jcps" podStartSLOduration=9.303813332 podStartE2EDuration="37.553706237s" totalImagesPullingTime="28.249892905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:57.55229981 +0000 UTC m=+38.731505549" watchObservedRunningTime="2026-09-10 04:26:57.553706237 +0000 UTC m=+38.732911975" Sep 10 04:26:57.555326 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:57.555301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:57.654600 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:57.654556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:57.757093 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:57.757054 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:57.813019 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:57.812925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:26:58.530541 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:58.530508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bx6zz" event={"ID":"99b96eb5-9593-4741-b02f-4fa003bc30ea","Type":"ContainerStarted","Data":"534301e423f157bb907ed500177e627f2c32fd53470599411a72579c402472a2"} Sep 10 04:26:58.546539 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:26:58.546487 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bx6zz" podStartSLOduration=3.009845741 podStartE2EDuration="5.546471313s" totalImagesPullingTime="2.536625572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:58.546002847 +0000 UTC m=+39.725208583" watchObservedRunningTime="2026-09-10 04:26:58.546471313 +0000 UTC m=+39.725677050" Sep 10 04:27:00.910647 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:00.910601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:27:00.911046 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:00.910761 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:27:00.911046 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:00.910825 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls podName:8391c7a9-ac44-4c5c-81ef-294def14a6a8 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:08.910809467 +0000 UTC m=+50.090015183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls") pod "dns-default-h6vhr" (UID: "8391c7a9-ac44-4c5c-81ef-294def14a6a8") : secret "dns-default-metrics-tls" not found Sep 10 04:27:04.583352 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:04.583318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:04.641906 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:04.641872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:08.964537 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:08.964496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:27:08.965123 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:08.964630 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:27:08.965123 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:08.964688 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls podName:8391c7a9-ac44-4c5c-81ef-294def14a6a8 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:24.964674566 +0000 UTC m=+66.143880282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls") pod "dns-default-h6vhr" (UID: "8391c7a9-ac44-4c5c-81ef-294def14a6a8") : secret "dns-default-metrics-tls" not found Sep 10 04:27:09.926933 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:09.926898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:10.026900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:10.026860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:17.505982 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:17.505951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48n48" Sep 10 04:27:17.624220 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:17.624188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:17.681759 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:17.681725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:24.974104 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:24.974049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:27:24.974604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:24.974133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:27:24.974604 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:24.974216 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 04:27:24.974604 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:24.974269 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls podName:8391c7a9-ac44-4c5c-81ef-294def14a6a8 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:56.974255481 +0000 UTC m=+98.153461201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls") pod "dns-default-h6vhr" (UID: "8391c7a9-ac44-4c5c-81ef-294def14a6a8") : secret "dns-default-metrics-tls" not found Sep 10 04:27:24.976884 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:24.976863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 04:27:24.985080 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:24.985042 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 04:27:24.985197 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:24.985137 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs podName:5f180f4c-4210-41ef-8601-951bece8a406 nodeName:}" failed. No retries permitted until 2026-09-10 04:28:28.985119689 +0000 UTC m=+130.164325409 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs") pod "network-metrics-daemon-65vps" (UID: "5f180f4c-4210-41ef-8601-951bece8a406") : secret "metrics-daemon-secret" not found Sep 10 04:27:25.074776 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.074743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:27:25.074880 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.074806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:27:25.077230 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.077213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 04:27:25.077285 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.077214 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 04:27:25.087503 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.087475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 04:27:25.089156 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.089133 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fd51def-abce-4b16-b3fe-5726ed40beea-original-pull-secret\") pod \"global-pull-secret-syncer-mfb5v\" (UID: \"6fd51def-abce-4b16-b3fe-5726ed40beea\") " pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:27:25.098098 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.098068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txts\" (UniqueName: \"kubernetes.io/projected/42b6e19f-71b1-43ba-be33-795b8d5dd2b3-kube-api-access-6txts\") pod \"network-check-target-zb5qd\" (UID: \"42b6e19f-71b1-43ba-be33-795b8d5dd2b3\") " pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:27:25.103634 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.103618 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9c7m\"" Sep 10 04:27:25.112204 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.112189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:27:25.207744 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.207714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mfb5v" Sep 10 04:27:25.410750 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.410703 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb5qd"] Sep 10 04:27:25.414346 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:25.414318 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b6e19f_71b1_43ba_be33_795b8d5dd2b3.slice/crio-9d34a2ef56313efce8c69c727339a3e1d5f71244ea7c7c489708aff94b1d6b77 WatchSource:0}: Error finding container 9d34a2ef56313efce8c69c727339a3e1d5f71244ea7c7c489708aff94b1d6b77: Status 404 returned error can't find the container with id 9d34a2ef56313efce8c69c727339a3e1d5f71244ea7c7c489708aff94b1d6b77 Sep 10 04:27:25.497574 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.497478 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mfb5v"] Sep 10 04:27:25.500984 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:25.500960 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd51def_abce_4b16_b3fe_5726ed40beea.slice/crio-cdf183ae2a776768e53a72f279cd8d4851c6fb0288f2328ecbb68adefbac3b61 WatchSource:0}: Error finding container cdf183ae2a776768e53a72f279cd8d4851c6fb0288f2328ecbb68adefbac3b61: Status 404 returned error can't find the container with id cdf183ae2a776768e53a72f279cd8d4851c6fb0288f2328ecbb68adefbac3b61 Sep 10 04:27:25.593542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.593496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb5qd" event={"ID":"42b6e19f-71b1-43ba-be33-795b8d5dd2b3","Type":"ContainerStarted","Data":"9d34a2ef56313efce8c69c727339a3e1d5f71244ea7c7c489708aff94b1d6b77"} Sep 10 04:27:25.594517 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:25.594493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mfb5v" event={"ID":"6fd51def-abce-4b16-b3fe-5726ed40beea","Type":"ContainerStarted","Data":"cdf183ae2a776768e53a72f279cd8d4851c6fb0288f2328ecbb68adefbac3b61"} Sep 10 04:27:26.078882 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.078839 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq"] Sep 10 04:27:26.080798 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.080776 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.083214 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.083191 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 04:27:26.085097 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.085070 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.085097 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.085087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5m2jk\"" Sep 10 04:27:26.085274 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.085174 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.085274 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.085189 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 04:27:26.095520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.095443 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq"] Sep 10 04:27:26.179070 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.179038 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll"] Sep 10 04:27:26.181059 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.181035 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" Sep 10 04:27:26.181557 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.181537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/39e4e57d-d703-4471-8868-62e7e551ec69-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.181658 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.181609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psdb9\" (UniqueName: \"kubernetes.io/projected/39e4e57d-d703-4471-8868-62e7e551ec69-kube-api-access-psdb9\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.181721 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.181703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.183129 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.183083 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.183245 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.183225 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.183347 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.183330 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-prhk8\"" Sep 10 04:27:26.187033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.186773 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-gmvpw"] Sep 10 04:27:26.188679 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.188659 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv"] Sep 10 04:27:26.188801 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.188785 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.195802 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.195674 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 10 04:27:26.197928 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.197906 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 10 04:27:26.198627 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.198581 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hpkqq"] Sep 10 04:27:26.198724 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.198673 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.198724 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.198694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-74l7r\"" Sep 10 04:27:26.198828 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.198788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:26.199002 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.198977 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.200762 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.200697 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll"] Sep 10 04:27:26.200860 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.200829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" Sep 10 04:27:26.201910 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.201879 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hpkqq"] Sep 10 04:27:26.202301 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.202279 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 10 04:27:26.202556 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.202533 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv"] Sep 10 04:27:26.202710 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.202693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.206237 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.205652 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.206237 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.205751 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bxbnk\"" Sep 10 04:27:26.206237 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.205849 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 04:27:26.206237 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.206075 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-b4mlq\"" Sep 10 04:27:26.214675 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.214075 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-gmvpw"] Sep 10 04:27:26.278133 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.278100 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27"] Sep 10 04:27:26.280353 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.280326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.282197 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-serving-cert\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.282310 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.282310 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7rf2\" (UniqueName: \"kubernetes.io/projected/0a439850-c330-454a-b338-6ae2b045b6b9-kube-api-access-l7rf2\") pod \"volume-data-source-validator-695c895bd6-jvzll\" (UID: \"0a439850-c330-454a-b338-6ae2b045b6b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" Sep 10 04:27:26.282419 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-trusted-ca\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.282419 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq6jh\" (UniqueName: \"kubernetes.io/projected/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-kube-api-access-vq6jh\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.282419 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bh2\" (UniqueName: \"kubernetes.io/projected/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-kube-api-access-75bh2\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.282419 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/39e4e57d-d703-4471-8868-62e7e551ec69-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.282604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-config\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.282604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-serving-cert\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.282604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sjbl\" (UniqueName: \"kubernetes.io/projected/20597051-07ce-495a-a465-2ae9e9d8796a-kube-api-access-2sjbl\") pod \"network-check-source-685456655f-hpkqq\" (UID: \"20597051-07ce-495a-a465-2ae9e9d8796a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" Sep 10 04:27:26.282604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qpnr\" (UniqueName: \"kubernetes.io/projected/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-kube-api-access-9qpnr\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:26.282604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdb9\" (UniqueName: \"kubernetes.io/projected/39e4e57d-d703-4471-8868-62e7e551ec69-kube-api-access-psdb9\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.282604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:26.282604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.282599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-config\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.282979 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.282739 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:26.282979 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.282801 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls podName:39e4e57d-d703-4471-8868-62e7e551ec69 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:26.782782089 +0000 UTC m=+67.961987811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-98bgq" (UID: "39e4e57d-d703-4471-8868-62e7e551ec69") : secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:26.283786 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.283749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/39e4e57d-d703-4471-8868-62e7e551ec69-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.284212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.284194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 04:27:26.284402 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.284381 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 04:27:26.285178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.284499 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fttx5\"" Sep 10 04:27:26.285178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.284696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:27:26.285178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.284826 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 04:27:26.296862 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.296466 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27"] Sep 10 04:27:26.307502 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.307477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdb9\" (UniqueName: \"kubernetes.io/projected/39e4e57d-d703-4471-8868-62e7e551ec69-kube-api-access-psdb9\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.346713 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.346608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:26.383738 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-config\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.383900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-serving-cert\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.383900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sjbl\" (UniqueName: \"kubernetes.io/projected/20597051-07ce-495a-a465-2ae9e9d8796a-kube-api-access-2sjbl\") pod \"network-check-source-685456655f-hpkqq\" (UID: \"20597051-07ce-495a-a465-2ae9e9d8796a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" Sep 10 04:27:26.383900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpnr\" (UniqueName: \"kubernetes.io/projected/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-kube-api-access-9qpnr\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:26.383900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:26.383900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-config\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.383900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-serving-cert\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.384236 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7rf2\" (UniqueName: \"kubernetes.io/projected/0a439850-c330-454a-b338-6ae2b045b6b9-kube-api-access-l7rf2\") pod \"volume-data-source-validator-695c895bd6-jvzll\" (UID: \"0a439850-c330-454a-b338-6ae2b045b6b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" Sep 10 04:27:26.384236 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.383980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-trusted-ca\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.384236 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.384016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq6jh\" (UniqueName: \"kubernetes.io/projected/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-kube-api-access-vq6jh\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.384236 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.384040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bh2\" (UniqueName: \"kubernetes.io/projected/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-kube-api-access-75bh2\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.384740 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.384687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-config\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.384740 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.384737 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-config\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.384917 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.384841 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 04:27:26.384917 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.384908 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls podName:ecee25df-cfc7-4d3b-bce9-7e923f42d2fa nodeName:}" failed. No retries permitted until 2026-09-10 04:27:26.884888481 +0000 UTC m=+68.064094210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v75vv" (UID: "ecee25df-cfc7-4d3b-bce9-7e923f42d2fa") : secret "samples-operator-tls" not found Sep 10 04:27:26.385273 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.385233 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-trusted-ca\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.387149 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.387106 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-serving-cert\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.387239 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.387150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-serving-cert\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.395206 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.395180 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bh2\" (UniqueName: \"kubernetes.io/projected/5ae90873-31f3-4d9a-9ccd-09ea9055bbbe-kube-api-access-75bh2\") pod \"service-ca-operator-859f94c4b-j8c27\" (UID: \"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.400355 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.399085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7rf2\" (UniqueName: \"kubernetes.io/projected/0a439850-c330-454a-b338-6ae2b045b6b9-kube-api-access-l7rf2\") pod \"volume-data-source-validator-695c895bd6-jvzll\" (UID: \"0a439850-c330-454a-b338-6ae2b045b6b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" Sep 10 04:27:26.400355 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.400137 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qpnr\" (UniqueName: \"kubernetes.io/projected/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-kube-api-access-9qpnr\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:26.400902 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.400512 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sjbl\" (UniqueName: \"kubernetes.io/projected/20597051-07ce-495a-a465-2ae9e9d8796a-kube-api-access-2sjbl\") pod \"network-check-source-685456655f-hpkqq\" (UID: \"20597051-07ce-495a-a465-2ae9e9d8796a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" Sep 10 04:27:26.401104 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.401080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq6jh\" (UniqueName: \"kubernetes.io/projected/3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9-kube-api-access-vq6jh\") pod \"console-operator-85b454874b-gmvpw\" (UID: \"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9\") " pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.447506 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.447476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:26.499311 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.499282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" Sep 10 04:27:26.508417 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.508396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:26.520155 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.520129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" Sep 10 04:27:26.593227 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.592975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" Sep 10 04:27:26.778252 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.778213 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll"] Sep 10 04:27:26.781852 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:26.781821 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a439850_c330_454a_b338_6ae2b045b6b9.slice/crio-87b32abb71b81fbbb492ea0509c020fe998cf9b4a0849c513c83a3c4d5c2757b WatchSource:0}: Error finding container 87b32abb71b81fbbb492ea0509c020fe998cf9b4a0849c513c83a3c4d5c2757b: Status 404 returned error can't find the container with id 87b32abb71b81fbbb492ea0509c020fe998cf9b4a0849c513c83a3c4d5c2757b Sep 10 04:27:26.786691 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.786667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:26.786885 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.786833 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:26.786980 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.786901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls podName:39e4e57d-d703-4471-8868-62e7e551ec69 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:27.786883595 +0000 UTC m=+68.966089313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-98bgq" (UID: "39e4e57d-d703-4471-8868-62e7e551ec69") : secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:26.799997 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.799930 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-gmvpw"] Sep 10 04:27:26.805865 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:26.805833 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc1f1dd_b5d0_4c8a_b917_9d8d9a83f5a9.slice/crio-2b979047e52e16366dac5b5c83e5ece434c4082835366e4869175a9104a6848f WatchSource:0}: Error finding container 2b979047e52e16366dac5b5c83e5ece434c4082835366e4869175a9104a6848f: Status 404 returned error can't find the container with id 2b979047e52e16366dac5b5c83e5ece434c4082835366e4869175a9104a6848f Sep 10 04:27:26.808126 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.808057 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hpkqq"] Sep 10 04:27:26.811676 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:26.811645 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20597051_07ce_495a_a465_2ae9e9d8796a.slice/crio-89909af05831b80d16880a576864adf0046525da1132894cd1386f1fe7770dde WatchSource:0}: Error finding container 89909af05831b80d16880a576864adf0046525da1132894cd1386f1fe7770dde: Status 404 returned error can't find the container with id 89909af05831b80d16880a576864adf0046525da1132894cd1386f1fe7770dde Sep 10 04:27:26.873591 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.873485 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27"] Sep 10 04:27:26.876871 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:26.876842 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae90873_31f3_4d9a_9ccd_09ea9055bbbe.slice/crio-24f4fdcafce3d6fcb7d94b32728a889d8756d1a00a8319fe0e588a5dfe78d48f WatchSource:0}: Error finding container 24f4fdcafce3d6fcb7d94b32728a889d8756d1a00a8319fe0e588a5dfe78d48f: Status 404 returned error can't find the container with id 24f4fdcafce3d6fcb7d94b32728a889d8756d1a00a8319fe0e588a5dfe78d48f Sep 10 04:27:26.887282 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:26.887257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:26.887378 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.887356 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 04:27:26.887445 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:26.887400 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls podName:ecee25df-cfc7-4d3b-bce9-7e923f42d2fa nodeName:}" failed. No retries permitted until 2026-09-10 04:27:27.887387504 +0000 UTC m=+69.066593218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v75vv" (UID: "ecee25df-cfc7-4d3b-bce9-7e923f42d2fa") : secret "samples-operator-tls" not found Sep 10 04:27:27.602475 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:27.602357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" event={"ID":"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe","Type":"ContainerStarted","Data":"24f4fdcafce3d6fcb7d94b32728a889d8756d1a00a8319fe0e588a5dfe78d48f"} Sep 10 04:27:27.604208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:27.604108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" event={"ID":"20597051-07ce-495a-a465-2ae9e9d8796a","Type":"ContainerStarted","Data":"89909af05831b80d16880a576864adf0046525da1132894cd1386f1fe7770dde"} Sep 10 04:27:27.605867 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:27.605807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" event={"ID":"0a439850-c330-454a-b338-6ae2b045b6b9","Type":"ContainerStarted","Data":"87b32abb71b81fbbb492ea0509c020fe998cf9b4a0849c513c83a3c4d5c2757b"} Sep 10 04:27:27.608572 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:27.608487 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" event={"ID":"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9","Type":"ContainerStarted","Data":"2b979047e52e16366dac5b5c83e5ece434c4082835366e4869175a9104a6848f"} Sep 10 04:27:27.796185 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:27.796140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:27.796346 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:27.796324 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:27.796424 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:27.796398 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls podName:39e4e57d-d703-4471-8868-62e7e551ec69 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:29.796377995 +0000 UTC m=+70.975583737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-98bgq" (UID: "39e4e57d-d703-4471-8868-62e7e551ec69") : secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:27.896625 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:27.896529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:27.896797 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:27.896758 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 04:27:27.896856 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:27.896826 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls podName:ecee25df-cfc7-4d3b-bce9-7e923f42d2fa nodeName:}" failed. No retries permitted until 2026-09-10 04:27:29.896806585 +0000 UTC m=+71.076012317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v75vv" (UID: "ecee25df-cfc7-4d3b-bce9-7e923f42d2fa") : secret "samples-operator-tls" not found Sep 10 04:27:29.812928 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:29.812883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:29.813368 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:29.813064 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:29.813368 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:29.813154 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls podName:39e4e57d-d703-4471-8868-62e7e551ec69 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.81313069 +0000 UTC m=+74.992336424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-98bgq" (UID: "39e4e57d-d703-4471-8868-62e7e551ec69") : secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:29.913676 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:29.913631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:29.913860 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:29.913796 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 04:27:29.913926 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:29.913872 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls podName:ecee25df-cfc7-4d3b-bce9-7e923f42d2fa nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.913853224 +0000 UTC m=+75.093058943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v75vv" (UID: "ecee25df-cfc7-4d3b-bce9-7e923f42d2fa") : secret "samples-operator-tls" not found Sep 10 04:27:30.198618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.198579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:30.201836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.201808 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln"] Sep 10 04:27:30.204637 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.204617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" Sep 10 04:27:30.206603 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.206577 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 10 04:27:30.206603 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.206594 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 10 04:27:30.207221 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.207196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xwnrf\"" Sep 10 04:27:30.214272 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.214250 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln"] Sep 10 04:27:30.215870 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.215848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhpkm\" (UniqueName: \"kubernetes.io/projected/06ddeb2c-9349-44f8-b5b5-beb4f3644e67-kube-api-access-lhpkm\") pod \"migrator-fdbb8fdff-nbdln\" (UID: \"06ddeb2c-9349-44f8-b5b5-beb4f3644e67\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" Sep 10 04:27:30.279928 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.279879 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:30.296167 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.296129 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nqx5f"] Sep 10 04:27:30.299613 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.299587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.301734 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.301689 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 04:27:30.301734 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.301724 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 04:27:30.302080 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.302062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 04:27:30.302262 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.302236 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 04:27:30.302363 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.302328 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2589\"" Sep 10 04:27:30.312459 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.312430 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nqx5f"] Sep 10 04:27:30.316707 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.316677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhpkm\" (UniqueName: \"kubernetes.io/projected/06ddeb2c-9349-44f8-b5b5-beb4f3644e67-kube-api-access-lhpkm\") pod \"migrator-fdbb8fdff-nbdln\" (UID: \"06ddeb2c-9349-44f8-b5b5-beb4f3644e67\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" Sep 10 04:27:30.316833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.316723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnh4g\" (UniqueName: \"kubernetes.io/projected/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-api-access-lnh4g\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.316833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.316758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e0918d0-6235-4b4a-bd5b-540bc67f140c-crio-socket\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.316833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.316792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e0918d0-6235-4b4a-bd5b-540bc67f140c-data-volume\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.316833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.316806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.316833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.316830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.334361 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.334329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhpkm\" (UniqueName: \"kubernetes.io/projected/06ddeb2c-9349-44f8-b5b5-beb4f3644e67-kube-api-access-lhpkm\") pod \"migrator-fdbb8fdff-nbdln\" (UID: \"06ddeb2c-9349-44f8-b5b5-beb4f3644e67\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" Sep 10 04:27:30.405214 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.405174 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:30.417197 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.417154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e0918d0-6235-4b4a-bd5b-540bc67f140c-crio-socket\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.417368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.417232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e0918d0-6235-4b4a-bd5b-540bc67f140c-data-volume\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.417368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.417261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.417368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.417298 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e0918d0-6235-4b4a-bd5b-540bc67f140c-crio-socket\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.417368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.417300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.417579 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.417401 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:30.417579 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.417403 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:30.417579 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.417437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnh4g\" (UniqueName: \"kubernetes.io/projected/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-api-access-lnh4g\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.417579 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.417466 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:30.917446958 +0000 UTC m=+72.096652700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:30.417579 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.417492 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:30.917481476 +0000 UTC m=+72.096687225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : configmap "kube-rbac-proxy" not found Sep 10 04:27:30.417799 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.417677 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e0918d0-6235-4b4a-bd5b-540bc67f140c-data-volume\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.427619 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.427587 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnh4g\" (UniqueName: \"kubernetes.io/projected/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-api-access-lnh4g\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.514919 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.514838 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" Sep 10 04:27:30.920911 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.920831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.920911 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:30.920884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:30.921391 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.920987 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:30.921391 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.921011 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:30.921391 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.921061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:31.921044454 +0000 UTC m=+73.100250169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : configmap "kube-rbac-proxy" not found Sep 10 04:27:30.921391 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:30.921077 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:31.921070599 +0000 UTC m=+73.100276314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:31.929600 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:31.929560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:31.930025 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:31.929624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:31.930025 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:31.929684 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:31.930025 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:31.929765 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.929747581 +0000 UTC m=+75.108953301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : configmap "kube-rbac-proxy" not found Sep 10 04:27:31.930025 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:31.929773 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:31.930025 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:31.929839 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.929821117 +0000 UTC m=+75.109026846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:32.420971 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.420915 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln"] Sep 10 04:27:32.424804 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:32.424759 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ddeb2c_9349_44f8_b5b5_beb4f3644e67.slice/crio-921e0be94301464ce5940755d55f10581d3bd2befe9cf0a1bf6d56594d153d61 WatchSource:0}: Error finding container 921e0be94301464ce5940755d55f10581d3bd2befe9cf0a1bf6d56594d153d61: Status 404 returned error can't find the container with id 921e0be94301464ce5940755d55f10581d3bd2befe9cf0a1bf6d56594d153d61 Sep 10 04:27:32.627063 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.627021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" event={"ID":"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe","Type":"ContainerStarted","Data":"7b6f69a0a9f958f16c576911ed6679430204078ddbe3b3e6a11ca8cd742a94f3"} Sep 10 04:27:32.628664 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.628633 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" event={"ID":"20597051-07ce-495a-a465-2ae9e9d8796a","Type":"ContainerStarted","Data":"1bc29c171ff8db64dddb91783933a17ad354fde0789f9a24b1a54a9921a8ff1a"} Sep 10 04:27:32.630317 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.630293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb5qd" event={"ID":"42b6e19f-71b1-43ba-be33-795b8d5dd2b3","Type":"ContainerStarted","Data":"5edd5e17c9cf03706dc72b78c5bc77edf4c1e4a1d62bd68b9792b889545d8d60"} Sep 10 04:27:32.630445 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.630354 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:27:32.631910 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.631890 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" event={"ID":"0a439850-c330-454a-b338-6ae2b045b6b9","Type":"ContainerStarted","Data":"b10fcaf341e98f96f0693ea3e57fa90b650209a0b3d7a2f47a18006be00d8146"} Sep 10 04:27:32.633653 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.633633 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/0.log" Sep 10 04:27:32.633754 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.633672 2578 generic.go:356] "Generic (PLEG): container finished" podID="3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9" containerID="4bd962b0f9f94c8e99ef623fab9d6b4b7e760357401e684f19b27b5e8cad36ab" exitCode=255 Sep 10 04:27:32.633754 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.633727 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" event={"ID":"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9","Type":"ContainerDied","Data":"4bd962b0f9f94c8e99ef623fab9d6b4b7e760357401e684f19b27b5e8cad36ab"} Sep 10 04:27:32.633932 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.633911 2578 scope.go:117] "RemoveContainer" containerID="4bd962b0f9f94c8e99ef623fab9d6b4b7e760357401e684f19b27b5e8cad36ab" Sep 10 04:27:32.634976 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.634957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" event={"ID":"06ddeb2c-9349-44f8-b5b5-beb4f3644e67","Type":"ContainerStarted","Data":"921e0be94301464ce5940755d55f10581d3bd2befe9cf0a1bf6d56594d153d61"} Sep 10 04:27:32.636458 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.636439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mfb5v" event={"ID":"6fd51def-abce-4b16-b3fe-5726ed40beea","Type":"ContainerStarted","Data":"912333b998d0fecf7f252607f6cb399bff2d60a1d1fe0002007814cab12d38bb"} Sep 10 04:27:32.642200 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.642155 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" podStartSLOduration=1.367422647 podStartE2EDuration="6.642140643s" totalImagesPullingTime="5.274717996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:32.642116538 +0000 UTC m=+73.821322276" watchObservedRunningTime="2026-09-10 04:27:32.642140643 +0000 UTC m=+73.821346382" Sep 10 04:27:32.672998 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.672016 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-hpkqq" podStartSLOduration=1.333888208 podStartE2EDuration="6.671996907s" totalImagesPullingTime="5.338108699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:32.669783001 +0000 UTC m=+73.848988739" watchObservedRunningTime="2026-09-10 04:27:32.671996907 +0000 UTC m=+73.851202645" Sep 10 04:27:32.672998 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.672308 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jvzll" podStartSLOduration=1.300102389 podStartE2EDuration="6.672297602s" totalImagesPullingTime="5.372195213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:32.655106577 +0000 UTC m=+73.834312314" watchObservedRunningTime="2026-09-10 04:27:32.672297602 +0000 UTC m=+73.851503343" Sep 10 04:27:32.688899 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.688510 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mfb5v" podStartSLOduration=66.036593813 podStartE2EDuration="1m12.688496374s" totalImagesPullingTime="6.651902561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:32.687791891 +0000 UTC m=+73.866997629" watchObservedRunningTime="2026-09-10 04:27:32.688496374 +0000 UTC m=+73.867702119" Sep 10 04:27:32.708812 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.708763 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zb5qd" podStartSLOduration=66.971870419 podStartE2EDuration="1m13.708750692s" totalImagesPullingTime="6.736880273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:32.708130202 +0000 UTC m=+73.887335939" watchObservedRunningTime="2026-09-10 04:27:32.708750692 +0000 UTC m=+73.887956420" Sep 10 04:27:32.855815 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:32.855785 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9klcc_dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778/dns-node-resolver/0.log" Sep 10 04:27:33.122180 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.122145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:33.446874 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.446824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:33.501592 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.501564 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:33.642520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.642488 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:27:33.643525 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.643501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/0.log" Sep 10 04:27:33.643653 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.643547 2578 generic.go:356] "Generic (PLEG): container finished" podID="3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9" containerID="30ca800696ee6c01fbbaa39eac9ed75e8a39a9c17f413a6ca4d5c0876357a141" exitCode=255 Sep 10 04:27:33.643731 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.643654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" event={"ID":"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9","Type":"ContainerDied","Data":"30ca800696ee6c01fbbaa39eac9ed75e8a39a9c17f413a6ca4d5c0876357a141"} Sep 10 04:27:33.643731 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.643706 2578 scope.go:117] "RemoveContainer" containerID="4bd962b0f9f94c8e99ef623fab9d6b4b7e760357401e684f19b27b5e8cad36ab" Sep 10 04:27:33.644131 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.644107 2578 scope.go:117] "RemoveContainer" containerID="30ca800696ee6c01fbbaa39eac9ed75e8a39a9c17f413a6ca4d5c0876357a141" Sep 10 04:27:33.644353 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.644265 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-gmvpw_openshift-console-operator(3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9)\"" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" podUID="3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9" Sep 10 04:27:33.688631 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.688592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:33.736770 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.736696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:33.843586 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.843542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:33.843734 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.843696 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:33.843794 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.843777 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls podName:39e4e57d-d703-4471-8868-62e7e551ec69 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:41.843757333 +0000 UTC m=+83.022963066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-98bgq" (UID: "39e4e57d-d703-4471-8868-62e7e551ec69") : secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:33.944678 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.944650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:33.944835 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.944683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:33.944835 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:33.944708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:33.944835 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.944793 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:33.944966 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.944841 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:37.944826932 +0000 UTC m=+79.124032661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:33.944966 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.944792 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 04:27:33.944966 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.944791 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:33.945082 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.944930 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls podName:ecee25df-cfc7-4d3b-bce9-7e923f42d2fa nodeName:}" failed. No retries permitted until 2026-09-10 04:27:41.944912428 +0000 UTC m=+83.124118159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-v75vv" (UID: "ecee25df-cfc7-4d3b-bce9-7e923f42d2fa") : secret "samples-operator-tls" not found Sep 10 04:27:33.945082 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:33.944989 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:37.944978 +0000 UTC m=+79.124183715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : configmap "kube-rbac-proxy" not found Sep 10 04:27:34.150906 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.150827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:34.252097 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.252057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:34.255168 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.255146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxq8f_168b05f1-90ad-4efa-90b0-58fbc982ff48/node-ca/0.log" Sep 10 04:27:34.648178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.648151 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:27:34.648535 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.648513 2578 scope.go:117] "RemoveContainer" containerID="30ca800696ee6c01fbbaa39eac9ed75e8a39a9c17f413a6ca4d5c0876357a141" Sep 10 04:27:34.648692 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:34.648671 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-gmvpw_openshift-console-operator(3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9)\"" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" podUID="3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9" Sep 10 04:27:34.649964 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.649927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" event={"ID":"06ddeb2c-9349-44f8-b5b5-beb4f3644e67","Type":"ContainerStarted","Data":"c69684de9e58d073f705f9f57d28982807e4223412ee94b422d5a777ea9a08f0"} Sep 10 04:27:34.650064 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.649992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" event={"ID":"06ddeb2c-9349-44f8-b5b5-beb4f3644e67","Type":"ContainerStarted","Data":"5a15055f17aef0b76214e2343a9af4b6fd12037b364018f3010965c719a9e7e9"} Sep 10 04:27:34.676186 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.676084 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-nbdln" podStartSLOduration=2.778342716 podStartE2EDuration="4.676070219s" totalImagesPullingTime="1.897727503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:34.675361498 +0000 UTC m=+75.854567237" watchObservedRunningTime="2026-09-10 04:27:34.676070219 +0000 UTC m=+75.855275963" Sep 10 04:27:34.749448 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.749419 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:34.805372 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.805341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:34.854776 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:34.854754 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bx6zz_99b96eb5-9593-4741-b02f-4fa003bc30ea/serve-healthcheck-canary/0.log" Sep 10 04:27:35.255635 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.255608 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-nbdln_06ddeb2c-9349-44f8-b5b5-beb4f3644e67/migrator/0.log" Sep 10 04:27:35.455088 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.455050 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-nbdln_06ddeb2c-9349-44f8-b5b5-beb4f3644e67/graceful-termination/0.log" Sep 10 04:27:35.968776 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.968743 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-rlm5j"] Sep 10 04:27:35.971787 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.971772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:35.973884 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.973855 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 04:27:35.973884 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.973867 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 04:27:35.974079 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.973872 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dhtnk\"" Sep 10 04:27:35.974486 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.974471 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 04:27:35.974571 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.974544 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 04:27:35.981556 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:35.981533 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-rlm5j"] Sep 10 04:27:36.059895 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.059864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-signing-cabundle\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.060040 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.059929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-signing-key\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.060040 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.059980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rfct\" (UniqueName: \"kubernetes.io/projected/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-kube-api-access-7rfct\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.161197 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.161161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-signing-key\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.161252 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.161213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfct\" (UniqueName: \"kubernetes.io/projected/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-kube-api-access-7rfct\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.161293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.161258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-signing-cabundle\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.161849 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.161832 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-signing-cabundle\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.163512 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.163495 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-signing-key\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.168434 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.168412 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rfct\" (UniqueName: \"kubernetes.io/projected/0d03f90c-e8b3-4336-9ecd-1054cd39a7b1-kube-api-access-7rfct\") pod \"service-ca-75d99c484-rlm5j\" (UID: \"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1\") " pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.251207 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.251124 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:36.280183 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.280148 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-rlm5j" Sep 10 04:27:36.300949 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.300907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:36.508988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.508895 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:36.509110 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.508996 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:36.509305 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.509291 2578 scope.go:117] "RemoveContainer" containerID="30ca800696ee6c01fbbaa39eac9ed75e8a39a9c17f413a6ca4d5c0876357a141" Sep 10 04:27:36.509449 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:36.509432 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-gmvpw_openshift-console-operator(3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9)\"" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" podUID="3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9" Sep 10 04:27:36.548687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.548656 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-rlm5j"] Sep 10 04:27:36.552135 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:36.552110 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d03f90c_e8b3_4336_9ecd_1054cd39a7b1.slice/crio-f7d28cb383de2293c01e351e6c2b239713975666926b9aa0af4aba1127b931da WatchSource:0}: Error finding container f7d28cb383de2293c01e351e6c2b239713975666926b9aa0af4aba1127b931da: Status 404 returned error can't find the container with id f7d28cb383de2293c01e351e6c2b239713975666926b9aa0af4aba1127b931da Sep 10 04:27:36.658458 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.658431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-rlm5j" event={"ID":"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1","Type":"ContainerStarted","Data":"ca0b68c06b13db2c6eafd7f398dc5864f60423898b8221b1e5ef6eb2a8eaf250"} Sep 10 04:27:36.658575 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.658482 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-rlm5j" event={"ID":"0d03f90c-e8b3-4336-9ecd-1054cd39a7b1","Type":"ContainerStarted","Data":"f7d28cb383de2293c01e351e6c2b239713975666926b9aa0af4aba1127b931da"} Sep 10 04:27:36.677597 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.677551 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-rlm5j" podStartSLOduration=1.677535587 podStartE2EDuration="1.677535587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:36.676402878 +0000 UTC m=+77.855608615" watchObservedRunningTime="2026-09-10 04:27:36.677535587 +0000 UTC m=+77.856741324" Sep 10 04:27:36.973624 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:36.973587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:37.889014 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:37.888980 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:37.976726 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:37.976686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:37.976955 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:37.976794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:37.976955 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:37.976886 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 04:27:37.976955 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:37.976906 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:37.977123 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:37.976965 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:45.976929903 +0000 UTC m=+87.156135624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : configmap "kube-rbac-proxy" not found Sep 10 04:27:37.977123 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:37.976993 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:27:45.976974846 +0000 UTC m=+87.156180575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:38.019278 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:38.019245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:38.153667 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:38.153581 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:38.449795 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:38.449759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:38.551647 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:38.551620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:38.650379 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:38.650341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:38.751256 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:38.751159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:38.985398 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:38.985357 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:39.512363 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:39.512310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:40.173950 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:40.173912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:40.378568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:40.378535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:40.566903 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:40.566856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:40.774849 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:40.774818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:40.964058 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:40.964027 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:41.601368 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:41.601337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:41.765897 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:41.765868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:41.907989 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:41.907848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:41.908106 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:41.908007 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:41.908106 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:41.908080 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls podName:39e4e57d-d703-4471-8868-62e7e551ec69 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:57.90806025 +0000 UTC m=+99.087265979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-98bgq" (UID: "39e4e57d-d703-4471-8868-62e7e551ec69") : secret "cluster-monitoring-operator-tls" not found Sep 10 04:27:41.969406 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:41.969371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:42.008706 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.008673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:42.011814 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.011785 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecee25df-cfc7-4d3b-bce9-7e923f42d2fa-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-v75vv\" (UID: \"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:42.126047 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.126018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" Sep 10 04:27:42.366869 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.366832 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:42.391421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.391393 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv"] Sep 10 04:27:42.469269 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.469236 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:42.568085 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.568048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:42.679497 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.679420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" event={"ID":"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa","Type":"ContainerStarted","Data":"9720305d9692e34cd07dc8c5e63c146dd7143ea9535fd8bbd0694b7c9cbdc69c"} Sep 10 04:27:42.768059 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:42.768036 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:43.106992 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:43.106957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:43.208255 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:43.208207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:43.320263 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:43.320230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:43.767461 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:43.767427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:44.190334 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:44.190189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:44.290836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:44.290800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:44.566770 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:44.566739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:44.690616 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:44.690582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" event={"ID":"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa","Type":"ContainerStarted","Data":"d37cfcb723ab547c81b4ddfa07b47ee6df35ac356ef9a5c77f99483d65561f51"} Sep 10 04:27:44.690756 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:44.690659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" event={"ID":"ecee25df-cfc7-4d3b-bce9-7e923f42d2fa","Type":"ContainerStarted","Data":"2fc4165db3bc7aeb02953e009980d1b446d1252446972166bd2d38a7965a6b0d"} Sep 10 04:27:44.704888 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:44.704842 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-v75vv" podStartSLOduration=16.659101394 podStartE2EDuration="18.704827335s" totalImagesPullingTime="2.045725941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:44.704057224 +0000 UTC m=+85.883262962" watchObservedRunningTime="2026-09-10 04:27:44.704827335 +0000 UTC m=+85.884033072" Sep 10 04:27:44.967006 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:44.966971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:45.169244 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:45.169211 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:45.770905 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:45.770864 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:46.044321 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:46.044222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:46.044766 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:46.044323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:46.044766 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:46.044437 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 04:27:46.044766 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:27:46.044523 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls podName:1e0918d0-6235-4b4a-bd5b-540bc67f140c nodeName:}" failed. No retries permitted until 2026-09-10 04:28:02.044502271 +0000 UTC m=+103.223708009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nqx5f" (UID: "1e0918d0-6235-4b4a-bd5b-540bc67f140c") : secret "insights-runtime-extractor-tls" not found Sep 10 04:27:46.044959 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:46.044817 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0918d0-6235-4b4a-bd5b-540bc67f140c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:27:46.369425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:46.369343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:46.568175 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:46.568143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:46.763950 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:46.763916 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:47.167347 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:47.167264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:47.969778 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:47.969728 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:48.168374 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:48.168343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:48.366134 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:48.366035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:48.572208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:48.572167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:49.290830 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:49.290803 2578 scope.go:117] "RemoveContainer" containerID="30ca800696ee6c01fbbaa39eac9ed75e8a39a9c17f413a6ca4d5c0876357a141" Sep 10 04:27:49.641542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:49.641457 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:49.695545 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:49.695503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:49.708620 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:49.708599 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:27:49.708732 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:49.708673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" event={"ID":"3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9","Type":"ContainerStarted","Data":"6a4b0215545014a42666e5dc6217362fe3aee435727066ca493810f66e950009"} Sep 10 04:27:49.708986 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:49.708967 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:49.723754 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:49.723709 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" podStartSLOduration=18.377411434 podStartE2EDuration="23.723695059s" totalImagesPullingTime="5.346283625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:49.722887965 +0000 UTC m=+90.902093703" watchObservedRunningTime="2026-09-10 04:27:49.723695059 +0000 UTC m=+90.902900796" Sep 10 04:27:50.508429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:50.508399 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-gmvpw" Sep 10 04:27:50.677133 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:50.677099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:50.789348 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:50.789270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:50.993666 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:50.993635 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:51.165910 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:51.165830 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:51.582605 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:51.582567 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:51.637256 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:51.637225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:51.766242 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:51.766208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:51.986293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:51.986261 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:52.040645 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:52.040615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:52.368785 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:52.368709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:52.468860 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:52.468825 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:52.571379 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:52.571346 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:53.978090 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:53.978061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:54.028244 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:54.028208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:55.328083 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.328043 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-64fsx"] Sep 10 04:27:55.331178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.331155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-64fsx" Sep 10 04:27:55.333829 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.333812 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 04:27:55.334138 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.334121 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fkjkf\"" Sep 10 04:27:55.334918 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.334905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 04:27:55.343807 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.343783 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-64fsx"] Sep 10 04:27:55.417029 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.417000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7q8\" (UniqueName: \"kubernetes.io/projected/ba970170-1f2d-4860-bffd-53891b6b0710-kube-api-access-fq7q8\") pod \"downloads-85d98c998f-64fsx\" (UID: \"ba970170-1f2d-4860-bffd-53891b6b0710\") " pod="openshift-console/downloads-85d98c998f-64fsx" Sep 10 04:27:55.444977 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.444931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:55.518188 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.518156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7q8\" (UniqueName: \"kubernetes.io/projected/ba970170-1f2d-4860-bffd-53891b6b0710-kube-api-access-fq7q8\") pod \"downloads-85d98c998f-64fsx\" (UID: \"ba970170-1f2d-4860-bffd-53891b6b0710\") " pod="openshift-console/downloads-85d98c998f-64fsx" Sep 10 04:27:55.528836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.528797 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7q8\" (UniqueName: \"kubernetes.io/projected/ba970170-1f2d-4860-bffd-53891b6b0710-kube-api-access-fq7q8\") pod \"downloads-85d98c998f-64fsx\" (UID: \"ba970170-1f2d-4860-bffd-53891b6b0710\") " pod="openshift-console/downloads-85d98c998f-64fsx" Sep 10 04:27:55.544599 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.544574 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:55.639820 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.639740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-64fsx" Sep 10 04:27:55.907119 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:55.907093 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-64fsx"] Sep 10 04:27:55.909421 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:55.909391 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba970170_1f2d_4860_bffd_53891b6b0710.slice/crio-8f46db43f1d3d7b2f9e3de8ad8a7e27115b16a86052834e95d318f182a1a59dd WatchSource:0}: Error finding container 8f46db43f1d3d7b2f9e3de8ad8a7e27115b16a86052834e95d318f182a1a59dd: Status 404 returned error can't find the container with id 8f46db43f1d3d7b2f9e3de8ad8a7e27115b16a86052834e95d318f182a1a59dd Sep 10 04:27:56.390325 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:56.390294 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:56.455492 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:56.455466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:27:56.736272 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:56.736234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-64fsx" event={"ID":"ba970170-1f2d-4860-bffd-53891b6b0710","Type":"ContainerStarted","Data":"8f46db43f1d3d7b2f9e3de8ad8a7e27115b16a86052834e95d318f182a1a59dd"} Sep 10 04:27:57.035269 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.035220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:27:57.038031 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.038004 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8391c7a9-ac44-4c5c-81ef-294def14a6a8-metrics-tls\") pod \"dns-default-h6vhr\" (UID: \"8391c7a9-ac44-4c5c-81ef-294def14a6a8\") " pod="openshift-dns/dns-default-h6vhr" Sep 10 04:27:57.062465 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.062440 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w9vrw\"" Sep 10 04:27:57.071095 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.071065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h6vhr" Sep 10 04:27:57.349828 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.349754 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h6vhr"] Sep 10 04:27:57.353621 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:57.353595 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8391c7a9_ac44_4c5c_81ef_294def14a6a8.slice/crio-93abc283a373c049335f2ed8496a1c887cdfc06dd456e6375ef186565a566851 WatchSource:0}: Error finding container 93abc283a373c049335f2ed8496a1c887cdfc06dd456e6375ef186565a566851: Status 404 returned error can't find the container with id 93abc283a373c049335f2ed8496a1c887cdfc06dd456e6375ef186565a566851 Sep 10 04:27:57.741502 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.741464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h6vhr" event={"ID":"8391c7a9-ac44-4c5c-81ef-294def14a6a8","Type":"ContainerStarted","Data":"93abc283a373c049335f2ed8496a1c887cdfc06dd456e6375ef186565a566851"} Sep 10 04:27:57.944761 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.944726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:57.947362 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:57.947332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39e4e57d-d703-4471-8868-62e7e551ec69-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-98bgq\" (UID: \"39e4e57d-d703-4471-8868-62e7e551ec69\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:58.200421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:58.200377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" Sep 10 04:27:58.479499 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:58.479292 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq"] Sep 10 04:27:58.482559 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:27:58.482174 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e4e57d_d703_4471_8868_62e7e551ec69.slice/crio-a72fa6d8110ad098e5503f95313f81a27059466e9bd45dd1796f2176a2ad380f WatchSource:0}: Error finding container a72fa6d8110ad098e5503f95313f81a27059466e9bd45dd1796f2176a2ad380f: Status 404 returned error can't find the container with id a72fa6d8110ad098e5503f95313f81a27059466e9bd45dd1796f2176a2ad380f Sep 10 04:27:58.747156 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:27:58.747071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" event={"ID":"39e4e57d-d703-4471-8868-62e7e551ec69","Type":"ContainerStarted","Data":"a72fa6d8110ad098e5503f95313f81a27059466e9bd45dd1796f2176a2ad380f"} Sep 10 04:28:00.130798 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:00.130758 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:00.182447 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:00.182383 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:00.765690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:00.765651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h6vhr" event={"ID":"8391c7a9-ac44-4c5c-81ef-294def14a6a8","Type":"ContainerStarted","Data":"68e55f80c67cf0e671bbb2571e6773ca1d9f08557e6800c150e2db1af8c904d1"} Sep 10 04:28:00.768090 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:00.767354 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" event={"ID":"39e4e57d-d703-4471-8868-62e7e551ec69","Type":"ContainerStarted","Data":"91f6e5ee06e23b59c64039700d81ec5771bddf071317960ec673d458405f84c5"} Sep 10 04:28:00.785103 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:00.784818 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-98bgq" podStartSLOduration=32.626622111 podStartE2EDuration="34.78479824s" totalImagesPullingTime="2.158176129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:00.783250942 +0000 UTC m=+101.962456679" watchObservedRunningTime="2026-09-10 04:28:00.78479824 +0000 UTC m=+101.964003978" Sep 10 04:28:01.013231 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.013192 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:01.114120 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.114025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:01.164503 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.164471 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r"] Sep 10 04:28:01.167676 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.167650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" Sep 10 04:28:01.169649 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.169628 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 04:28:01.169771 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.169708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-trlqb\"" Sep 10 04:28:01.174687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.174662 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r"] Sep 10 04:28:01.187376 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.187257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:01.275569 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.275485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1497f8c0-436c-4e6f-84a9-38a3fa9aac91-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jtg8r\" (UID: \"1497f8c0-436c-4e6f-84a9-38a3fa9aac91\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" Sep 10 04:28:01.376156 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.376060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1497f8c0-436c-4e6f-84a9-38a3fa9aac91-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jtg8r\" (UID: \"1497f8c0-436c-4e6f-84a9-38a3fa9aac91\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" Sep 10 04:28:01.376399 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.376204 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:01.379307 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.379259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1497f8c0-436c-4e6f-84a9-38a3fa9aac91-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jtg8r\" (UID: \"1497f8c0-436c-4e6f-84a9-38a3fa9aac91\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" Sep 10 04:28:01.480471 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.480322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" Sep 10 04:28:01.759497 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.759468 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r"] Sep 10 04:28:01.763508 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:01.763481 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1497f8c0_436c_4e6f_84a9_38a3fa9aac91.slice/crio-f5c46724d21fa0e21c8c66b219ffacccd31900bebc8e7563b0235427ec2503d0 WatchSource:0}: Error finding container f5c46724d21fa0e21c8c66b219ffacccd31900bebc8e7563b0235427ec2503d0: Status 404 returned error can't find the container with id f5c46724d21fa0e21c8c66b219ffacccd31900bebc8e7563b0235427ec2503d0 Sep 10 04:28:01.773549 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.773515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h6vhr" event={"ID":"8391c7a9-ac44-4c5c-81ef-294def14a6a8","Type":"ContainerStarted","Data":"d22c2e5082a397049723bcd27e1b562ddfa13b0665c12242950fd794418deeb3"} Sep 10 04:28:01.773666 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.773614 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h6vhr" Sep 10 04:28:01.774891 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.774866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" event={"ID":"1497f8c0-436c-4e6f-84a9-38a3fa9aac91","Type":"ContainerStarted","Data":"f5c46724d21fa0e21c8c66b219ffacccd31900bebc8e7563b0235427ec2503d0"} Sep 10 04:28:01.789637 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:01.789556 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h6vhr" podStartSLOduration=65.503579581 podStartE2EDuration="1m8.789544906s" totalImagesPullingTime="3.285965325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:01.787082548 +0000 UTC m=+102.966288285" watchObservedRunningTime="2026-09-10 04:28:01.789544906 +0000 UTC m=+102.968750642" Sep 10 04:28:02.082030 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:02.081923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:28:02.084573 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:02.084540 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0918d0-6235-4b4a-bd5b-540bc67f140c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nqx5f\" (UID: \"1e0918d0-6235-4b4a-bd5b-540bc67f140c\") " pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:28:02.110601 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:02.110562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nqx5f" Sep 10 04:28:02.391147 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:02.391069 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nqx5f"] Sep 10 04:28:02.394258 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:02.394227 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0918d0_6235_4b4a_bd5b_540bc67f140c.slice/crio-45d6377d229a559930db70c8694bbb27bcf9f07f018f628227a094520a0a359c WatchSource:0}: Error finding container 45d6377d229a559930db70c8694bbb27bcf9f07f018f628227a094520a0a359c: Status 404 returned error can't find the container with id 45d6377d229a559930db70c8694bbb27bcf9f07f018f628227a094520a0a359c Sep 10 04:28:02.780272 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:02.780232 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nqx5f" event={"ID":"1e0918d0-6235-4b4a-bd5b-540bc67f140c","Type":"ContainerStarted","Data":"c99f3ac458193493d4dda0cfefe5972f67e5c23c1f9fa0221c5d3dee85f0a8be"} Sep 10 04:28:02.780434 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:02.780307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nqx5f" event={"ID":"1e0918d0-6235-4b4a-bd5b-540bc67f140c","Type":"ContainerStarted","Data":"45d6377d229a559930db70c8694bbb27bcf9f07f018f628227a094520a0a359c"} Sep 10 04:28:03.647327 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:03.647295 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zb5qd" Sep 10 04:28:03.787357 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:03.787244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" event={"ID":"1497f8c0-436c-4e6f-84a9-38a3fa9aac91","Type":"ContainerStarted","Data":"3dca24e84ad3c85f8679f0af33e25ad2fe8028f45be04dc86964035066797721"} Sep 10 04:28:03.787967 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:03.787806 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" Sep 10 04:28:03.793029 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:03.793002 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" Sep 10 04:28:03.804090 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:03.804039 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jtg8r" podStartSLOduration=1.102819412 podStartE2EDuration="2.804020213s" totalImagesPullingTime="1.701200801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:03.802992547 +0000 UTC m=+104.982198286" watchObservedRunningTime="2026-09-10 04:28:03.804020213 +0000 UTC m=+104.983225952" Sep 10 04:28:04.192911 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:04.192875 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:04.256175 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:04.256135 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:04.497465 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:04.497414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:04.794227 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:04.794144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nqx5f" event={"ID":"1e0918d0-6235-4b4a-bd5b-540bc67f140c","Type":"ContainerStarted","Data":"44620746711a545866d7d94d157fca93c10069fa0cd6c165100a50ae7e4a54b0"} Sep 10 04:28:04.817382 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:04.814378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:04.868955 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:04.868910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:04.934321 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:04.934287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:05.017641 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:05.017608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:06.804576 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:06.804543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nqx5f" event={"ID":"1e0918d0-6235-4b4a-bd5b-540bc67f140c","Type":"ContainerStarted","Data":"66b8de9bc66003c356ecb8e254610a2a595ec81fb47983ba91aefa46e42bc7de"} Sep 10 04:28:06.823082 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:06.823033 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nqx5f" podStartSLOduration=33.447230895 podStartE2EDuration="36.82301466s" totalImagesPullingTime="3.375783765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:27:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:06.822334225 +0000 UTC m=+108.001539961" watchObservedRunningTime="2026-09-10 04:28:06.82301466 +0000 UTC m=+108.002220398" Sep 10 04:28:07.055478 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:07.055361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:07.871725 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:07.871692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:07.937245 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:07.937207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:08.186252 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.186220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:08.243419 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.243386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:08.339663 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.339633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:08.553482 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.553370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:08.571655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.571497 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg"] Sep 10 04:28:08.599804 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.599638 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg"] Sep 10 04:28:08.599804 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.599797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.603401 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.602969 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bwpcj\"" Sep 10 04:28:08.603401 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.603269 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 04:28:08.603887 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.603663 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 04:28:08.604135 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.604066 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 04:28:08.617629 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.617577 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz"] Sep 10 04:28:08.641599 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.640930 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4l9mx"] Sep 10 04:28:08.643736 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.642485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.646868 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.645595 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 04:28:08.646868 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.645659 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 04:28:08.646868 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.646315 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bhttr\"" Sep 10 04:28:08.646868 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.646695 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 04:28:08.661429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.661399 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz"] Sep 10 04:28:08.661535 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.661516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.663265 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.663244 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 04:28:08.663528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.663510 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sltvl\"" Sep 10 04:28:08.663883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.663793 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 04:28:08.664056 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.664038 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 04:28:08.672410 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.672326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:08.737134 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj6s6\" (UniqueName: \"kubernetes.io/projected/d940592e-1c91-4d6b-9596-ffccbf5a1e04-kube-api-access-rj6s6\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.737292 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjr9c\" (UniqueName: \"kubernetes.io/projected/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-api-access-rjr9c\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.737292 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.737403 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.737403 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.737403 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d940592e-1c91-4d6b-9596-ffccbf5a1e04-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.737403 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21167426-504a-47ef-8cef-aa8e88c9a9ef-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.737598 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.737598 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.737598 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.737509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21167426-504a-47ef-8cef-aa8e88c9a9ef-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.768616 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.768575 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:08.838425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.838425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6s6\" (UniqueName: \"kubernetes.io/projected/d940592e-1c91-4d6b-9596-ffccbf5a1e04-kube-api-access-rj6s6\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.838610 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjr9c\" (UniqueName: \"kubernetes.io/projected/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-api-access-rjr9c\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.838610 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.838610 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.838610 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.838610 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-root\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.838610 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-textfile\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.838933 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.838933 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.838933 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d940592e-1c91-4d6b-9596-ffccbf5a1e04-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.838933 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:08.838698 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 04:28:08.838933 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:08.838774 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls podName:d940592e-1c91-4d6b-9596-ffccbf5a1e04 nodeName:}" failed. No retries permitted until 2026-09-10 04:28:09.338754945 +0000 UTC m=+110.517960666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-vwzpg" (UID: "d940592e-1c91-4d6b-9596-ffccbf5a1e04") : secret "openshift-state-metrics-tls" not found Sep 10 04:28:08.838933 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21167426-504a-47ef-8cef-aa8e88c9a9ef-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.838959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b913a895-cae1-4969-ab74-f895c7af234c-metrics-client-ca\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839075 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/21167426-504a-47ef-8cef-aa8e88c9a9ef-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21167426-504a-47ef-8cef-aa8e88c9a9ef-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-wtmp\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:08.839217 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 10 04:28:08.839267 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:08.839271 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-tls podName:21167426-504a-47ef-8cef-aa8e88c9a9ef nodeName:}" failed. No retries permitted until 2026-09-10 04:28:09.33925615 +0000 UTC m=+110.518461869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-zs7bz" (UID: "21167426-504a-47ef-8cef-aa8e88c9a9ef") : secret "kube-state-metrics-tls" not found Sep 10 04:28:08.839980 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.839980 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6m7f\" (UniqueName: \"kubernetes.io/projected/b913a895-cae1-4969-ab74-f895c7af234c-kube-api-access-v6m7f\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.839980 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-sys\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.840196 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.839996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d940592e-1c91-4d6b-9596-ffccbf5a1e04-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.840876 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.840809 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21167426-504a-47ef-8cef-aa8e88c9a9ef-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.842046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.842005 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.842514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.842491 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.849861 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.849833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjr9c\" (UniqueName: \"kubernetes.io/projected/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-api-access-rjr9c\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:08.851178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.851140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj6s6\" (UniqueName: \"kubernetes.io/projected/d940592e-1c91-4d6b-9596-ffccbf5a1e04-kube-api-access-rj6s6\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:08.941014 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.940980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b913a895-cae1-4969-ab74-f895c7af234c-metrics-client-ca\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-wtmp\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6m7f\" (UniqueName: \"kubernetes.io/projected/b913a895-cae1-4969-ab74-f895c7af234c-kube-api-access-v6m7f\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-sys\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-root\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-textfile\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.941762 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.941695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-textfile\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.942215 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.942191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b913a895-cae1-4969-ab74-f895c7af234c-metrics-client-ca\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.942350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.942332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-wtmp\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.942676 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.942657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-sys\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.943127 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.943078 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b913a895-cae1-4969-ab74-f895c7af234c-root\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.943127 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:08.943094 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 04:28:08.943272 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:08.943169 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls podName:b913a895-cae1-4969-ab74-f895c7af234c nodeName:}" failed. No retries permitted until 2026-09-10 04:28:09.443149948 +0000 UTC m=+110.622355670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls") pod "node-exporter-4l9mx" (UID: "b913a895-cae1-4969-ab74-f895c7af234c") : secret "node-exporter-tls" not found Sep 10 04:28:08.943437 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.943417 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-accelerators-collector-config\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.945519 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.945496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.952414 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.952392 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6m7f\" (UniqueName: \"kubernetes.io/projected/b913a895-cae1-4969-ab74-f895c7af234c-kube-api-access-v6m7f\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:08.957677 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:08.957489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:09.060077 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.059990 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:09.344601 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.344558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:09.344786 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.344656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:09.344786 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:09.344705 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 04:28:09.344786 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:09.344782 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls podName:d940592e-1c91-4d6b-9596-ffccbf5a1e04 nodeName:}" failed. No retries permitted until 2026-09-10 04:28:10.344763431 +0000 UTC m=+111.523969168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-vwzpg" (UID: "d940592e-1c91-4d6b-9596-ffccbf5a1e04") : secret "openshift-state-metrics-tls" not found Sep 10 04:28:09.347781 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.347748 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21167426-504a-47ef-8cef-aa8e88c9a9ef-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zs7bz\" (UID: \"21167426-504a-47ef-8cef-aa8e88c9a9ef\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:09.446148 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.446037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:09.446312 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:09.446167 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 04:28:09.446312 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:28:09.446243 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls podName:b913a895-cae1-4969-ab74-f895c7af234c nodeName:}" failed. No retries permitted until 2026-09-10 04:28:10.446222884 +0000 UTC m=+111.625428598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls") pod "node-exporter-4l9mx" (UID: "b913a895-cae1-4969-ab74-f895c7af234c") : secret "node-exporter-tls" not found Sep 10 04:28:09.477898 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.477843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:09.554961 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.554850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" Sep 10 04:28:09.578824 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.578777 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:09.657082 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.656999 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:09.667763 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.667731 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:28:09.671008 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.670980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.673348 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.673305 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 04:28:09.673485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.673305 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 04:28:09.673485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.673305 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 04:28:09.673485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.673446 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zhmtz\"" Sep 10 04:28:09.673766 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.673728 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 04:28:09.673883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.673862 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 04:28:09.673958 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.673922 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 04:28:09.674084 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.674065 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 04:28:09.674163 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.674098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 04:28:09.674163 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.674155 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 04:28:09.685117 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.685087 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:28:09.716669 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.716610 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:09.778166 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.778121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:09.849912 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.849875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850072 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.849989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850072 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-volume\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850213 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850213 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850213 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-out\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850413 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850413 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850413 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vk4m\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-kube-api-access-6vk4m\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850413 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850553 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850553 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-web-config\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.850553 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.850508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.952097 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.952060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.952097 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.952115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vk4m\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-kube-api-access-6vk4m\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.952646 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.952413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.952646 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.952481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.952646 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.952533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-web-config\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.952646 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.952641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.952848 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.952721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.953225 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.953690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-volume\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.953690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.953690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.953690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.953690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-out\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.953690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.954072 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.953993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.955097 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.955075 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.957393 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.957253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.958975 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.958361 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-web-config\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.958975 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.958543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-out\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.958975 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.958797 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-volume\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.959155 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.958991 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.959155 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.958996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.959699 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.959664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.960351 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.960332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.960581 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.960560 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vk4m\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-kube-api-access-6vk4m\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.960633 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.960592 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:09.982829 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:09.982796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:28:10.356873 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.356780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:10.359655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.359611 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d940592e-1c91-4d6b-9596-ffccbf5a1e04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vwzpg\" (UID: \"d940592e-1c91-4d6b-9596-ffccbf5a1e04\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:10.412015 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.411987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" Sep 10 04:28:10.457797 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.457758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:10.460392 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.460365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b913a895-cae1-4969-ab74-f895c7af234c-node-exporter-tls\") pod \"node-exporter-4l9mx\" (UID: \"b913a895-cae1-4969-ab74-f895c7af234c\") " pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:10.476496 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.476473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4l9mx" Sep 10 04:28:10.579328 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.579291 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f68468458-zgzbj"] Sep 10 04:28:10.582464 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.582438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.584632 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.584611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 04:28:10.584764 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.584658 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 04:28:10.584764 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.584688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2fqkg8fggiuum\"" Sep 10 04:28:10.584889 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.584786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 04:28:10.585039 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.585021 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-44ntf\"" Sep 10 04:28:10.585039 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.585035 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 04:28:10.585176 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.585045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 04:28:10.596562 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.596542 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f68468458-zgzbj"] Sep 10 04:28:10.600510 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.600454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:10.760445 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.760445 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a61c7c1-6315-40cc-8a92-bd26d78016fe-metrics-client-ca\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.760700 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7pd\" (UniqueName: \"kubernetes.io/projected/9a61c7c1-6315-40cc-8a92-bd26d78016fe-kube-api-access-8r7pd\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.760700 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.760700 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.760700 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-tls\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.760911 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-grpc-tls\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.760911 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.760751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862077 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862077 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a61c7c1-6315-40cc-8a92-bd26d78016fe-metrics-client-ca\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862390 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7pd\" (UniqueName: \"kubernetes.io/projected/9a61c7c1-6315-40cc-8a92-bd26d78016fe-kube-api-access-8r7pd\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862390 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862390 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862390 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-tls\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862390 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-grpc-tls\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.862390 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.863032 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.862981 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a61c7c1-6315-40cc-8a92-bd26d78016fe-metrics-client-ca\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.865498 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.865453 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.865607 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.865501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.865607 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.865564 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-tls\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.866118 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.866099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.866228 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.866118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.866341 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.866324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a61c7c1-6315-40cc-8a92-bd26d78016fe-secret-grpc-tls\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.870455 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.870433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7pd\" (UniqueName: \"kubernetes.io/projected/9a61c7c1-6315-40cc-8a92-bd26d78016fe-kube-api-access-8r7pd\") pod \"thanos-querier-f68468458-zgzbj\" (UID: \"9a61c7c1-6315-40cc-8a92-bd26d78016fe\") " pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:10.894399 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:10.894369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:11.520039 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:11.519863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:11.620824 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:11.620724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:11.783353 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:11.783267 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h6vhr" Sep 10 04:28:11.829191 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:11.829014 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:11.928928 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:11.928849 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:12.027542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:12.027505 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:13.080373 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.080334 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b95fc577c-fjchh"] Sep 10 04:28:13.082954 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.082920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.085131 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.085109 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 04:28:13.085226 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.085112 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-l5d8q\"" Sep 10 04:28:13.085728 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.085709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f9jvgjroj9vu3\"" Sep 10 04:28:13.085815 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.085710 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 04:28:13.085815 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.085710 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 04:28:13.085815 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.085788 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 04:28:13.092609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.092585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b95fc577c-fjchh"] Sep 10 04:28:13.184899 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.184869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-secret-metrics-server-client-certs\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.185087 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.184903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-secret-metrics-server-tls\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.185087 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.185026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefd63d7-6545-456f-8247-1b5bf0263bb0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.185206 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.185110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fefd63d7-6545-456f-8247-1b5bf0263bb0-audit-log\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.185206 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.185146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fefd63d7-6545-456f-8247-1b5bf0263bb0-metrics-server-audit-profiles\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.185206 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.185172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-client-ca-bundle\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.185367 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.185217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbv2g\" (UniqueName: \"kubernetes.io/projected/fefd63d7-6545-456f-8247-1b5bf0263bb0-kube-api-access-lbv2g\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.285805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.285768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefd63d7-6545-456f-8247-1b5bf0263bb0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.285805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.285810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fefd63d7-6545-456f-8247-1b5bf0263bb0-audit-log\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.286027 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.285826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fefd63d7-6545-456f-8247-1b5bf0263bb0-metrics-server-audit-profiles\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.286027 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.285980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-client-ca-bundle\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.286145 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.286028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbv2g\" (UniqueName: \"kubernetes.io/projected/fefd63d7-6545-456f-8247-1b5bf0263bb0-kube-api-access-lbv2g\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.286145 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.286074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-secret-metrics-server-client-certs\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.286145 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.286098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-secret-metrics-server-tls\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.286288 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.286239 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fefd63d7-6545-456f-8247-1b5bf0263bb0-audit-log\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.287007 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.286979 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fefd63d7-6545-456f-8247-1b5bf0263bb0-metrics-server-audit-profiles\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.287274 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.287138 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefd63d7-6545-456f-8247-1b5bf0263bb0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.289105 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.289081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-secret-metrics-server-client-certs\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.289198 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.289145 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-secret-metrics-server-tls\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.289270 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.289230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fefd63d7-6545-456f-8247-1b5bf0263bb0-client-ca-bundle\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.298500 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.298053 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbv2g\" (UniqueName: \"kubernetes.io/projected/fefd63d7-6545-456f-8247-1b5bf0263bb0-kube-api-access-lbv2g\") pod \"metrics-server-b95fc577c-fjchh\" (UID: \"fefd63d7-6545-456f-8247-1b5bf0263bb0\") " pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.375587 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.375505 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc"] Sep 10 04:28:13.378237 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.378116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:13.378873 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.378854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.381144 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.381117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 04:28:13.381252 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.381117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gttqb\"" Sep 10 04:28:13.386820 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.386774 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc"] Sep 10 04:28:13.395277 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.395254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:13.445514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.445474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:13.475245 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:13.475200 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb913a895_cae1_4969_ab74_f895c7af234c.slice/crio-342d79ce17bd820c288022b2962e37a1e0b37870f72298b3188148b538c2247d WatchSource:0}: Error finding container 342d79ce17bd820c288022b2962e37a1e0b37870f72298b3188148b538c2247d: Status 404 returned error can't find the container with id 342d79ce17bd820c288022b2962e37a1e0b37870f72298b3188148b538c2247d Sep 10 04:28:13.488831 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.488012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs8ht\" (UniqueName: \"kubernetes.io/projected/d42cd242-0fd1-4aec-bf40-0896f181fd3a-kube-api-access-rs8ht\") pod \"monitoring-plugin-85bbbbbf4-cqdrc\" (UID: \"d42cd242-0fd1-4aec-bf40-0896f181fd3a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.488831 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.488058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d42cd242-0fd1-4aec-bf40-0896f181fd3a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cqdrc\" (UID: \"d42cd242-0fd1-4aec-bf40-0896f181fd3a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.588958 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.588918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs8ht\" (UniqueName: \"kubernetes.io/projected/d42cd242-0fd1-4aec-bf40-0896f181fd3a-kube-api-access-rs8ht\") pod \"monitoring-plugin-85bbbbbf4-cqdrc\" (UID: \"d42cd242-0fd1-4aec-bf40-0896f181fd3a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.589087 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.588975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d42cd242-0fd1-4aec-bf40-0896f181fd3a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cqdrc\" (UID: \"d42cd242-0fd1-4aec-bf40-0896f181fd3a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.591933 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.591910 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d42cd242-0fd1-4aec-bf40-0896f181fd3a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cqdrc\" (UID: \"d42cd242-0fd1-4aec-bf40-0896f181fd3a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.599339 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.599319 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs8ht\" (UniqueName: \"kubernetes.io/projected/d42cd242-0fd1-4aec-bf40-0896f181fd3a-kube-api-access-rs8ht\") pod \"monitoring-plugin-85bbbbbf4-cqdrc\" (UID: \"d42cd242-0fd1-4aec-bf40-0896f181fd3a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.691127 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.691096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:13.754720 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.754617 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz"] Sep 10 04:28:13.769185 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:13.768171 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21167426_504a_47ef_8cef_aa8e88c9a9ef.slice/crio-e257626190f081e905f0f3083104d9431720b8df5b38a2a01053ce56bb718123 WatchSource:0}: Error finding container e257626190f081e905f0f3083104d9431720b8df5b38a2a01053ce56bb718123: Status 404 returned error can't find the container with id e257626190f081e905f0f3083104d9431720b8df5b38a2a01053ce56bb718123 Sep 10 04:28:13.771767 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.771741 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg"] Sep 10 04:28:13.775380 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:13.775356 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd940592e_1c91_4d6b_9596_ffccbf5a1e04.slice/crio-b5bb8f8985435220f15b31bbbbab07c4332d2189762430663ba16dd90d842bb2 WatchSource:0}: Error finding container b5bb8f8985435220f15b31bbbbab07c4332d2189762430663ba16dd90d842bb2: Status 404 returned error can't find the container with id b5bb8f8985435220f15b31bbbbab07c4332d2189762430663ba16dd90d842bb2 Sep 10 04:28:13.777926 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.777848 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:28:13.782901 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:13.782763 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90b3a7d_2a73_4ca2_9230_51bf29699497.slice/crio-d4dbbc53ddd8bac3d91a8650bb4ea02ca801fc3e245097d9e940a2fb137a4270 WatchSource:0}: Error finding container d4dbbc53ddd8bac3d91a8650bb4ea02ca801fc3e245097d9e940a2fb137a4270: Status 404 returned error can't find the container with id d4dbbc53ddd8bac3d91a8650bb4ea02ca801fc3e245097d9e940a2fb137a4270 Sep 10 04:28:13.791461 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.791182 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b95fc577c-fjchh"] Sep 10 04:28:13.794923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.794748 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f68468458-zgzbj"] Sep 10 04:28:13.797401 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:13.797351 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefd63d7_6545_456f_8247_1b5bf0263bb0.slice/crio-dfbe45c439c8a0fb57e19b052a4bf2d7a838058ae44347a5444074678f5ac361 WatchSource:0}: Error finding container dfbe45c439c8a0fb57e19b052a4bf2d7a838058ae44347a5444074678f5ac361: Status 404 returned error can't find the container with id dfbe45c439c8a0fb57e19b052a4bf2d7a838058ae44347a5444074678f5ac361 Sep 10 04:28:13.797849 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:13.797803 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a61c7c1_6315_40cc_8a92_bd26d78016fe.slice/crio-63f3183a24a6a003afba5f316ec398be72fe198ab491606b755d1bdbd683ac96 WatchSource:0}: Error finding container 63f3183a24a6a003afba5f316ec398be72fe198ab491606b755d1bdbd683ac96: Status 404 returned error can't find the container with id 63f3183a24a6a003afba5f316ec398be72fe198ab491606b755d1bdbd683ac96 Sep 10 04:28:13.836877 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.836844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-64fsx" event={"ID":"ba970170-1f2d-4860-bffd-53891b6b0710","Type":"ContainerStarted","Data":"dabc43f784b9c3982eea284c42a4fedf4f71d1e28528dfcf8367439065fe962d"} Sep 10 04:28:13.837229 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.837209 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-64fsx" Sep 10 04:28:13.838414 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.838393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l9mx" event={"ID":"b913a895-cae1-4969-ab74-f895c7af234c","Type":"ContainerStarted","Data":"342d79ce17bd820c288022b2962e37a1e0b37870f72298b3188148b538c2247d"} Sep 10 04:28:13.840000 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.839971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" event={"ID":"21167426-504a-47ef-8cef-aa8e88c9a9ef","Type":"ContainerStarted","Data":"e257626190f081e905f0f3083104d9431720b8df5b38a2a01053ce56bb718123"} Sep 10 04:28:13.841761 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.841738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"d4dbbc53ddd8bac3d91a8650bb4ea02ca801fc3e245097d9e940a2fb137a4270"} Sep 10 04:28:13.846176 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.846018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" event={"ID":"d940592e-1c91-4d6b-9596-ffccbf5a1e04","Type":"ContainerStarted","Data":"b5bb8f8985435220f15b31bbbbab07c4332d2189762430663ba16dd90d842bb2"} Sep 10 04:28:13.848601 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.848579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" event={"ID":"fefd63d7-6545-456f-8247-1b5bf0263bb0","Type":"ContainerStarted","Data":"dfbe45c439c8a0fb57e19b052a4bf2d7a838058ae44347a5444074678f5ac361"} Sep 10 04:28:13.848993 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.848976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-64fsx" Sep 10 04:28:13.850584 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.850489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" event={"ID":"9a61c7c1-6315-40cc-8a92-bd26d78016fe","Type":"ContainerStarted","Data":"63f3183a24a6a003afba5f316ec398be72fe198ab491606b755d1bdbd683ac96"} Sep 10 04:28:13.861689 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.861641 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-64fsx" podStartSLOduration=1.232760299 podStartE2EDuration="18.861624166s" totalImagesPullingTime="17.628863867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:13.861073873 +0000 UTC m=+115.040279611" watchObservedRunningTime="2026-09-10 04:28:13.861624166 +0000 UTC m=+115.040829904" Sep 10 04:28:13.976058 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:13.975747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc"] Sep 10 04:28:13.979683 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:13.979643 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42cd242_0fd1_4aec_bf40_0896f181fd3a.slice/crio-422e6c2098bfc3fca01c4fa6967a50c895568b566fb62bff759c54e97859eccd WatchSource:0}: Error finding container 422e6c2098bfc3fca01c4fa6967a50c895568b566fb62bff759c54e97859eccd: Status 404 returned error can't find the container with id 422e6c2098bfc3fca01c4fa6967a50c895568b566fb62bff759c54e97859eccd Sep 10 04:28:14.655502 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.655469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:14.756514 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.756432 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:14.773623 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.772269 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:28:14.776158 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.776133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.779848 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.778506 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-26nfp0lganod9\"" Sep 10 04:28:14.779848 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.778736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 04:28:14.779848 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.779298 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j7xpp\"" Sep 10 04:28:14.779848 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.779774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 04:28:14.780908 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.780350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 04:28:14.781264 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.781151 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 04:28:14.784524 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.782366 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 04:28:14.784524 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.783663 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 04:28:14.784524 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.784044 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 04:28:14.786568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.785145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 04:28:14.786568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.785274 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 04:28:14.786568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.785338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 04:28:14.787685 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.787294 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 04:28:14.787685 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.787365 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 04:28:14.787685 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.787519 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 04:28:14.800544 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.800515 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 04:28:14.803335 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.802802 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:28:14.811556 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.811492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.811812 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.811785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.811975 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.811958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.812108 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.812092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.812348 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.812331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-config\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.814772 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.814739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815006 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.814986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815163 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.815142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815282 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.815266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815413 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.815399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6958j\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-kube-api-access-6958j\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.815532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815660 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.815645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815774 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.815759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.815879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.815864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.816751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.816733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.823443 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.823409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.824071 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.824047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.824167 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.824094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.824167 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.824118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.824167 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.824152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.843783 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.843723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:14.868556 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.868518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" event={"ID":"d940592e-1c91-4d6b-9596-ffccbf5a1e04","Type":"ContainerStarted","Data":"361a51f826337ace4939e77c5601f3983be42c9667bb11de984af697097eed7d"} Sep 10 04:28:14.868833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.868798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" event={"ID":"d940592e-1c91-4d6b-9596-ffccbf5a1e04","Type":"ContainerStarted","Data":"3f99dfa02d92f141d46c861dec6204ab17e37ab11967060ca50c6e1dd6b19435"} Sep 10 04:28:14.875668 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.875632 2578 generic.go:356] "Generic (PLEG): container finished" podID="b913a895-cae1-4969-ab74-f895c7af234c" containerID="07fb89547cd2ce98a916b0aa539914dbafeec286a7c2c0562c7828f536b79418" exitCode=0 Sep 10 04:28:14.878333 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.877414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l9mx" event={"ID":"b913a895-cae1-4969-ab74-f895c7af234c","Type":"ContainerDied","Data":"07fb89547cd2ce98a916b0aa539914dbafeec286a7c2c0562c7828f536b79418"} Sep 10 04:28:14.884170 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.884114 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" event={"ID":"d42cd242-0fd1-4aec-bf40-0896f181fd3a","Type":"ContainerStarted","Data":"422e6c2098bfc3fca01c4fa6967a50c895568b566fb62bff759c54e97859eccd"} Sep 10 04:28:14.925252 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925393 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925393 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925515 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925515 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-config\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925515 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925515 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925717 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925717 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925717 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6958j\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-kube-api-access-6958j\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925717 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.925923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.926240 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.926240 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.925992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.926240 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.926028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.927797 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.927768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.930025 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.929982 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.930890 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.930867 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.931577 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.931539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.935104 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.935078 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.936551 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.936526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.946260 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.946213 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6958j\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-kube-api-access-6958j\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.948759 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.947562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.948759 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.948165 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.967234 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.966581 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.967234 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.966769 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.967750 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.967511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-config\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.967750 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.967583 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.967750 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.967701 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.968593 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.968513 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.972648 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.971736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.972648 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.972149 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.972648 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.972205 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.973535 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.973488 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:14.975824 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:14.975779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:15.120282 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.120252 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:15.186421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.186364 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:15.288039 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.287987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:15.444909 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.444807 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:28:15.903012 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.902328 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l9mx" event={"ID":"b913a895-cae1-4969-ab74-f895c7af234c","Type":"ContainerStarted","Data":"a1b7c5b591c77fca93e1875bf34aa710f17d7ea0cf812f6b28d78287cc3e50b3"} Sep 10 04:28:15.903012 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.902396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4l9mx" event={"ID":"b913a895-cae1-4969-ab74-f895c7af234c","Type":"ContainerStarted","Data":"bf7ee3d3ec57bed41a3337727e18a19d241e771d80b73484c7e720f61b649ac1"} Sep 10 04:28:15.908349 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.908273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerStarted","Data":"b825a55734d11acf9b0b102a605e534a83c9eef59a1b75dead5053153ff085ca"} Sep 10 04:28:15.923275 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:15.923041 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4l9mx" podStartSLOduration=6.753324689 podStartE2EDuration="7.923021962s" totalImagesPullingTime="1.080907819s" totalInitContainerRuntime="88.789454ms" isStatefulPod=true podCreationTimestamp="2026-09-10 04:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:15.920617284 +0000 UTC m=+117.099823050" watchObservedRunningTime="2026-09-10 04:28:15.923021962 +0000 UTC m=+117.102227700" Sep 10 04:28:16.965719 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:16.965662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:17.036835 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:17.036739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:18.188604 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:18.188563 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:18.254545 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:18.254510 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:18.939976 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:18.939921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:19.005535 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:19.005491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:19.644189 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:19.644126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:19.743984 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:19.743955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:19.933312 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:19.933237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc"} Sep 10 04:28:20.949436 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.949398 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" event={"ID":"21167426-504a-47ef-8cef-aa8e88c9a9ef","Type":"ContainerStarted","Data":"9f4f32c7fbe59113b2582b0445d181bd83df34c10782132fe89a96f436a0e406"} Sep 10 04:28:20.949912 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.949470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" event={"ID":"21167426-504a-47ef-8cef-aa8e88c9a9ef","Type":"ContainerStarted","Data":"0ef146604d7a0b8af419a0313208451c850c1a50114b9cd553208edde8da1e31"} Sep 10 04:28:20.949912 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.949498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" event={"ID":"21167426-504a-47ef-8cef-aa8e88c9a9ef","Type":"ContainerStarted","Data":"eb8027810d296c91659357720fc973c6c6a750f1992295a39785395e339a6449"} Sep 10 04:28:20.951866 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.951835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" event={"ID":"d42cd242-0fd1-4aec-bf40-0896f181fd3a","Type":"ContainerStarted","Data":"51ce72f5ef905e2561e20a04a4e4ee504488038574528d12e2d54a8880b1020e"} Sep 10 04:28:20.952042 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.951921 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:20.954029 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.954001 2578 generic.go:356] "Generic (PLEG): container finished" podID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerID="788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc" exitCode=0 Sep 10 04:28:20.954166 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.954090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc"} Sep 10 04:28:20.958427 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.958400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" event={"ID":"d940592e-1c91-4d6b-9596-ffccbf5a1e04","Type":"ContainerStarted","Data":"13db54f2729833b779da7e01a21eff964241306b799f9650aa10f2dbf35489c7"} Sep 10 04:28:20.959086 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.959066 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" Sep 10 04:28:20.960301 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.960280 2578 generic.go:356] "Generic (PLEG): container finished" podID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerID="1deed4daea71b4dde96697d76ed6d70ded664aee0b1e24f0ecccec04a55560a9" exitCode=0 Sep 10 04:28:20.960384 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.960347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"1deed4daea71b4dde96697d76ed6d70ded664aee0b1e24f0ecccec04a55560a9"} Sep 10 04:28:20.962817 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.962795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" event={"ID":"fefd63d7-6545-456f-8247-1b5bf0263bb0","Type":"ContainerStarted","Data":"52e6fa1e2acfd49b5afca4353135033ac94493f04848159f079c3a824950246b"} Sep 10 04:28:20.965485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.965458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" event={"ID":"9a61c7c1-6315-40cc-8a92-bd26d78016fe","Type":"ContainerStarted","Data":"3a58a1f1090eeb11938ad9fe71f548420f4677901e7115c8ad283f69124a38d4"} Sep 10 04:28:20.965588 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.965536 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" event={"ID":"9a61c7c1-6315-40cc-8a92-bd26d78016fe","Type":"ContainerStarted","Data":"0d72a477d53eac92f899de0b3a451ec97f7be331abca804c5f2a84229a226b31"} Sep 10 04:28:20.965588 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.965577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" event={"ID":"9a61c7c1-6315-40cc-8a92-bd26d78016fe","Type":"ContainerStarted","Data":"84d7e913104088bea4b55073b1f9e23c482275751fadb32f21c9d693740c635c"} Sep 10 04:28:20.968157 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:20.968104 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zs7bz" podStartSLOduration=6.968193112 podStartE2EDuration="12.968084997s" totalImagesPullingTime="5.999891885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:20.965354885 +0000 UTC m=+122.144560623" watchObservedRunningTime="2026-09-10 04:28:20.968084997 +0000 UTC m=+122.147290736" Sep 10 04:28:21.030974 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:21.030869 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vwzpg" podStartSLOduration=7.193979052 podStartE2EDuration="13.030849344s" totalImagesPullingTime="5.836870292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:21.028630391 +0000 UTC m=+122.207836128" watchObservedRunningTime="2026-09-10 04:28:21.030849344 +0000 UTC m=+122.210055080" Sep 10 04:28:21.046645 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:21.046596 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cqdrc" podStartSLOduration=2.2616319320000002 podStartE2EDuration="8.046581287s" totalImagesPullingTime="5.784949355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:21.044981071 +0000 UTC m=+122.224186809" watchObservedRunningTime="2026-09-10 04:28:21.046581287 +0000 UTC m=+122.225787015" Sep 10 04:28:22.251734 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:22.251665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:22.352178 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:22.352143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:22.824837 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:22.824757 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:22.981886 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:22.981847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" event={"ID":"9a61c7c1-6315-40cc-8a92-bd26d78016fe","Type":"ContainerStarted","Data":"25a16b75e283559f3bd0760e0ef0a3cbea699c9547176f28569686b690f23eda"} Sep 10 04:28:22.982088 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:22.981961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" event={"ID":"9a61c7c1-6315-40cc-8a92-bd26d78016fe","Type":"ContainerStarted","Data":"ee2c5f8fcf1b02ec44ee5cfe69ef3e4a3ad34321dfd9361cf8d27e8731429252"} Sep 10 04:28:22.982088 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:22.982012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" event={"ID":"9a61c7c1-6315-40cc-8a92-bd26d78016fe","Type":"ContainerStarted","Data":"7d947755ed5d6c78e15b8b5c56da8c0486a4070f476ceda55017813c40572fea"} Sep 10 04:28:23.006699 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:23.006228 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" podStartSLOduration=4.994749497 podStartE2EDuration="13.006206342s" totalImagesPullingTime="8.011456845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:23.003829966 +0000 UTC m=+124.183035706" watchObservedRunningTime="2026-09-10 04:28:23.006206342 +0000 UTC m=+124.185412081" Sep 10 04:28:23.006699 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:23.006403 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" podStartSLOduration=4.038854068 podStartE2EDuration="10.006393079s" totalImagesPullingTime="5.967539011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:21.064153403 +0000 UTC m=+122.243359141" watchObservedRunningTime="2026-09-10 04:28:23.006393079 +0000 UTC m=+124.185598827" Sep 10 04:28:23.604131 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:23.604095 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:23.656201 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:23.656162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:23.986897 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:23.986864 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:25.295515 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:25.295447 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:25.391128 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:25.391046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:25.511472 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:25.511407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:26.000126 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.000091 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6"} Sep 10 04:28:26.000421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.000167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3"} Sep 10 04:28:26.000421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.000206 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320"} Sep 10 04:28:26.000421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.000246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b"} Sep 10 04:28:26.000421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.000284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b"} Sep 10 04:28:26.000421 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.000318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerStarted","Data":"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176"} Sep 10 04:28:26.003358 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.003333 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerStarted","Data":"8ba21686abb88ca46fbb20bf467240ae3f1f20bdfcdcd8700147352a8eb22a09"} Sep 10 04:28:26.003457 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.003385 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerStarted","Data":"1ff1cb29dcc3f4d027ece893d2d199482a092f139dd124752b8811f5643bcc5d"} Sep 10 04:28:26.003457 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.003414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerStarted","Data":"93c1a35c432efe8aa64b981aee14dff6eda0a685c66cdc15444f9eb17019dc49"} Sep 10 04:28:26.003524 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.003462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerStarted","Data":"4222d1ac03492c550cc7b62ed25090f5b9ddb552d35cf78ddf855e5a66203c94"} Sep 10 04:28:26.003524 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.003488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerStarted","Data":"14e2d46d3beca9ca0e174887ca7debbc3c3c01023586f6feb84d03748be68858"} Sep 10 04:28:26.003524 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.003510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerStarted","Data":"c9a7d5de822c520cf283c3ba050ca5a1fd545cb421ec6af763b9c0ff7bbbcb02"} Sep 10 04:28:26.025717 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.025666 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.993998471 podStartE2EDuration="17.025650892s" totalImagesPullingTime="10.01134664s" totalInitContainerRuntime="20.305781ms" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:26.023932421 +0000 UTC m=+127.203138157" watchObservedRunningTime="2026-09-10 04:28:26.025650892 +0000 UTC m=+127.204856628" Sep 10 04:28:26.049422 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.049362 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.213673888 podStartE2EDuration="12.049342307s" totalImagesPullingTime="8.792505227s" totalInitContainerRuntime="43.163192ms" isStatefulPod=false podCreationTimestamp="2026-09-10 04:28:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:26.048280003 +0000 UTC m=+127.227485744" watchObservedRunningTime="2026-09-10 04:28:26.049342307 +0000 UTC m=+127.228548044" Sep 10 04:28:26.696839 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.696802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:26.798502 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.798464 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:26.859678 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:26.859647 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:29.065973 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:29.065915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:28:29.068162 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:29.068140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f180f4c-4210-41ef-8601-951bece8a406-metrics-certs\") pod \"network-metrics-daemon-65vps\" (UID: \"5f180f4c-4210-41ef-8601-951bece8a406\") " pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:28:29.103732 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:29.103710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lmcvv\"" Sep 10 04:28:29.111724 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:29.111704 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-65vps" Sep 10 04:28:29.414966 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:29.414826 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-65vps"] Sep 10 04:28:29.418656 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:28:29.418626 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f180f4c_4210_41ef_8601_951bece8a406.slice/crio-f239a2227d92d0b19a2a5c8bd84fba6b74ed5d664963952b5259f41717497e3c WatchSource:0}: Error finding container f239a2227d92d0b19a2a5c8bd84fba6b74ed5d664963952b5259f41717497e3c: Status 404 returned error can't find the container with id f239a2227d92d0b19a2a5c8bd84fba6b74ed5d664963952b5259f41717497e3c Sep 10 04:28:29.999446 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:29.999418 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f68468458-zgzbj" Sep 10 04:28:30.028558 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:30.028520 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-65vps" event={"ID":"5f180f4c-4210-41ef-8601-951bece8a406","Type":"ContainerStarted","Data":"f239a2227d92d0b19a2a5c8bd84fba6b74ed5d664963952b5259f41717497e3c"} Sep 10 04:28:30.120642 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:30.120609 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:28:30.167833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:30.167804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:30.233607 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:30.233579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:33.046215 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:33.046115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-65vps" event={"ID":"5f180f4c-4210-41ef-8601-951bece8a406","Type":"ContainerStarted","Data":"a3e8bdf27f400ce056aaf174ea5483cb33127b3d7c4b54a0b21ac88a6f2eeff4"} Sep 10 04:28:33.046215 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:33.046185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-65vps" event={"ID":"5f180f4c-4210-41ef-8601-951bece8a406","Type":"ContainerStarted","Data":"e8349b2ecb4561019a732de17f8544da632c991260f7d1ab89b72c5a9a89f2f3"} Sep 10 04:28:33.062687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:33.062637 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-65vps" podStartSLOduration=131.028615353 podStartE2EDuration="2m14.062623244s" totalImagesPullingTime="3.034007891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:33.060674596 +0000 UTC m=+134.239880334" watchObservedRunningTime="2026-09-10 04:28:33.062623244 +0000 UTC m=+134.241828981" Sep 10 04:28:33.144698 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:33.144668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:33.247141 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:33.247119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:33.395659 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:33.395594 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:33.395659 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:33.395646 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:34.649309 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:34.649267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:34.707976 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:34.707929 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:48.601375 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:48.601338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:49.644719 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:49.644681 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:49.698758 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:49.698717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:28:53.400968 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:53.400925 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:28:53.404609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:28:53.404587 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b95fc577c-fjchh" Sep 10 04:29:03.181402 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:03.181326 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ae90873-31f3-4d9a-9ccd-09ea9055bbbe" containerID="7b6f69a0a9f958f16c576911ed6679430204078ddbe3b3e6a11ca8cd742a94f3" exitCode=0 Sep 10 04:29:03.181767 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:03.181399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" event={"ID":"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe","Type":"ContainerDied","Data":"7b6f69a0a9f958f16c576911ed6679430204078ddbe3b3e6a11ca8cd742a94f3"} Sep 10 04:29:03.181767 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:03.181719 2578 scope.go:117] "RemoveContainer" containerID="7b6f69a0a9f958f16c576911ed6679430204078ddbe3b3e6a11ca8cd742a94f3" Sep 10 04:29:04.187331 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:04.187293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-j8c27" event={"ID":"5ae90873-31f3-4d9a-9ccd-09ea9055bbbe","Type":"ContainerStarted","Data":"fbf7901bb23e5a0535809e36ab42b922ab10bd675f6d915e233a3abf0c11f3dc"} Sep 10 04:29:15.121357 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:15.121278 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:15.140619 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:15.140591 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:15.253512 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:15.253489 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:27.788599 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:27.788556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:28.459093 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.459064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:28.843524 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.843428 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:29:28.843995 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.843804 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="alertmanager" containerID="cri-o://8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176" gracePeriod=120 Sep 10 04:29:28.843995 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.843865 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-metric" containerID="cri-o://5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3" gracePeriod=120 Sep 10 04:29:28.843995 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.843893 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-web" containerID="cri-o://feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b" gracePeriod=120 Sep 10 04:29:28.843995 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.843919 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy" containerID="cri-o://847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320" gracePeriod=120 Sep 10 04:29:28.844204 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.843976 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="prom-label-proxy" containerID="cri-o://957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6" gracePeriod=120 Sep 10 04:29:28.844204 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:28.843904 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="config-reloader" containerID="cri-o://049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b" gracePeriod=120 Sep 10 04:29:29.307839 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.307807 2578 generic.go:356] "Generic (PLEG): container finished" podID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerID="957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6" exitCode=0 Sep 10 04:29:29.307839 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.307833 2578 generic.go:356] "Generic (PLEG): container finished" podID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerID="847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320" exitCode=0 Sep 10 04:29:29.307839 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.307839 2578 generic.go:356] "Generic (PLEG): container finished" podID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerID="049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b" exitCode=0 Sep 10 04:29:29.307839 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.307844 2578 generic.go:356] "Generic (PLEG): container finished" podID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerID="8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176" exitCode=0 Sep 10 04:29:29.308186 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.307881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6"} Sep 10 04:29:29.308186 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.308007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320"} Sep 10 04:29:29.308186 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.308050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b"} Sep 10 04:29:29.308186 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:29.308093 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176"} Sep 10 04:29:30.081118 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.081088 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.186696 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.186669 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-metrics-client-ca\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.186847 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.186709 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-main-db\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.186847 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.186737 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-out\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.186847 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.186761 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-volume\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187059 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.186920 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vk4m\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-kube-api-access-6vk4m\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187059 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.186989 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-web-config\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187059 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187029 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-cluster-tls-config\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187067 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-web\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187107 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:29:30.187208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187119 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-main-tls\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187152 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:30.187208 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187189 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187478 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187229 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187478 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187266 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-tls-assets\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187478 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187299 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-trusted-ca-bundle\") pod \"f90b3a7d-2a73-4ca2-9230-51bf29699497\" (UID: \"f90b3a7d-2a73-4ca2-9230-51bf29699497\") " Sep 10 04:29:30.187626 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187581 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-metrics-client-ca\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.187626 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.187602 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-main-db\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.188042 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.188013 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:30.190079 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.190012 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:30.190468 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.190430 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-volume" (OuterVolumeSpecName: "config-volume") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:30.190468 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.190437 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:29:30.190767 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.190663 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:30.190767 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.190743 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-out" (OuterVolumeSpecName: "config-out") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:29:30.191066 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.191044 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-kube-api-access-6vk4m" (OuterVolumeSpecName: "kube-api-access-6vk4m") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "kube-api-access-6vk4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:29:30.191288 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.191267 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:30.191561 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.191546 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:30.195558 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.195534 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:30.202434 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.202410 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-web-config" (OuterVolumeSpecName: "web-config") pod "f90b3a7d-2a73-4ca2-9230-51bf29699497" (UID: "f90b3a7d-2a73-4ca2-9230-51bf29699497"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:30.288249 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288224 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-main-tls\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288249 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288249 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288261 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288272 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-tls-assets\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288281 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90b3a7d-2a73-4ca2-9230-51bf29699497-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288289 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-out\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288297 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-config-volume\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288304 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vk4m\" (UniqueName: \"kubernetes.io/projected/f90b3a7d-2a73-4ca2-9230-51bf29699497-kube-api-access-6vk4m\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288314 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-web-config\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288322 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-cluster-tls-config\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.288418 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.288329 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f90b3a7d-2a73-4ca2-9230-51bf29699497-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:30.316017 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.315987 2578 generic.go:356] "Generic (PLEG): container finished" podID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerID="5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3" exitCode=0 Sep 10 04:29:30.316017 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.316013 2578 generic.go:356] "Generic (PLEG): container finished" podID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerID="feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b" exitCode=0 Sep 10 04:29:30.316203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.316033 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3"} Sep 10 04:29:30.316203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.316068 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 04:29:30.316203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.316092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b"} Sep 10 04:29:30.316203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.316124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f90b3a7d-2a73-4ca2-9230-51bf29699497","Type":"ContainerDied","Data":"d4dbbc53ddd8bac3d91a8650bb4ea02ca801fc3e245097d9e940a2fb137a4270"} Sep 10 04:29:30.316203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.316168 2578 scope.go:117] "RemoveContainer" containerID="957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6" Sep 10 04:29:30.324360 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.324342 2578 scope.go:117] "RemoveContainer" containerID="5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3" Sep 10 04:29:30.331396 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.331379 2578 scope.go:117] "RemoveContainer" containerID="847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320" Sep 10 04:29:30.339456 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.338984 2578 scope.go:117] "RemoveContainer" containerID="feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b" Sep 10 04:29:30.339671 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.339651 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:29:30.345643 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.345625 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 04:29:30.346669 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.346653 2578 scope.go:117] "RemoveContainer" containerID="049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b" Sep 10 04:29:30.353583 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.353569 2578 scope.go:117] "RemoveContainer" containerID="8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176" Sep 10 04:29:30.360381 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.360363 2578 scope.go:117] "RemoveContainer" containerID="788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc" Sep 10 04:29:30.367633 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.367615 2578 scope.go:117] "RemoveContainer" containerID="957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6" Sep 10 04:29:30.367903 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:29:30.367883 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6\": container with ID starting with 957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6 not found: ID does not exist" containerID="957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6" Sep 10 04:29:30.367959 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.367911 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6"} err="failed to get container status \"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6\": rpc error: code = NotFound desc = could not find container \"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6\": container with ID starting with 957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6 not found: ID does not exist" Sep 10 04:29:30.367959 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.367955 2578 scope.go:117] "RemoveContainer" containerID="5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3" Sep 10 04:29:30.368204 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:29:30.368187 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3\": container with ID starting with 5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3 not found: ID does not exist" containerID="5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3" Sep 10 04:29:30.368248 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368211 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3"} err="failed to get container status \"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3\": rpc error: code = NotFound desc = could not find container \"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3\": container with ID starting with 5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3 not found: ID does not exist" Sep 10 04:29:30.368248 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368227 2578 scope.go:117] "RemoveContainer" containerID="847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320" Sep 10 04:29:30.368451 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:29:30.368434 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320\": container with ID starting with 847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320 not found: ID does not exist" containerID="847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320" Sep 10 04:29:30.368488 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368457 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320"} err="failed to get container status \"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320\": rpc error: code = NotFound desc = could not find container \"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320\": container with ID starting with 847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320 not found: ID does not exist" Sep 10 04:29:30.368488 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368473 2578 scope.go:117] "RemoveContainer" containerID="feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b" Sep 10 04:29:30.368681 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:29:30.368663 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b\": container with ID starting with feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b not found: ID does not exist" containerID="feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b" Sep 10 04:29:30.368723 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368686 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b"} err="failed to get container status \"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b\": rpc error: code = NotFound desc = could not find container \"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b\": container with ID starting with feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b not found: ID does not exist" Sep 10 04:29:30.368723 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368698 2578 scope.go:117] "RemoveContainer" containerID="049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b" Sep 10 04:29:30.368923 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:29:30.368905 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b\": container with ID starting with 049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b not found: ID does not exist" containerID="049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b" Sep 10 04:29:30.368993 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368928 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b"} err="failed to get container status \"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b\": rpc error: code = NotFound desc = could not find container \"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b\": container with ID starting with 049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b not found: ID does not exist" Sep 10 04:29:30.369052 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.368995 2578 scope.go:117] "RemoveContainer" containerID="8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176" Sep 10 04:29:30.369248 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:29:30.369227 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176\": container with ID starting with 8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176 not found: ID does not exist" containerID="8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176" Sep 10 04:29:30.369293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369253 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176"} err="failed to get container status \"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176\": rpc error: code = NotFound desc = could not find container \"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176\": container with ID starting with 8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176 not found: ID does not exist" Sep 10 04:29:30.369293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369267 2578 scope.go:117] "RemoveContainer" containerID="788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc" Sep 10 04:29:30.369481 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:29:30.369466 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc\": container with ID starting with 788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc not found: ID does not exist" containerID="788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc" Sep 10 04:29:30.369522 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369487 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc"} err="failed to get container status \"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc\": rpc error: code = NotFound desc = could not find container \"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc\": container with ID starting with 788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc not found: ID does not exist" Sep 10 04:29:30.369522 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369500 2578 scope.go:117] "RemoveContainer" containerID="957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6" Sep 10 04:29:30.369743 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369725 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6"} err="failed to get container status \"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6\": rpc error: code = NotFound desc = could not find container \"957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6\": container with ID starting with 957481afda3722594ac2e103cb5b9b3d646abb763fc1fc7d92960cd4998e0ce6 not found: ID does not exist" Sep 10 04:29:30.369780 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369745 2578 scope.go:117] "RemoveContainer" containerID="5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3" Sep 10 04:29:30.369985 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369968 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3"} err="failed to get container status \"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3\": rpc error: code = NotFound desc = could not find container \"5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3\": container with ID starting with 5deec74871749a6047cfce2e4b9fd87d478043b16faa6a0692f757b13505b3d3 not found: ID does not exist" Sep 10 04:29:30.370033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.369987 2578 scope.go:117] "RemoveContainer" containerID="847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320" Sep 10 04:29:30.370199 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.370172 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320"} err="failed to get container status \"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320\": rpc error: code = NotFound desc = could not find container \"847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320\": container with ID starting with 847cef6804f7a9ed3db7b85e6344157fc1986547ce658486f5c06761775db320 not found: ID does not exist" Sep 10 04:29:30.370245 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.370199 2578 scope.go:117] "RemoveContainer" containerID="feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b" Sep 10 04:29:30.370389 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.370371 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b"} err="failed to get container status \"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b\": rpc error: code = NotFound desc = could not find container \"feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b\": container with ID starting with feaa03e5874c726485b11e78153c89762b59ad94a56beacad39478b85d327e8b not found: ID does not exist" Sep 10 04:29:30.370429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.370390 2578 scope.go:117] "RemoveContainer" containerID="049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b" Sep 10 04:29:30.370661 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.370633 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b"} err="failed to get container status \"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b\": rpc error: code = NotFound desc = could not find container \"049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b\": container with ID starting with 049798228d4c05c10c915465442afbf523862be6fa24dea1f2ebfb20d91ea25b not found: ID does not exist" Sep 10 04:29:30.370661 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.370656 2578 scope.go:117] "RemoveContainer" containerID="8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176" Sep 10 04:29:30.371002 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.370980 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176"} err="failed to get container status \"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176\": rpc error: code = NotFound desc = could not find container \"8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176\": container with ID starting with 8d5cc7442ef599b3a7292d04f4c449f189392344236749aad99c9665b46fd176 not found: ID does not exist" Sep 10 04:29:30.371102 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.371005 2578 scope.go:117] "RemoveContainer" containerID="788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc" Sep 10 04:29:30.371357 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:30.371304 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc"} err="failed to get container status \"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc\": rpc error: code = NotFound desc = could not find container \"788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc\": container with ID starting with 788521624e733c0de3542a1aba6d01452ccd36895f54b8e10501e8709516ffcc not found: ID does not exist" Sep 10 04:29:31.294071 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:31.294036 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" path="/var/lib/kubelet/pods/f90b3a7d-2a73-4ca2-9230-51bf29699497/volumes" Sep 10 04:29:33.174805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.174770 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:29:33.175219 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.175051 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="prometheus" containerID="cri-o://c9a7d5de822c520cf283c3ba050ca5a1fd545cb421ec6af763b9c0ff7bbbcb02" gracePeriod=600 Sep 10 04:29:33.175219 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.175074 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8ba21686abb88ca46fbb20bf467240ae3f1f20bdfcdcd8700147352a8eb22a09" gracePeriod=600 Sep 10 04:29:33.175219 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.175100 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="thanos-sidecar" containerID="cri-o://4222d1ac03492c550cc7b62ed25090f5b9ddb552d35cf78ddf855e5a66203c94" gracePeriod=600 Sep 10 04:29:33.175219 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.175132 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-web" containerID="cri-o://93c1a35c432efe8aa64b981aee14dff6eda0a685c66cdc15444f9eb17019dc49" gracePeriod=600 Sep 10 04:29:33.175219 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.175132 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="config-reloader" containerID="cri-o://14e2d46d3beca9ca0e174887ca7debbc3c3c01023586f6feb84d03748be68858" gracePeriod=600 Sep 10 04:29:33.175219 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.175057 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy" containerID="cri-o://1ff1cb29dcc3f4d027ece893d2d199482a092f139dd124752b8811f5643bcc5d" gracePeriod=600 Sep 10 04:29:33.333153 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333118 2578 generic.go:356] "Generic (PLEG): container finished" podID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerID="8ba21686abb88ca46fbb20bf467240ae3f1f20bdfcdcd8700147352a8eb22a09" exitCode=0 Sep 10 04:29:33.333153 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333146 2578 generic.go:356] "Generic (PLEG): container finished" podID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerID="1ff1cb29dcc3f4d027ece893d2d199482a092f139dd124752b8811f5643bcc5d" exitCode=0 Sep 10 04:29:33.333153 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333164 2578 generic.go:356] "Generic (PLEG): container finished" podID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerID="93c1a35c432efe8aa64b981aee14dff6eda0a685c66cdc15444f9eb17019dc49" exitCode=0 Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333170 2578 generic.go:356] "Generic (PLEG): container finished" podID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerID="4222d1ac03492c550cc7b62ed25090f5b9ddb552d35cf78ddf855e5a66203c94" exitCode=0 Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333176 2578 generic.go:356] "Generic (PLEG): container finished" podID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerID="14e2d46d3beca9ca0e174887ca7debbc3c3c01023586f6feb84d03748be68858" exitCode=0 Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333182 2578 generic.go:356] "Generic (PLEG): container finished" podID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerID="c9a7d5de822c520cf283c3ba050ca5a1fd545cb421ec6af763b9c0ff7bbbcb02" exitCode=0 Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"8ba21686abb88ca46fbb20bf467240ae3f1f20bdfcdcd8700147352a8eb22a09"} Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"1ff1cb29dcc3f4d027ece893d2d199482a092f139dd124752b8811f5643bcc5d"} Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"93c1a35c432efe8aa64b981aee14dff6eda0a685c66cdc15444f9eb17019dc49"} Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"4222d1ac03492c550cc7b62ed25090f5b9ddb552d35cf78ddf855e5a66203c94"} Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"14e2d46d3beca9ca0e174887ca7debbc3c3c01023586f6feb84d03748be68858"} Sep 10 04:29:33.333429 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.333386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"c9a7d5de822c520cf283c3ba050ca5a1fd545cb421ec6af763b9c0ff7bbbcb02"} Sep 10 04:29:33.414601 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.414577 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:33.518906 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.518876 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-grpc-tls\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519092 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.518924 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6958j\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-kube-api-access-6958j\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519092 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.518972 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-trusted-ca-bundle\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519092 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519003 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-kube-rbac-proxy\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519092 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519026 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-metrics-client-certs\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519092 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519054 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-2\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519092 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519085 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-config\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519113 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-kubelet-serving-ca-bundle\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519139 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-db\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519165 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-serving-certs-ca-bundle\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519197 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519230 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-metrics-client-ca\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519292 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-tls-assets\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519326 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519373 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-tls\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519397 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-web-config\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519425 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-config-out\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519481 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-1\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519506 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-thanos-prometheus-http-client-file\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519531 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-0\") pod \"41d582aa-b528-4076-833e-9025f0ac5ae0\" (UID: \"41d582aa-b528-4076-833e-9025f0ac5ae0\") " Sep 10 04:29:33.519751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519496 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:33.519751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519690 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:33.520095 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519829 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.520095 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.519850 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.520195 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.520127 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:33.521086 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.521061 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:33.521614 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.521447 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.521920 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.521748 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:33.522031 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522011 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:33.522145 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522125 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 04:29:33.522212 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522178 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.522265 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522253 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-kube-api-access-6958j" (OuterVolumeSpecName: "kube-api-access-6958j") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "kube-api-access-6958j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:29:33.522433 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522410 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-config" (OuterVolumeSpecName: "config") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.522551 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522528 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:29:33.522808 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522780 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.522970 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.522923 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-config-out" (OuterVolumeSpecName: "config-out") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 04:29:33.523055 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.523000 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.523914 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.523894 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.524147 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.524128 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.524291 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.524272 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.524392 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.524373 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:29:33.534183 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.534164 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-web-config" (OuterVolumeSpecName: "web-config") pod "41d582aa-b528-4076-833e-9025f0ac5ae0" (UID: "41d582aa-b528-4076-833e-9025f0ac5ae0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:29:33.620768 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620741 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620768 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620766 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620782 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620795 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-grpc-tls\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620809 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6958j\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-kube-api-access-6958j\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620821 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620835 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-kube-rbac-proxy\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620848 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-metrics-client-certs\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620860 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-config\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620873 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620886 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-prometheus-k8s-db\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620902 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.620924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620916 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d582aa-b528-4076-833e-9025f0ac5ae0-configmap-metrics-client-ca\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.621297 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620930 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d582aa-b528-4076-833e-9025f0ac5ae0-tls-assets\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.621297 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620966 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.621297 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620980 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.621297 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.620994 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d582aa-b528-4076-833e-9025f0ac5ae0-web-config\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:33.621297 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:33.621006 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d582aa-b528-4076-833e-9025f0ac5ae0-config-out\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:29:34.340500 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.340464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d582aa-b528-4076-833e-9025f0ac5ae0","Type":"ContainerDied","Data":"b825a55734d11acf9b0b102a605e534a83c9eef59a1b75dead5053153ff085ca"} Sep 10 04:29:34.340924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.340534 2578 scope.go:117] "RemoveContainer" containerID="8ba21686abb88ca46fbb20bf467240ae3f1f20bdfcdcd8700147352a8eb22a09" Sep 10 04:29:34.340924 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.340482 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.349179 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.349161 2578 scope.go:117] "RemoveContainer" containerID="1ff1cb29dcc3f4d027ece893d2d199482a092f139dd124752b8811f5643bcc5d" Sep 10 04:29:34.356790 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.356774 2578 scope.go:117] "RemoveContainer" containerID="93c1a35c432efe8aa64b981aee14dff6eda0a685c66cdc15444f9eb17019dc49" Sep 10 04:29:34.364307 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.364286 2578 scope.go:117] "RemoveContainer" containerID="4222d1ac03492c550cc7b62ed25090f5b9ddb552d35cf78ddf855e5a66203c94" Sep 10 04:29:34.364883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.364866 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:29:34.368879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.368858 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:29:34.371450 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.371435 2578 scope.go:117] "RemoveContainer" containerID="14e2d46d3beca9ca0e174887ca7debbc3c3c01023586f6feb84d03748be68858" Sep 10 04:29:34.377922 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.377907 2578 scope.go:117] "RemoveContainer" containerID="c9a7d5de822c520cf283c3ba050ca5a1fd545cb421ec6af763b9c0ff7bbbcb02" Sep 10 04:29:34.385218 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.385198 2578 scope.go:117] "RemoveContainer" containerID="1deed4daea71b4dde96697d76ed6d70ded664aee0b1e24f0ecccec04a55560a9" Sep 10 04:29:34.393292 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393272 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:29:34.393568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393557 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="prometheus" Sep 10 04:29:34.393609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393570 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="prometheus" Sep 10 04:29:34.393609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393579 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="init-config-reloader" Sep 10 04:29:34.393609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393585 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="init-config-reloader" Sep 10 04:29:34.393609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393592 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-web" Sep 10 04:29:34.393609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393597 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-web" Sep 10 04:29:34.393609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393604 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy" Sep 10 04:29:34.393609 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393611 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393620 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-metric" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393625 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-metric" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393631 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="thanos-sidecar" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393636 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="thanos-sidecar" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393643 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393648 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393654 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="prom-label-proxy" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393658 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="prom-label-proxy" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393667 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="alertmanager" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393671 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="alertmanager" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393677 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="init-config-reloader" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393682 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="init-config-reloader" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393688 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="config-reloader" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393692 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="config-reloader" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393702 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-web" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393707 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-web" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393713 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-thanos" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393717 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-thanos" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393727 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="config-reloader" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393731 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="config-reloader" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393780 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="thanos-sidecar" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393788 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="alertmanager" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393794 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393801 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-thanos" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393808 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-web" Sep 10 04:29:34.393805 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393814 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="prometheus" Sep 10 04:29:34.394550 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393819 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy-web" Sep 10 04:29:34.394550 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393824 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="prom-label-proxy" Sep 10 04:29:34.394550 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393830 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="config-reloader" Sep 10 04:29:34.394550 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393836 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="config-reloader" Sep 10 04:29:34.394550 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393841 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" containerName="kube-rbac-proxy" Sep 10 04:29:34.394550 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.393847 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90b3a7d-2a73-4ca2-9230-51bf29699497" containerName="kube-rbac-proxy-metric" Sep 10 04:29:34.397769 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.397754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.400034 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.400015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 04:29:34.400258 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.400244 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 04:29:34.400425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.400397 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-26nfp0lganod9\"" Sep 10 04:29:34.400702 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.400684 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j7xpp\"" Sep 10 04:29:34.400786 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.400710 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 04:29:34.400838 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.400809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 04:29:34.400900 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.400885 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 04:29:34.401089 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.401067 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 04:29:34.401089 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.401088 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 04:29:34.401250 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.401095 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 04:29:34.401400 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.401377 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 04:29:34.401508 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.401435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 04:29:34.401508 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.401377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 04:29:34.401508 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.401450 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 04:29:34.403907 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.403886 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 04:29:34.406646 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.406626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 04:29:34.416975 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.416931 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:29:34.529137 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529137 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529137 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-config\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ebf0b04-6fa8-4c83-a648-064610f417dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzkb\" (UniqueName: \"kubernetes.io/projected/9ebf0b04-6fa8-4c83-a648-064610f417dc-kube-api-access-vnzkb\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ebf0b04-6fa8-4c83-a648-064610f417dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.529836 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.529659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630380 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630380 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-config\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ebf0b04-6fa8-4c83-a648-064610f417dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.630640 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzkb\" (UniqueName: \"kubernetes.io/projected/9ebf0b04-6fa8-4c83-a648-064610f417dc-kube-api-access-vnzkb\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ebf0b04-6fa8-4c83-a648-064610f417dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.630920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.631154 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.631520 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.631289 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.632158 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.631702 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.632158 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.631851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.632332 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.632168 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.633630 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.633599 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.633724 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.633608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-config\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.634507 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.634177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ebf0b04-6fa8-4c83-a648-064610f417dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.634507 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.634304 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.634704 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.634677 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.634958 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.634908 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.635265 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.635242 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.635414 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.635389 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.635736 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.635713 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.635964 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.635915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ebf0b04-6fa8-4c83-a648-064610f417dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.636087 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.636069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.636359 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.636336 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.636556 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.636539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ebf0b04-6fa8-4c83-a648-064610f417dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.636714 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.636698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ebf0b04-6fa8-4c83-a648-064610f417dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.643601 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.643578 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzkb\" (UniqueName: \"kubernetes.io/projected/9ebf0b04-6fa8-4c83-a648-064610f417dc-kube-api-access-vnzkb\") pod \"prometheus-k8s-0\" (UID: \"9ebf0b04-6fa8-4c83-a648-064610f417dc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.708425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.708392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:34.987080 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:34.987043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 04:29:34.990825 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:29:34.990789 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebf0b04_6fa8_4c83_a648_064610f417dc.slice/crio-5077a7099a2745d2e3c51eb4970bdc11bbd9f78fd4630f26b94f9e543b57283d WatchSource:0}: Error finding container 5077a7099a2745d2e3c51eb4970bdc11bbd9f78fd4630f26b94f9e543b57283d: Status 404 returned error can't find the container with id 5077a7099a2745d2e3c51eb4970bdc11bbd9f78fd4630f26b94f9e543b57283d Sep 10 04:29:35.294353 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:35.294276 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d582aa-b528-4076-833e-9025f0ac5ae0" path="/var/lib/kubelet/pods/41d582aa-b528-4076-833e-9025f0ac5ae0/volumes" Sep 10 04:29:35.346369 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:35.346338 2578 generic.go:356] "Generic (PLEG): container finished" podID="9ebf0b04-6fa8-4c83-a648-064610f417dc" containerID="9c6426b5c4c84a2544647161e43df036baa88cef4f061e22a122b0fdc2dd35c9" exitCode=0 Sep 10 04:29:35.346763 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:35.346427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerDied","Data":"9c6426b5c4c84a2544647161e43df036baa88cef4f061e22a122b0fdc2dd35c9"} Sep 10 04:29:35.346763 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:35.346499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerStarted","Data":"5077a7099a2745d2e3c51eb4970bdc11bbd9f78fd4630f26b94f9e543b57283d"} Sep 10 04:29:36.354618 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.354575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerStarted","Data":"b2dee753625fbdffb7445b0be9a373c914d095039f9300614e5252cd87ab9d3b"} Sep 10 04:29:36.355099 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.354699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerStarted","Data":"4ee7912e107b023c4aa8e14ec26f1ef462934e9872594b787a70d4fb4e5748b2"} Sep 10 04:29:36.355099 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.354749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerStarted","Data":"ae323ca8bbe427416f4925780dd938d4793588e07dd526ff97a24bfc7c984604"} Sep 10 04:29:36.355099 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.354795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerStarted","Data":"ba9bddf106cee7a0b25b2ba27913a564c0a62a555b9ce2cb854d6637d8e3516f"} Sep 10 04:29:36.355099 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.354834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerStarted","Data":"869cec53f1cce72ed6039b2f0de073305de87690a2d98dcabe1904d4011021a0"} Sep 10 04:29:36.355099 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.354880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9ebf0b04-6fa8-4c83-a648-064610f417dc","Type":"ContainerStarted","Data":"edee05e3288ee0dc0b9c31825f21486fd1c14d00ae495071ed16cb5e6f2a0a7a"} Sep 10 04:29:36.382293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.382238 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.360552387 podStartE2EDuration="2.382222277s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.66989ms" isStatefulPod=false podCreationTimestamp="2026-09-10 04:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:29:36.380263874 +0000 UTC m=+197.559469646" watchObservedRunningTime="2026-09-10 04:29:36.382222277 +0000 UTC m=+197.561428014" Sep 10 04:29:36.602917 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.602881 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:36.668370 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.668271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:36.729109 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.729073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:36.830370 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:36.830343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:37.329406 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:37.329368 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:37.386750 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:37.386720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:39.709461 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:39.709405 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:29:47.629879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:47.629835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:47.733628 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:47.733588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:29:47.832172 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:29:47.832137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:05.986959 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:05.986896 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:06.040738 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:06.040705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:10.405788 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:10.405750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:14.608109 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:14.608069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:30.743648 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:30.743610 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:34.708827 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:34.708792 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:30:34.724402 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:34.724377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:30:35.638130 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:35.638100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 04:30:43.005512 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:43.005477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:43.064860 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:43.064824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:44.730464 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:44.730426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:44.831406 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:44.831369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:54.828991 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:54.828958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:54.879156 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:54.879130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:55.870430 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:55.870377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:55.968335 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:55.968295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:30:56.027262 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:30:56.027222 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:31:04.653238 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:04.653200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:31:04.752971 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:04.752928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:31:04.890813 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:04.890778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:31:19.202366 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:19.202309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:31:19.204807 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:19.204781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:31:19.210351 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:19.210323 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:31:19.212650 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:19.212631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:31:19.213791 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:19.213772 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 04:31:42.788303 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:42.788263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:31:42.842355 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:31:42.842314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:02.757015 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:02.756981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:03.996011 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:03.995966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:27.882795 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:27.882684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:27.935292 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:27.935240 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:29.457523 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:29.457484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:30.228377 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:30.228295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:32.877625 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:32.877589 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:32.979203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:32.979172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:34.499824 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:34.499789 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:34.613908 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:34.613870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:35.094489 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:35.094456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:35.200840 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:35.200797 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:37.321147 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:37.321113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:37.486131 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:37.486097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:39.653867 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:39.653829 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:39.716184 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:39.716151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:42.956587 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:42.956555 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:43.015478 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:43.015445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:45.497625 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:45.497595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:46.063679 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:46.063644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:46.156879 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:46.156842 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:48.090788 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.090757 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb"] Sep 10 04:32:48.093832 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.093813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.095896 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.095877 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 04:32:48.097211 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.097195 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 04:32:48.097211 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.097202 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-48rl4\"" Sep 10 04:32:48.103544 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.103525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb"] Sep 10 04:32:48.119215 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.119192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f688456c-bdcf-4b55-b17a-0292aa1b6660-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jkvvb\" (UID: \"f688456c-bdcf-4b55-b17a-0292aa1b6660\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.119308 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.119259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmt4d\" (UniqueName: \"kubernetes.io/projected/f688456c-bdcf-4b55-b17a-0292aa1b6660-kube-api-access-pmt4d\") pod \"openshift-lws-operator-fd8ccff4c-jkvvb\" (UID: \"f688456c-bdcf-4b55-b17a-0292aa1b6660\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.219907 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.219880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmt4d\" (UniqueName: \"kubernetes.io/projected/f688456c-bdcf-4b55-b17a-0292aa1b6660-kube-api-access-pmt4d\") pod \"openshift-lws-operator-fd8ccff4c-jkvvb\" (UID: \"f688456c-bdcf-4b55-b17a-0292aa1b6660\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.220072 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.219974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f688456c-bdcf-4b55-b17a-0292aa1b6660-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jkvvb\" (UID: \"f688456c-bdcf-4b55-b17a-0292aa1b6660\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.220320 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.220301 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f688456c-bdcf-4b55-b17a-0292aa1b6660-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jkvvb\" (UID: \"f688456c-bdcf-4b55-b17a-0292aa1b6660\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.232677 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.232654 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmt4d\" (UniqueName: \"kubernetes.io/projected/f688456c-bdcf-4b55-b17a-0292aa1b6660-kube-api-access-pmt4d\") pod \"openshift-lws-operator-fd8ccff4c-jkvvb\" (UID: \"f688456c-bdcf-4b55-b17a-0292aa1b6660\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.413169 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.413089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" Sep 10 04:32:48.681147 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.681119 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb"] Sep 10 04:32:48.683839 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:32:48.683815 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf688456c_bdcf_4b55_b17a_0292aa1b6660.slice/crio-fc654d98a0229245e0ba270f575ebba20053284c4ca633a8ee6f21e0dfec601b WatchSource:0}: Error finding container fc654d98a0229245e0ba270f575ebba20053284c4ca633a8ee6f21e0dfec601b: Status 404 returned error can't find the container with id fc654d98a0229245e0ba270f575ebba20053284c4ca633a8ee6f21e0dfec601b Sep 10 04:32:48.685313 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:48.685296 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 04:32:49.180272 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:49.180239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" event={"ID":"f688456c-bdcf-4b55-b17a-0292aa1b6660","Type":"ContainerStarted","Data":"fc654d98a0229245e0ba270f575ebba20053284c4ca633a8ee6f21e0dfec601b"} Sep 10 04:32:52.198920 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:52.198879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" event={"ID":"f688456c-bdcf-4b55-b17a-0292aa1b6660","Type":"ContainerStarted","Data":"bbafdbe49707eae5c746abb9dbdef23d76ba92725fd77bebbbbd1875f4c97aad"} Sep 10 04:32:52.932094 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:52.932042 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:53.033263 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:53.033223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:32:54.915886 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:32:54.915855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:14.760505 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:14.760470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:15.115331 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:15.115241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:15.215283 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:15.215249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:15.316411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:15.316375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:15.857253 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:15.857216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:15.907364 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:15.907329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:16.705994 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:16.705958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:16.808752 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:16.808710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:19.186294 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.186265 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:19.261041 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.260989 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jkvvb" podStartSLOduration=28.548835654 podStartE2EDuration="31.260973606s" totalImagesPullingTime="2.712137952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:32:52.214050454 +0000 UTC m=+393.393256191" watchObservedRunningTime="2026-09-10 04:33:19.260973606 +0000 UTC m=+420.440179343" Sep 10 04:33:19.261784 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.261768 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6"] Sep 10 04:33:19.265331 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.265314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.267756 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.267735 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 04:33:19.267845 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.267735 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tlh9f\"" Sep 10 04:33:19.275914 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.275893 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 04:33:19.276147 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.276132 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 04:33:19.280773 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.280752 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6"] Sep 10 04:33:19.320485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.320456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:19.393350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.393315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-manager-config\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.393350 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.393354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-metrics-cert\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.393576 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.393426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25ks\" (UniqueName: \"kubernetes.io/projected/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-kube-api-access-w25ks\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.393576 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.393513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-cert\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.494424 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.494336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25ks\" (UniqueName: \"kubernetes.io/projected/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-kube-api-access-w25ks\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.494424 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.494419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-cert\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.494643 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.494465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-manager-config\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.494643 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.494489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-metrics-cert\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.495254 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.495231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-manager-config\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.496990 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.496970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-metrics-cert\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.497081 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.497019 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-cert\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.503452 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.503406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25ks\" (UniqueName: \"kubernetes.io/projected/7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8-kube-api-access-w25ks\") pod \"lws-controller-manager-55f5554b4b-rk6x6\" (UID: \"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8\") " pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.574112 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.574079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:19.847766 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:19.847742 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6"] Sep 10 04:33:19.849759 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:33:19.849730 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9c0f9a_8d20_42be_89a7_ae27fe4b98c8.slice/crio-3a677daa6e8b24ee04a9e526a7540eb49968c3239a2c1c15e3ef1a24abe2d73d WatchSource:0}: Error finding container 3a677daa6e8b24ee04a9e526a7540eb49968c3239a2c1c15e3ef1a24abe2d73d: Status 404 returned error can't find the container with id 3a677daa6e8b24ee04a9e526a7540eb49968c3239a2c1c15e3ef1a24abe2d73d Sep 10 04:33:20.318898 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:20.318862 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" event={"ID":"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8","Type":"ContainerStarted","Data":"3a677daa6e8b24ee04a9e526a7540eb49968c3239a2c1c15e3ef1a24abe2d73d"} Sep 10 04:33:21.812146 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:21.812062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:21.911516 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:21.911472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:22.330561 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.330524 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" event={"ID":"7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8","Type":"ContainerStarted","Data":"f56958339847024841dccf809db27bd5a9922aa9fc67a044e6022b46522ef7f3"} Sep 10 04:33:22.330741 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.330655 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:22.349912 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.349852 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" podStartSLOduration=1.7482814960000002 podStartE2EDuration="3.349829402s" totalImagesPullingTime="1.601547906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:33:22.348568546 +0000 UTC m=+423.527774284" watchObservedRunningTime="2026-09-10 04:33:22.349829402 +0000 UTC m=+423.529035139" Sep 10 04:33:22.426570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.426540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:22.674994 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.674888 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:22.783023 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.782986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:22.821115 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.821088 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj"] Sep 10 04:33:22.824988 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.824967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:22.827054 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.827028 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pr9xr\"" Sep 10 04:33:22.827181 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.827085 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 04:33:22.827181 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.827028 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 04:33:22.827181 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.827121 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 04:33:22.827400 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.827385 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 04:33:22.842337 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.842316 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj"] Sep 10 04:33:22.926675 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.926588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d027d3ac-0493-4e44-bc07-b37f81f4191c-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:22.926675 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.926625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjp6\" (UniqueName: \"kubernetes.io/projected/d027d3ac-0493-4e44-bc07-b37f81f4191c-kube-api-access-7rjp6\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:22.926675 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.926670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d027d3ac-0493-4e44-bc07-b37f81f4191c-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:22.926984 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.926751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d027d3ac-0493-4e44-bc07-b37f81f4191c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:22.926984 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.926785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d027d3ac-0493-4e44-bc07-b37f81f4191c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:22.930288 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:22.930245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:23.027786 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.027743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d027d3ac-0493-4e44-bc07-b37f81f4191c-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.028023 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.027801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjp6\" (UniqueName: \"kubernetes.io/projected/d027d3ac-0493-4e44-bc07-b37f81f4191c-kube-api-access-7rjp6\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.028023 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.027854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d027d3ac-0493-4e44-bc07-b37f81f4191c-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.028023 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.027892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d027d3ac-0493-4e44-bc07-b37f81f4191c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.028023 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.027917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d027d3ac-0493-4e44-bc07-b37f81f4191c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.028298 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.028204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d027d3ac-0493-4e44-bc07-b37f81f4191c-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.031126 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.031067 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d027d3ac-0493-4e44-bc07-b37f81f4191c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.031293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.031270 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d027d3ac-0493-4e44-bc07-b37f81f4191c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.031622 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.031593 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d027d3ac-0493-4e44-bc07-b37f81f4191c-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.032094 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.032067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:23.035597 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.035566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjp6\" (UniqueName: \"kubernetes.io/projected/d027d3ac-0493-4e44-bc07-b37f81f4191c-kube-api-access-7rjp6\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-6thxj\" (UID: \"d027d3ac-0493-4e44-bc07-b37f81f4191c\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.130245 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.130214 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:23.135087 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.135067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:23.234042 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.233996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:23.341267 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.341232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:23.427410 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.427386 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj"] Sep 10 04:33:23.429971 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:33:23.429925 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd027d3ac_0493_4e44_bc07_b37f81f4191c.slice/crio-8cdaea1aef63324a1f27e701bb4669b6c26f624c73f83879458f6506dbe4ea6d WatchSource:0}: Error finding container 8cdaea1aef63324a1f27e701bb4669b6c26f624c73f83879458f6506dbe4ea6d: Status 404 returned error can't find the container with id 8cdaea1aef63324a1f27e701bb4669b6c26f624c73f83879458f6506dbe4ea6d Sep 10 04:33:23.441325 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:23.441297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:24.344078 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:24.344040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" event={"ID":"d027d3ac-0493-4e44-bc07-b37f81f4191c","Type":"ContainerStarted","Data":"8cdaea1aef63324a1f27e701bb4669b6c26f624c73f83879458f6506dbe4ea6d"} Sep 10 04:33:26.559907 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:26.559867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:26.660387 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:26.660309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:26.759908 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:26.759871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:27.361273 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:27.361239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" event={"ID":"d027d3ac-0493-4e44-bc07-b37f81f4191c","Type":"ContainerStarted","Data":"8ccda12a5f21d0a2f1af38ec9e08fd389170fdbf6f35ec67afcc5aa65425264d"} Sep 10 04:33:28.367718 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:28.367683 2578 generic.go:356] "Generic (PLEG): container finished" podID="d027d3ac-0493-4e44-bc07-b37f81f4191c" containerID="8ccda12a5f21d0a2f1af38ec9e08fd389170fdbf6f35ec67afcc5aa65425264d" exitCode=0 Sep 10 04:33:28.368122 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:28.367757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" event={"ID":"d027d3ac-0493-4e44-bc07-b37f81f4191c","Type":"ContainerDied","Data":"8ccda12a5f21d0a2f1af38ec9e08fd389170fdbf6f35ec67afcc5aa65425264d"} Sep 10 04:33:29.373060 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:29.373026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" event={"ID":"d027d3ac-0493-4e44-bc07-b37f81f4191c","Type":"ContainerStarted","Data":"e4e9bd4238ef99a1ed997b4a827213408cc4cdc272b905fb17ace9e4f547d5ad"} Sep 10 04:33:29.373466 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:29.373144 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:29.391930 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:29.391845 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" podStartSLOduration=3.092189486 podStartE2EDuration="7.391827236s" totalImagesPullingTime="3.28245526s" totalInitContainerRuntime="1.01718249s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:33:29.390723506 +0000 UTC m=+430.569929256" watchObservedRunningTime="2026-09-10 04:33:29.391827236 +0000 UTC m=+430.571032974" Sep 10 04:33:33.337669 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:33.337642 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f5554b4b-rk6x6" Sep 10 04:33:40.379561 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:40.379535 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-6thxj" Sep 10 04:33:42.070819 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:42.070726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:42.192104 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:42.192066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:52.845092 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.845055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:52.987371 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.987330 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5"] Sep 10 04:33:52.991277 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.991256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:52.993225 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.993205 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 04:33:52.993542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.993525 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vswlw\"" Sep 10 04:33:52.994047 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.994024 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 04:33:52.994140 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.994090 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 04:33:52.994140 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.994104 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 04:33:53.000432 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:52.999512 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5"] Sep 10 04:33:53.087336 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.087281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/418cdeb6-8375-4484-b0fd-a994443c0af4-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.087501 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.087351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bs6h\" (UniqueName: \"kubernetes.io/projected/418cdeb6-8375-4484-b0fd-a994443c0af4-kube-api-access-9bs6h\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.087501 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.087428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418cdeb6-8375-4484-b0fd-a994443c0af4-tmp\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.123062 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.122957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:53.188132 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.188100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418cdeb6-8375-4484-b0fd-a994443c0af4-tmp\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.188303 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.188174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/418cdeb6-8375-4484-b0fd-a994443c0af4-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.188303 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.188226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bs6h\" (UniqueName: \"kubernetes.io/projected/418cdeb6-8375-4484-b0fd-a994443c0af4-kube-api-access-9bs6h\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.188425 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:33:53.188328 2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 10 04:33:53.188425 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:33:53.188406 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cdeb6-8375-4484-b0fd-a994443c0af4-tls-certs podName:418cdeb6-8375-4484-b0fd-a994443c0af4 nodeName:}" failed. No retries permitted until 2026-09-10 04:33:53.688384365 +0000 UTC m=+454.867590099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/418cdeb6-8375-4484-b0fd-a994443c0af4-tls-certs") pod "kube-auth-proxy-dbb8dffb6-mfms5" (UID: "418cdeb6-8375-4484-b0fd-a994443c0af4") : secret "kube-auth-proxy-tls" not found Sep 10 04:33:53.190246 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.190219 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418cdeb6-8375-4484-b0fd-a994443c0af4-tmp\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.200922 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.200905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bs6h\" (UniqueName: \"kubernetes.io/projected/418cdeb6-8375-4484-b0fd-a994443c0af4-kube-api-access-9bs6h\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.224270 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.224243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:53.322498 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.322464 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:53.424000 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.423867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:53.529542 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.529495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:53.674217 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.674133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:53.692218 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.692187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/418cdeb6-8375-4484-b0fd-a994443c0af4-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.694622 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.694603 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/418cdeb6-8375-4484-b0fd-a994443c0af4-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-mfms5\" (UID: \"418cdeb6-8375-4484-b0fd-a994443c0af4\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:53.776869 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.776835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:53.905046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:53.905012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" Sep 10 04:33:54.004087 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:54.004055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:54.066778 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:54.066727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:54.180135 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:54.180031 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5"] Sep 10 04:33:54.182742 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:33:54.182708 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418cdeb6_8375_4484_b0fd_a994443c0af4.slice/crio-c4052b2503d09166b7d1da76ba62ffda0d11f4806e94395940c50e75f3b8f060 WatchSource:0}: Error finding container c4052b2503d09166b7d1da76ba62ffda0d11f4806e94395940c50e75f3b8f060: Status 404 returned error can't find the container with id c4052b2503d09166b7d1da76ba62ffda0d11f4806e94395940c50e75f3b8f060 Sep 10 04:33:54.491107 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:54.491076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" event={"ID":"418cdeb6-8375-4484-b0fd-a994443c0af4","Type":"ContainerStarted","Data":"c4052b2503d09166b7d1da76ba62ffda0d11f4806e94395940c50e75f3b8f060"} Sep 10 04:33:55.011422 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:55.011264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:33:57.508700 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:57.508668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" event={"ID":"418cdeb6-8375-4484-b0fd-a994443c0af4","Type":"ContainerStarted","Data":"24ce1099793d8158df9658c520690a33ce18aa6a74ae10b06bb3e0256688f1da"} Sep 10 04:33:57.524700 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:33:57.524625 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-mfms5" podStartSLOduration=2.422472793 podStartE2EDuration="5.524604661s" totalImagesPullingTime="3.102131868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:33:57.523123596 +0000 UTC m=+458.702329345" watchObservedRunningTime="2026-09-10 04:33:57.524604661 +0000 UTC m=+458.703810403" Sep 10 04:34:01.946625 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:01.946579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:02.050177 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:02.050132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:02.265825 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:02.265725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:02.630033 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:02.629951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:03.246174 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:03.246128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:04.547824 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:04.547791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:04.656249 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:04.656195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:04.882965 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:04.882841 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:05.026193 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:05.026151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:05.861843 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:05.861788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:06.013685 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:06.013655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:06.102045 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:06.102011 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:54.166790 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:54.166753 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:34:54.263993 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:34:54.263928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:10.515359 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:10.515304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:11.351741 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:11.351696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:12.111767 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:12.111676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:14.468978 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:14.468927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:15.330665 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:15.330627 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:15.728028 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:15.727991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:15.970264 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:15.970231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:16.140346 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:16.140231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:18.451439 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:18.451403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:20.173780 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:20.173740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:20.338360 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:20.338324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:21.588533 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:21.588499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:23.124321 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:23.124282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:23.262093 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:23.262055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:25.497786 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:25.497757 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:25.598662 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:25.598625 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:25.908294 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:25.908214 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:26.010217 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:26.010167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:26.304810 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:26.304779 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:26.406196 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:26.406156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:30.158112 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:30.158073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:33.781274 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.781233 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v"] Sep 10 04:35:33.784738 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.784719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" Sep 10 04:35:33.787869 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.787846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-q266m\"" Sep 10 04:35:33.788116 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.788094 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 04:35:33.789811 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.789783 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 04:35:33.806157 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.806123 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v"] Sep 10 04:35:33.831923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.831891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4pzh\" (UniqueName: \"kubernetes.io/projected/44027bf6-ebf8-4df8-8473-eabf159cc519-kube-api-access-m4pzh\") pod \"limitador-operator-controller-manager-74495c69f8-bkf7v\" (UID: \"44027bf6-ebf8-4df8-8473-eabf159cc519\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" Sep 10 04:35:33.933225 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.933177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4pzh\" (UniqueName: \"kubernetes.io/projected/44027bf6-ebf8-4df8-8473-eabf159cc519-kube-api-access-m4pzh\") pod \"limitador-operator-controller-manager-74495c69f8-bkf7v\" (UID: \"44027bf6-ebf8-4df8-8473-eabf159cc519\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" Sep 10 04:35:33.953511 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:33.953478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4pzh\" (UniqueName: \"kubernetes.io/projected/44027bf6-ebf8-4df8-8473-eabf159cc519-kube-api-access-m4pzh\") pod \"limitador-operator-controller-manager-74495c69f8-bkf7v\" (UID: \"44027bf6-ebf8-4df8-8473-eabf159cc519\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" Sep 10 04:35:34.095888 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:34.095804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" Sep 10 04:35:34.387280 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:34.387202 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v"] Sep 10 04:35:34.390221 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:35:34.390188 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44027bf6_ebf8_4df8_8473_eabf159cc519.slice/crio-e7051b514b9c0b4655c7ad6db1fcb266740457a5e530d9c1cc3243d8582384f4 WatchSource:0}: Error finding container e7051b514b9c0b4655c7ad6db1fcb266740457a5e530d9c1cc3243d8582384f4: Status 404 returned error can't find the container with id e7051b514b9c0b4655c7ad6db1fcb266740457a5e530d9c1cc3243d8582384f4 Sep 10 04:35:34.419109 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:34.419082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:34.562765 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:34.562726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:34.970993 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:34.970914 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" event={"ID":"44027bf6-ebf8-4df8-8473-eabf159cc519","Type":"ContainerStarted","Data":"e7051b514b9c0b4655c7ad6db1fcb266740457a5e530d9c1cc3243d8582384f4"} Sep 10 04:35:36.922310 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:36.922229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:36.981917 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:36.981884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" event={"ID":"44027bf6-ebf8-4df8-8473-eabf159cc519","Type":"ContainerStarted","Data":"8131b4c09321c33b74ce77f51a82f1fdf70b9607d9e03e3696db4d054b4719e5"} Sep 10 04:35:36.982091 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:36.982036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" Sep 10 04:35:37.004922 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:37.004871 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" podStartSLOduration=1.796216159 podStartE2EDuration="4.004856176s" totalImagesPullingTime="2.208640017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:37.002523685 +0000 UTC m=+558.181729421" watchObservedRunningTime="2026-09-10 04:35:37.004856176 +0000 UTC m=+558.184061913" Sep 10 04:35:37.009955 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:37.009910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:41.563573 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:41.563543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:41.723780 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:41.723746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:46.722957 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:46.722903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:46.822799 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:46.822761 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:47.134340 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:47.134255 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:47.233398 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:47.233349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:47.332275 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:47.332243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:47.433080 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:47.433031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:47.988485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:47.988455 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bkf7v" Sep 10 04:35:50.858466 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:50.858430 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:51.075735 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:51.075664 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:54.203684 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:54.203636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:57.355868 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:57.355836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:57.471194 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:57.471156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:59.782533 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:59.782498 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:35:59.834276 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:35:59.834230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:03.847555 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:03.847515 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:04.146172 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:04.146066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:04.527642 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:04.527603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:04.596120 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:04.596073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:05.608845 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:05.608812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:05.709815 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:05.709756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:05.778025 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:05.777991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:06.439742 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.439699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:06.516307 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.516280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:06.519818 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.519796 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-bgvgz"] Sep 10 04:36:06.526683 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.526662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bgvgz" Sep 10 04:36:06.528839 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.528813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zqvjc\"" Sep 10 04:36:06.530162 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.530133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bgvgz"] Sep 10 04:36:06.615160 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.615123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrgjn\" (UniqueName: \"kubernetes.io/projected/19592df6-45dc-4810-85ac-2c3533ffe295-kube-api-access-mrgjn\") pod \"authorino-59c974bd48-bgvgz\" (UID: \"19592df6-45dc-4810-85ac-2c3533ffe295\") " pod="kuadrant-system/authorino-59c974bd48-bgvgz" Sep 10 04:36:06.716535 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.716451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrgjn\" (UniqueName: \"kubernetes.io/projected/19592df6-45dc-4810-85ac-2c3533ffe295-kube-api-access-mrgjn\") pod \"authorino-59c974bd48-bgvgz\" (UID: \"19592df6-45dc-4810-85ac-2c3533ffe295\") " pod="kuadrant-system/authorino-59c974bd48-bgvgz" Sep 10 04:36:06.724557 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.724529 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrgjn\" (UniqueName: \"kubernetes.io/projected/19592df6-45dc-4810-85ac-2c3533ffe295-kube-api-access-mrgjn\") pod \"authorino-59c974bd48-bgvgz\" (UID: \"19592df6-45dc-4810-85ac-2c3533ffe295\") " pod="kuadrant-system/authorino-59c974bd48-bgvgz" Sep 10 04:36:06.837553 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:06.837515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bgvgz" Sep 10 04:36:07.104423 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:07.104399 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bgvgz"] Sep 10 04:36:07.106859 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:36:07.106831 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19592df6_45dc_4810_85ac_2c3533ffe295.slice/crio-cc1e9df6f398d216607358d8f2a2fe1fc25ad7e94fecbafb1b26160fc0004af1 WatchSource:0}: Error finding container cc1e9df6f398d216607358d8f2a2fe1fc25ad7e94fecbafb1b26160fc0004af1: Status 404 returned error can't find the container with id cc1e9df6f398d216607358d8f2a2fe1fc25ad7e94fecbafb1b26160fc0004af1 Sep 10 04:36:07.124684 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:07.124656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bgvgz" event={"ID":"19592df6-45dc-4810-85ac-2c3533ffe295","Type":"ContainerStarted","Data":"cc1e9df6f398d216607358d8f2a2fe1fc25ad7e94fecbafb1b26160fc0004af1"} Sep 10 04:36:15.168443 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:15.168405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bgvgz" event={"ID":"19592df6-45dc-4810-85ac-2c3533ffe295","Type":"ContainerStarted","Data":"64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b"} Sep 10 04:36:15.185946 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:15.185873 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-bgvgz" podStartSLOduration=1.249357899 podStartE2EDuration="9.185851652s" totalImagesPullingTime="7.936493753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:15.182875761 +0000 UTC m=+596.362081498" watchObservedRunningTime="2026-09-10 04:36:15.185851652 +0000 UTC m=+596.365057390" Sep 10 04:36:18.301198 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:18.301162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:18.402134 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:18.402102 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:19.236401 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:19.236370 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:36:19.236877 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:19.236851 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:36:19.243998 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:19.243977 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:36:19.244427 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:19.244411 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:36:20.208276 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:20.208237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:20.309275 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:20.309225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:21.802103 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:21.802064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:21.950717 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:21.950683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:22.303166 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:22.303126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:32.013215 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.013181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:32.226891 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.226855 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-jpq7g"] Sep 10 04:36:32.230866 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.230846 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jpq7g" Sep 10 04:36:32.237373 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.237342 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-jpq7g"] Sep 10 04:36:32.244987 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.241551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:32.328257 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.328170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bcd8\" (UniqueName: \"kubernetes.io/projected/031e2312-692f-4e00-a562-452a6bc8902d-kube-api-access-8bcd8\") pod \"authorino-557f876f69-jpq7g\" (UID: \"031e2312-692f-4e00-a562-452a6bc8902d\") " pod="kuadrant-system/authorino-557f876f69-jpq7g" Sep 10 04:36:32.341104 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.341072 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jpq7g"] Sep 10 04:36:32.341404 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:36:32.341354 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8bcd8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-jpq7g" podUID="031e2312-692f-4e00-a562-452a6bc8902d" Sep 10 04:36:32.367298 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.367263 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-s46sc"] Sep 10 04:36:32.370682 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.370660 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:32.372662 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.372645 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 04:36:32.377183 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.377158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-s46sc"] Sep 10 04:36:32.428887 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.428853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bcd8\" (UniqueName: \"kubernetes.io/projected/031e2312-692f-4e00-a562-452a6bc8902d-kube-api-access-8bcd8\") pod \"authorino-557f876f69-jpq7g\" (UID: \"031e2312-692f-4e00-a562-452a6bc8902d\") " pod="kuadrant-system/authorino-557f876f69-jpq7g" Sep 10 04:36:32.428887 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.428892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t77tw\" (UniqueName: \"kubernetes.io/projected/9df68170-165e-407f-bd3a-f84a1165eb5a-kube-api-access-t77tw\") pod \"authorino-6d4dfc649f-s46sc\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:32.429136 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.429006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9df68170-165e-407f-bd3a-f84a1165eb5a-tls-cert\") pod \"authorino-6d4dfc649f-s46sc\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:32.436152 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.436126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bcd8\" (UniqueName: \"kubernetes.io/projected/031e2312-692f-4e00-a562-452a6bc8902d-kube-api-access-8bcd8\") pod \"authorino-557f876f69-jpq7g\" (UID: \"031e2312-692f-4e00-a562-452a6bc8902d\") " pod="kuadrant-system/authorino-557f876f69-jpq7g" Sep 10 04:36:32.461864 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.461839 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-s46sc"] Sep 10 04:36:32.462125 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:36:32.462107 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-t77tw tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-s46sc" podUID="9df68170-165e-407f-bd3a-f84a1165eb5a" Sep 10 04:36:32.490030 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.490004 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f5ccc9c68-cn2vv"] Sep 10 04:36:32.493431 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.493413 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:32.500541 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.500406 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f5ccc9c68-cn2vv"] Sep 10 04:36:32.530230 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.530199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5q54\" (UniqueName: \"kubernetes.io/projected/f7a77e40-91db-4fd3-9772-dc571792f323-kube-api-access-w5q54\") pod \"authorino-6f5ccc9c68-cn2vv\" (UID: \"f7a77e40-91db-4fd3-9772-dc571792f323\") " pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:32.530394 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.530240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9df68170-165e-407f-bd3a-f84a1165eb5a-tls-cert\") pod \"authorino-6d4dfc649f-s46sc\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:32.530394 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.530255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a77e40-91db-4fd3-9772-dc571792f323-tls-cert\") pod \"authorino-6f5ccc9c68-cn2vv\" (UID: \"f7a77e40-91db-4fd3-9772-dc571792f323\") " pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:32.530394 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.530305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t77tw\" (UniqueName: \"kubernetes.io/projected/9df68170-165e-407f-bd3a-f84a1165eb5a-kube-api-access-t77tw\") pod \"authorino-6d4dfc649f-s46sc\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:32.532585 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.532566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9df68170-165e-407f-bd3a-f84a1165eb5a-tls-cert\") pod \"authorino-6d4dfc649f-s46sc\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:32.537733 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.537714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t77tw\" (UniqueName: \"kubernetes.io/projected/9df68170-165e-407f-bd3a-f84a1165eb5a-kube-api-access-t77tw\") pod \"authorino-6d4dfc649f-s46sc\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:32.631658 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.631586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a77e40-91db-4fd3-9772-dc571792f323-tls-cert\") pod \"authorino-6f5ccc9c68-cn2vv\" (UID: \"f7a77e40-91db-4fd3-9772-dc571792f323\") " pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:32.631783 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.631716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q54\" (UniqueName: \"kubernetes.io/projected/f7a77e40-91db-4fd3-9772-dc571792f323-kube-api-access-w5q54\") pod \"authorino-6f5ccc9c68-cn2vv\" (UID: \"f7a77e40-91db-4fd3-9772-dc571792f323\") " pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:32.633667 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.633649 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a77e40-91db-4fd3-9772-dc571792f323-tls-cert\") pod \"authorino-6f5ccc9c68-cn2vv\" (UID: \"f7a77e40-91db-4fd3-9772-dc571792f323\") " pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:32.639778 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.639753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5q54\" (UniqueName: \"kubernetes.io/projected/f7a77e40-91db-4fd3-9772-dc571792f323-kube-api-access-w5q54\") pod \"authorino-6f5ccc9c68-cn2vv\" (UID: \"f7a77e40-91db-4fd3-9772-dc571792f323\") " pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:32.802653 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:32.802618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" Sep 10 04:36:33.070390 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.070361 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f5ccc9c68-cn2vv"] Sep 10 04:36:33.073605 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:36:33.073580 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a77e40_91db_4fd3_9772_dc571792f323.slice/crio-4b5e5fac5737a7bfed877a08321d9c2e8cc7907ced030c7a81b3089794d01d1b WatchSource:0}: Error finding container 4b5e5fac5737a7bfed877a08321d9c2e8cc7907ced030c7a81b3089794d01d1b: Status 404 returned error can't find the container with id 4b5e5fac5737a7bfed877a08321d9c2e8cc7907ced030c7a81b3089794d01d1b Sep 10 04:36:33.257871 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.257840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" event={"ID":"f7a77e40-91db-4fd3-9772-dc571792f323","Type":"ContainerStarted","Data":"4b5e5fac5737a7bfed877a08321d9c2e8cc7907ced030c7a81b3089794d01d1b"} Sep 10 04:36:33.258027 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.257876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jpq7g" Sep 10 04:36:33.258027 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.257876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:33.265916 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.265880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jpq7g" Sep 10 04:36:33.267843 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.267829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:33.337485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.337431 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9df68170-165e-407f-bd3a-f84a1165eb5a-tls-cert\") pod \"9df68170-165e-407f-bd3a-f84a1165eb5a\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " Sep 10 04:36:33.337485 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.337469 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t77tw\" (UniqueName: \"kubernetes.io/projected/9df68170-165e-407f-bd3a-f84a1165eb5a-kube-api-access-t77tw\") pod \"9df68170-165e-407f-bd3a-f84a1165eb5a\" (UID: \"9df68170-165e-407f-bd3a-f84a1165eb5a\") " Sep 10 04:36:33.337617 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.337512 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bcd8\" (UniqueName: \"kubernetes.io/projected/031e2312-692f-4e00-a562-452a6bc8902d-kube-api-access-8bcd8\") pod \"031e2312-692f-4e00-a562-452a6bc8902d\" (UID: \"031e2312-692f-4e00-a562-452a6bc8902d\") " Sep 10 04:36:33.339512 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.339486 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df68170-165e-407f-bd3a-f84a1165eb5a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9df68170-165e-407f-bd3a-f84a1165eb5a" (UID: "9df68170-165e-407f-bd3a-f84a1165eb5a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:36:33.339620 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.339530 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df68170-165e-407f-bd3a-f84a1165eb5a-kube-api-access-t77tw" (OuterVolumeSpecName: "kube-api-access-t77tw") pod "9df68170-165e-407f-bd3a-f84a1165eb5a" (UID: "9df68170-165e-407f-bd3a-f84a1165eb5a"). InnerVolumeSpecName "kube-api-access-t77tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:36:33.339620 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.339546 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031e2312-692f-4e00-a562-452a6bc8902d-kube-api-access-8bcd8" (OuterVolumeSpecName: "kube-api-access-8bcd8") pod "031e2312-692f-4e00-a562-452a6bc8902d" (UID: "031e2312-692f-4e00-a562-452a6bc8902d"). InnerVolumeSpecName "kube-api-access-8bcd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:36:33.438329 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.438302 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t77tw\" (UniqueName: \"kubernetes.io/projected/9df68170-165e-407f-bd3a-f84a1165eb5a-kube-api-access-t77tw\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:36:33.438329 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.438326 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bcd8\" (UniqueName: \"kubernetes.io/projected/031e2312-692f-4e00-a562-452a6bc8902d-kube-api-access-8bcd8\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:36:33.438479 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:33.438341 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9df68170-165e-407f-bd3a-f84a1165eb5a-tls-cert\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:36:34.264293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.264260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-s46sc" Sep 10 04:36:34.264293 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.264272 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" event={"ID":"f7a77e40-91db-4fd3-9772-dc571792f323","Type":"ContainerStarted","Data":"5105ca3ce7cdd619a3b86ba9ede24897183be8fc42773ece89c638f0748216b9"} Sep 10 04:36:34.264721 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.264299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jpq7g" Sep 10 04:36:34.279336 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.279295 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f5ccc9c68-cn2vv" podStartSLOduration=1.823782824 podStartE2EDuration="2.279277973s" totalImagesPullingTime="455.495149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:34.277640355 +0000 UTC m=+615.456846092" watchObservedRunningTime="2026-09-10 04:36:34.279277973 +0000 UTC m=+615.458483710" Sep 10 04:36:34.306358 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.306330 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bgvgz"] Sep 10 04:36:34.306555 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.306531 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-bgvgz" podUID="19592df6-45dc-4810-85ac-2c3533ffe295" containerName="authorino" containerID="cri-o://64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b" gracePeriod=30 Sep 10 04:36:34.308225 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.308204 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jpq7g"] Sep 10 04:36:34.317659 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.317636 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-jpq7g"] Sep 10 04:36:34.335726 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.335699 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-s46sc"] Sep 10 04:36:34.346101 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.346074 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-s46sc"] Sep 10 04:36:34.547023 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.546995 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bgvgz" Sep 10 04:36:34.650053 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.650017 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrgjn\" (UniqueName: \"kubernetes.io/projected/19592df6-45dc-4810-85ac-2c3533ffe295-kube-api-access-mrgjn\") pod \"19592df6-45dc-4810-85ac-2c3533ffe295\" (UID: \"19592df6-45dc-4810-85ac-2c3533ffe295\") " Sep 10 04:36:34.652235 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.652212 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19592df6-45dc-4810-85ac-2c3533ffe295-kube-api-access-mrgjn" (OuterVolumeSpecName: "kube-api-access-mrgjn") pod "19592df6-45dc-4810-85ac-2c3533ffe295" (UID: "19592df6-45dc-4810-85ac-2c3533ffe295"). InnerVolumeSpecName "kube-api-access-mrgjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:36:34.751245 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:34.751220 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrgjn\" (UniqueName: \"kubernetes.io/projected/19592df6-45dc-4810-85ac-2c3533ffe295-kube-api-access-mrgjn\") on node \"ip-10-0-129-39.ec2.internal\" DevicePath \"\"" Sep 10 04:36:35.271005 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.270963 2578 generic.go:356] "Generic (PLEG): container finished" podID="19592df6-45dc-4810-85ac-2c3533ffe295" containerID="64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b" exitCode=0 Sep 10 04:36:35.271005 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.270991 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-bgvgz" Sep 10 04:36:35.271450 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.271035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bgvgz" event={"ID":"19592df6-45dc-4810-85ac-2c3533ffe295","Type":"ContainerDied","Data":"64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b"} Sep 10 04:36:35.271450 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.271085 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-bgvgz" event={"ID":"19592df6-45dc-4810-85ac-2c3533ffe295","Type":"ContainerDied","Data":"cc1e9df6f398d216607358d8f2a2fe1fc25ad7e94fecbafb1b26160fc0004af1"} Sep 10 04:36:35.271450 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.271105 2578 scope.go:117] "RemoveContainer" containerID="64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b" Sep 10 04:36:35.281162 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.281142 2578 scope.go:117] "RemoveContainer" containerID="64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b" Sep 10 04:36:35.281461 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:36:35.281431 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b\": container with ID starting with 64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b not found: ID does not exist" containerID="64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b" Sep 10 04:36:35.281555 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.281468 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b"} err="failed to get container status \"64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b\": rpc error: code = NotFound desc = could not find container \"64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b\": container with ID starting with 64bcfc4a863b039cc231028dd0a1853b2b0e91011d408eb86b1d4c622ce2910b not found: ID does not exist" Sep 10 04:36:35.296456 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.296421 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031e2312-692f-4e00-a562-452a6bc8902d" path="/var/lib/kubelet/pods/031e2312-692f-4e00-a562-452a6bc8902d/volumes" Sep 10 04:36:35.296730 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.296715 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df68170-165e-407f-bd3a-f84a1165eb5a" path="/var/lib/kubelet/pods/9df68170-165e-407f-bd3a-f84a1165eb5a/volumes" Sep 10 04:36:35.296887 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.296873 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bgvgz"] Sep 10 04:36:35.297661 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:35.297635 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-bgvgz"] Sep 10 04:36:37.294877 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:37.294842 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19592df6-45dc-4810-85ac-2c3533ffe295" path="/var/lib/kubelet/pods/19592df6-45dc-4810-85ac-2c3533ffe295/volumes" Sep 10 04:36:38.999151 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:38.999116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:39.094177 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:39.094143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:39.195474 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:39.195437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:42.469729 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:42.469676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:36:42.563955 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:36:42.563898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:15.105395 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:15.105362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:16.455375 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:16.455337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:16.555983 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:16.555933 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:16.616185 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:16.616136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:16.693992 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:16.693951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:16.794690 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:16.794615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:17.031458 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.031424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:17.178180 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.178098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:17.339602 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.339563 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-n7jmc"] Sep 10 04:37:17.340107 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.340089 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19592df6-45dc-4810-85ac-2c3533ffe295" containerName="authorino" Sep 10 04:37:17.340107 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.340108 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19592df6-45dc-4810-85ac-2c3533ffe295" containerName="authorino" Sep 10 04:37:17.340215 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.340179 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="19592df6-45dc-4810-85ac-2c3533ffe295" containerName="authorino" Sep 10 04:37:17.343094 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.343078 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.345367 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.345346 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 04:37:17.345488 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.345352 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l2l85\"" Sep 10 04:37:17.354436 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.354409 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-n7jmc"] Sep 10 04:37:17.522425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.522386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-n7jmc\" (UID: \"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.522790 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.522454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bvw5\" (UniqueName: \"kubernetes.io/projected/ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd-kube-api-access-4bvw5\") pod \"payload-processing-5b54b7fbb7-n7jmc\" (UID: \"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.623832 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.623785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-n7jmc\" (UID: \"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.624059 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.623855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bvw5\" (UniqueName: \"kubernetes.io/projected/ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd-kube-api-access-4bvw5\") pod \"payload-processing-5b54b7fbb7-n7jmc\" (UID: \"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.624575 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.624549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-n7jmc\" (UID: \"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.632252 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.632228 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bvw5\" (UniqueName: \"kubernetes.io/projected/ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd-kube-api-access-4bvw5\") pod \"payload-processing-5b54b7fbb7-n7jmc\" (UID: \"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.655338 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.655312 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:17.924278 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:17.924215 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-n7jmc"] Sep 10 04:37:17.926684 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:37:17.926639 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea511f09_b3a4_4ca5_a5a8_a06c9f9279fd.slice/crio-9d9b8279e505cfa6072fb771a6d4177b1665fad74d433211f2cffb9dd5e844f0 WatchSource:0}: Error finding container 9d9b8279e505cfa6072fb771a6d4177b1665fad74d433211f2cffb9dd5e844f0: Status 404 returned error can't find the container with id 9d9b8279e505cfa6072fb771a6d4177b1665fad74d433211f2cffb9dd5e844f0 Sep 10 04:37:18.479174 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:18.479135 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" event={"ID":"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd","Type":"ContainerStarted","Data":"9d9b8279e505cfa6072fb771a6d4177b1665fad74d433211f2cffb9dd5e844f0"} Sep 10 04:37:20.491797 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:20.491758 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" event={"ID":"ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd","Type":"ContainerStarted","Data":"29d8e59e316868b78a728e0df81de81e559c31774d50bebf76f57291d79608cd"} Sep 10 04:37:20.492235 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:20.491888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:20.508098 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:20.508048 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" podStartSLOduration=1.12349987 podStartE2EDuration="3.508033704s" totalImagesPullingTime="2.384533834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:37:20.506412747 +0000 UTC m=+661.685618486" watchObservedRunningTime="2026-09-10 04:37:20.508033704 +0000 UTC m=+661.687239440" Sep 10 04:37:27.038815 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:27.038754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:27.135645 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:27.135613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:37:31.498934 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:31.498900 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-n7jmc" Sep 10 04:37:35.866837 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:37:35.866809 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:04.133037 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.133000 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-k82tb"] Sep 10 04:38:04.140790 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.140768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.143156 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.143130 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 04:38:04.143278 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.143135 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 04:38:04.143693 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.143675 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cl8w9\"" Sep 10 04:38:04.144247 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.143693 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 04:38:04.146204 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.146175 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-k82tb"] Sep 10 04:38:04.165190 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.165164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:04.320094 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.320060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.320094 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.320097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng7s\" (UniqueName: \"kubernetes.io/projected/45636df1-9b64-4f2c-b371-cf1a7fd426a5-kube-api-access-qng7s\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.320319 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.320129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45636df1-9b64-4f2c-b371-cf1a7fd426a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.320319 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.320181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.320319 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.320227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.320319 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.320264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421110 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421110 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng7s\" (UniqueName: \"kubernetes.io/projected/45636df1-9b64-4f2c-b371-cf1a7fd426a5-kube-api-access-qng7s\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421110 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45636df1-9b64-4f2c-b371-cf1a7fd426a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421110 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421442 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421442 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421591 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.421625 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.421589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.423382 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.423360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45636df1-9b64-4f2c-b371-cf1a7fd426a5-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.423657 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.423640 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45636df1-9b64-4f2c-b371-cf1a7fd426a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.428908 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.428884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng7s\" (UniqueName: \"kubernetes.io/projected/45636df1-9b64-4f2c-b371-cf1a7fd426a5-kube-api-access-qng7s\") pod \"e2e-distinct-simulated-kserve-6685d86975-k82tb\" (UID: \"45636df1-9b64-4f2c-b371-cf1a7fd426a5\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.452912 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.452894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:04.727054 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.727029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-k82tb"] Sep 10 04:38:04.729452 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:38:04.729426 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45636df1_9b64_4f2c_b371_cf1a7fd426a5.slice/crio-fb3cad81bbed9354f0a1b794251d96ca130514be7860f6584f57d4c7970a0a1c WatchSource:0}: Error finding container fb3cad81bbed9354f0a1b794251d96ca130514be7860f6584f57d4c7970a0a1c: Status 404 returned error can't find the container with id fb3cad81bbed9354f0a1b794251d96ca130514be7860f6584f57d4c7970a0a1c Sep 10 04:38:04.730671 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:04.730653 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 04:38:05.717783 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:05.717687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" event={"ID":"45636df1-9b64-4f2c-b371-cf1a7fd426a5","Type":"ContainerStarted","Data":"fb3cad81bbed9354f0a1b794251d96ca130514be7860f6584f57d4c7970a0a1c"} Sep 10 04:38:06.723570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:06.723538 2578 generic.go:356] "Generic (PLEG): container finished" podID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" containerID="7005069bffebfc68200f01196254b4bd1a121718d1381f846c724a66f6cc5bc3" exitCode=0 Sep 10 04:38:06.724026 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:06.723618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" event={"ID":"45636df1-9b64-4f2c-b371-cf1a7fd426a5","Type":"ContainerDied","Data":"7005069bffebfc68200f01196254b4bd1a121718d1381f846c724a66f6cc5bc3"} Sep 10 04:38:06.724026 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:06.723822 2578 scope.go:117] "RemoveContainer" containerID="7005069bffebfc68200f01196254b4bd1a121718d1381f846c724a66f6cc5bc3" Sep 10 04:38:07.730460 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:07.730430 2578 generic.go:356] "Generic (PLEG): container finished" podID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" containerID="e5a068c7fde3f808c0d8bdb3310d09eb3a74295308f440195fd00e658691c10e" exitCode=0 Sep 10 04:38:07.731066 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:07.730469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" event={"ID":"45636df1-9b64-4f2c-b371-cf1a7fd426a5","Type":"ContainerDied","Data":"e5a068c7fde3f808c0d8bdb3310d09eb3a74295308f440195fd00e658691c10e"} Sep 10 04:38:07.731066 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:07.730528 2578 scope.go:117] "RemoveContainer" containerID="7005069bffebfc68200f01196254b4bd1a121718d1381f846c724a66f6cc5bc3" Sep 10 04:38:07.731066 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:07.730814 2578 scope.go:117] "RemoveContainer" containerID="e5a068c7fde3f808c0d8bdb3310d09eb3a74295308f440195fd00e658691c10e" Sep 10 04:38:07.731066 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:38:07.731022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:38:08.737543 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:08.737515 2578 scope.go:117] "RemoveContainer" containerID="e5a068c7fde3f808c0d8bdb3310d09eb3a74295308f440195fd00e658691c10e" Sep 10 04:38:08.737909 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:38:08.737699 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:38:14.453352 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:14.453262 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:14.453352 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:14.453324 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:14.453352 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:14.453344 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:14.453352 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:14.453357 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:14.453837 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:14.453713 2578 scope.go:117] "RemoveContainer" containerID="e5a068c7fde3f808c0d8bdb3310d09eb3a74295308f440195fd00e658691c10e" Sep 10 04:38:14.453894 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:38:14.453874 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:38:15.191149 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:15.191113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:15.261149 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:15.261117 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:15.849304 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:15.849256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:22.679203 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.679166 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt"] Sep 10 04:38:22.682758 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.682738 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.684935 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.684908 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 04:38:22.697537 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.697505 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt"] Sep 10 04:38:22.735853 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.735813 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:22.795603 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.795569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.795761 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.795620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czswr\" (UniqueName: \"kubernetes.io/projected/9bb25cd5-74c1-4771-aa44-12b398ea1ada-kube-api-access-czswr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.795761 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.795720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.795761 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.795759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.795869 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.795782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bb25cd5-74c1-4771-aa44-12b398ea1ada-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.795869 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.795807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.896880 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.896841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.896880 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.896890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.897155 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.896907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bb25cd5-74c1-4771-aa44-12b398ea1ada-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.897155 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.896924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.897155 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.897024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.897155 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.897083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czswr\" (UniqueName: \"kubernetes.io/projected/9bb25cd5-74c1-4771-aa44-12b398ea1ada-kube-api-access-czswr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.897381 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.897351 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.897536 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.897403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.897536 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.897367 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.899352 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.899330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bb25cd5-74c1-4771-aa44-12b398ea1ada-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.899585 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.899566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bb25cd5-74c1-4771-aa44-12b398ea1ada-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.905721 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.905699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czswr\" (UniqueName: \"kubernetes.io/projected/9bb25cd5-74c1-4771-aa44-12b398ea1ada-kube-api-access-czswr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-llgpt\" (UID: \"9bb25cd5-74c1-4771-aa44-12b398ea1ada\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:22.994549 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:22.994514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:23.265704 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:23.265675 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt"] Sep 10 04:38:23.267834 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:38:23.267802 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb25cd5_74c1_4771_aa44_12b398ea1ada.slice/crio-d04bb795a1a1ae6c6017f6b3f2b582cd72ed39f4b36fd7bee70bd9f232e2d05a WatchSource:0}: Error finding container d04bb795a1a1ae6c6017f6b3f2b582cd72ed39f4b36fd7bee70bd9f232e2d05a: Status 404 returned error can't find the container with id d04bb795a1a1ae6c6017f6b3f2b582cd72ed39f4b36fd7bee70bd9f232e2d05a Sep 10 04:38:23.813706 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:23.813615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" event={"ID":"9bb25cd5-74c1-4771-aa44-12b398ea1ada","Type":"ContainerStarted","Data":"69a1e46031f56833940c746c46ffd7d9635275af761661fc0a3deaf77820ba49"} Sep 10 04:38:23.813706 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:23.813671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" event={"ID":"9bb25cd5-74c1-4771-aa44-12b398ea1ada","Type":"ContainerStarted","Data":"d04bb795a1a1ae6c6017f6b3f2b582cd72ed39f4b36fd7bee70bd9f232e2d05a"} Sep 10 04:38:23.830509 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:23.830454 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" podStartSLOduration=1.633135072 podStartE2EDuration="1.830435711s" totalImagesPullingTime="197.300639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:38:23.829815341 +0000 UTC m=+725.009021078" watchObservedRunningTime="2026-09-10 04:38:23.830435711 +0000 UTC m=+725.009641449" Sep 10 04:38:28.120723 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:28.120679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:29.291207 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:29.291182 2578 scope.go:117] "RemoveContainer" containerID="e5a068c7fde3f808c0d8bdb3310d09eb3a74295308f440195fd00e658691c10e" Sep 10 04:38:29.847687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:29.847592 2578 generic.go:356] "Generic (PLEG): container finished" podID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" containerID="f6417992a0c740e620236ae45f22f8042b81c8062e0edc6f288f69e04e528312" exitCode=0 Sep 10 04:38:29.847687 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:29.847660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" event={"ID":"45636df1-9b64-4f2c-b371-cf1a7fd426a5","Type":"ContainerDied","Data":"f6417992a0c740e620236ae45f22f8042b81c8062e0edc6f288f69e04e528312"} Sep 10 04:38:29.847921 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:29.847719 2578 scope.go:117] "RemoveContainer" containerID="e5a068c7fde3f808c0d8bdb3310d09eb3a74295308f440195fd00e658691c10e" Sep 10 04:38:29.848113 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:29.848095 2578 scope.go:117] "RemoveContainer" containerID="f6417992a0c740e620236ae45f22f8042b81c8062e0edc6f288f69e04e528312" Sep 10 04:38:29.848343 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:38:29.848321 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:38:32.995259 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:32.995228 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:32.995642 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:32.995289 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:33.007382 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:33.007353 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:33.883765 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:33.883732 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-llgpt" Sep 10 04:38:34.453929 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:34.453894 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:34.454327 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:34.453971 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:34.454327 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:34.453990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:34.454327 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:34.454003 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:38:34.454327 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:34.454319 2578 scope.go:117] "RemoveContainer" containerID="f6417992a0c740e620236ae45f22f8042b81c8062e0edc6f288f69e04e528312" Sep 10 04:38:34.454519 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:38:34.454483 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:38:39.168198 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:39.168146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:44.858506 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:44.858465 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:38:48.289886 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:38:48.289847 2578 scope.go:117] "RemoveContainer" containerID="f6417992a0c740e620236ae45f22f8042b81c8062e0edc6f288f69e04e528312" Sep 10 04:38:48.290359 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:38:48.290124 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:39:00.289166 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:00.289128 2578 scope.go:117] "RemoveContainer" containerID="f6417992a0c740e620236ae45f22f8042b81c8062e0edc6f288f69e04e528312" Sep 10 04:39:01.012987 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:01.012954 2578 generic.go:356] "Generic (PLEG): container finished" podID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" containerID="cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a" exitCode=0 Sep 10 04:39:01.013159 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:01.013029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" event={"ID":"45636df1-9b64-4f2c-b371-cf1a7fd426a5","Type":"ContainerDied","Data":"cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a"} Sep 10 04:39:01.013159 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:01.013093 2578 scope.go:117] "RemoveContainer" containerID="f6417992a0c740e620236ae45f22f8042b81c8062e0edc6f288f69e04e528312" Sep 10 04:39:01.013449 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:01.013432 2578 scope.go:117] "RemoveContainer" containerID="cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a" Sep 10 04:39:01.013683 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:39:01.013665 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:39:04.453717 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:04.453682 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:04.454160 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:04.453745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:04.454160 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:04.453764 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:04.454160 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:04.453779 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:04.454160 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:04.454145 2578 scope.go:117] "RemoveContainer" containerID="cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a" Sep 10 04:39:04.454337 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:39:04.454319 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:39:11.893504 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:11.893469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:39:11.993020 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:11.992982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:39:18.289576 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:18.289547 2578 scope.go:117] "RemoveContainer" containerID="cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a" Sep 10 04:39:18.289980 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:39:18.289734 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:39:33.289154 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:33.289124 2578 scope.go:117] "RemoveContainer" containerID="cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a" Sep 10 04:39:33.289530 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:39:33.289289 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:39:48.289361 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:48.289329 2578 scope.go:117] "RemoveContainer" containerID="cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a" Sep 10 04:39:49.247921 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:49.247886 2578 generic.go:356] "Generic (PLEG): container finished" podID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" exitCode=0 Sep 10 04:39:49.248110 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:49.247965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" event={"ID":"45636df1-9b64-4f2c-b371-cf1a7fd426a5","Type":"ContainerDied","Data":"38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38"} Sep 10 04:39:49.248110 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:49.248023 2578 scope.go:117] "RemoveContainer" containerID="cc2ee859221656720724ec18b879ab6f94950e1b503c5362ec1cbf601d25f83a" Sep 10 04:39:49.248357 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:49.248334 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:39:49.248530 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:39:49.248513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:39:54.454046 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:54.454002 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:54.454519 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:54.454069 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:54.454519 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:54.454088 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:54.454519 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:54.454112 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:39:54.454519 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:39:54.454465 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:39:54.454676 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:39:54.454655 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:40:09.292897 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:40:09.292867 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:40:09.293319 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:40:09.293067 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:40:15.128144 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:40:15.128101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:40:21.290025 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:40:21.289990 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:40:21.290454 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:40:21.290168 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:40:32.289315 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:40:32.289283 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:40:32.289794 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:40:32.289449 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:40:46.289273 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:40:46.289243 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:40:46.289645 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:40:46.289399 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:40:53.769231 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:40:53.769195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:41:01.289917 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:01.289877 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:41:01.290428 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:41:01.290152 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:41:12.289301 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:12.289217 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:41:12.645305 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:12.645273 2578 generic.go:356] "Generic (PLEG): container finished" podID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" exitCode=0 Sep 10 04:41:12.645478 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:12.645339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" event={"ID":"45636df1-9b64-4f2c-b371-cf1a7fd426a5","Type":"ContainerDied","Data":"d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea"} Sep 10 04:41:12.645478 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:12.645384 2578 scope.go:117] "RemoveContainer" containerID="38852c79389d9d50cf6d03425d12c72140189fccef0a69556c68fd8d15960d38" Sep 10 04:41:12.645757 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:12.645738 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:41:12.646006 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:41:12.645983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:41:14.453539 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:14.453506 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:41:14.453923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:14.453568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:41:14.453923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:14.453587 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:41:14.453923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:14.453600 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" Sep 10 04:41:14.454064 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:14.453928 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:41:14.454150 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:41:14.454132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:41:19.270571 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:19.270541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:41:19.270998 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:19.270835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:41:19.278221 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:19.278200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:41:19.278347 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:19.278229 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:41:26.289594 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:26.289558 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:41:26.290053 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:41:26.289751 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:41:39.291455 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:39.291422 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:41:39.291841 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:41:39.291593 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:41:51.289548 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:41:51.289516 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:41:51.290058 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:41:51.289702 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:42:03.290041 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:03.290003 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:42:03.292478 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:42:03.290275 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:42:15.290121 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:15.290075 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:42:15.290505 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:42:15.290292 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:42:30.289252 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:30.289212 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:42:30.289728 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:42:30.289373 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:42:31.369691 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:31.369659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f5ccc9c68-cn2vv_f7a77e40-91db-4fd3-9772-dc571792f323/authorino/0.log" Sep 10 04:42:37.242201 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:37.242169 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-6thxj_d027d3ac-0493-4e44-bc07-b37f81f4191c/copy-manifests/0.log" Sep 10 04:42:37.253668 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:37.253644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-6thxj_d027d3ac-0493-4e44-bc07-b37f81f4191c/manager/0.log" Sep 10 04:42:38.759299 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:38.759259 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f5ccc9c68-cn2vv_f7a77e40-91db-4fd3-9772-dc571792f323/authorino/0.log" Sep 10 04:42:39.459415 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:39.459378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-bkf7v_44027bf6-ebf8-4df8-8473-eabf159cc519/manager/0.log" Sep 10 04:42:40.165119 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:40.165090 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-mfms5_418cdeb6-8375-4484-b0fd-a994443c0af4/kube-auth-proxy/0.log" Sep 10 04:42:40.510285 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:40.510256 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-n7jmc_ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd/payload-processing/0.log" Sep 10 04:42:41.076061 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:41.076030 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-k82tb_45636df1-9b64-4f2c-b371-cf1a7fd426a5/main/5.log" Sep 10 04:42:41.295479 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:41.295454 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-llgpt_9bb25cd5-74c1-4771-aa44-12b398ea1ada/main/0.log" Sep 10 04:42:45.290079 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:45.290044 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:42:45.290458 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:42:45.290278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:42:46.671661 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.671627 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfjbl/must-gather-4925t"] Sep 10 04:42:46.675466 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.675442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:46.677701 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.677681 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfjbl\"/\"kube-root-ca.crt\"" Sep 10 04:42:46.678327 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.678311 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfjbl\"/\"openshift-service-ca.crt\"" Sep 10 04:42:46.678408 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.678314 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfjbl\"/\"default-dockercfg-gnz5s\"" Sep 10 04:42:46.683989 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.683967 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/must-gather-4925t"] Sep 10 04:42:46.702610 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.702582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:42:46.810071 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.810026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkn6d\" (UniqueName: \"kubernetes.io/projected/7367d622-8d59-4a2c-ba02-af0d66ae7e23-kube-api-access-mkn6d\") pod \"must-gather-4925t\" (UID: \"7367d622-8d59-4a2c-ba02-af0d66ae7e23\") " pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:46.810071 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.810078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7367d622-8d59-4a2c-ba02-af0d66ae7e23-must-gather-output\") pod \"must-gather-4925t\" (UID: \"7367d622-8d59-4a2c-ba02-af0d66ae7e23\") " pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:46.911481 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.911449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkn6d\" (UniqueName: \"kubernetes.io/projected/7367d622-8d59-4a2c-ba02-af0d66ae7e23-kube-api-access-mkn6d\") pod \"must-gather-4925t\" (UID: \"7367d622-8d59-4a2c-ba02-af0d66ae7e23\") " pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:46.911627 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.911490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7367d622-8d59-4a2c-ba02-af0d66ae7e23-must-gather-output\") pod \"must-gather-4925t\" (UID: \"7367d622-8d59-4a2c-ba02-af0d66ae7e23\") " pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:46.911884 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.911867 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7367d622-8d59-4a2c-ba02-af0d66ae7e23-must-gather-output\") pod \"must-gather-4925t\" (UID: \"7367d622-8d59-4a2c-ba02-af0d66ae7e23\") " pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:46.924527 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.924465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkn6d\" (UniqueName: \"kubernetes.io/projected/7367d622-8d59-4a2c-ba02-af0d66ae7e23-kube-api-access-mkn6d\") pod \"must-gather-4925t\" (UID: \"7367d622-8d59-4a2c-ba02-af0d66ae7e23\") " pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:46.985568 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:46.985529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/must-gather-4925t" Sep 10 04:42:47.254490 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:47.254467 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/must-gather-4925t"] Sep 10 04:42:47.256849 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:42:47.256817 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7367d622_8d59_4a2c_ba02_af0d66ae7e23.slice/crio-3bb03f7f52a5d61f9ce15e9fe49fb1aeeaad7c9aff8df689f3ef2fd803c9c2ea WatchSource:0}: Error finding container 3bb03f7f52a5d61f9ce15e9fe49fb1aeeaad7c9aff8df689f3ef2fd803c9c2ea: Status 404 returned error can't find the container with id 3bb03f7f52a5d61f9ce15e9fe49fb1aeeaad7c9aff8df689f3ef2fd803c9c2ea Sep 10 04:42:48.125101 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:48.125034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/must-gather-4925t" event={"ID":"7367d622-8d59-4a2c-ba02-af0d66ae7e23","Type":"ContainerStarted","Data":"3bb03f7f52a5d61f9ce15e9fe49fb1aeeaad7c9aff8df689f3ef2fd803c9c2ea"} Sep 10 04:42:48.618409 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:48.618371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" limit=1024 Sep 10 04:42:49.133026 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:49.132984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/must-gather-4925t" event={"ID":"7367d622-8d59-4a2c-ba02-af0d66ae7e23","Type":"ContainerStarted","Data":"b823863b617d5c3321b856dae9d271936c00760eeeb0be18703a4267a7a3e78a"} Sep 10 04:42:49.133523 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:49.133040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/must-gather-4925t" event={"ID":"7367d622-8d59-4a2c-ba02-af0d66ae7e23","Type":"ContainerStarted","Data":"218b3f41b44e33a346a2568a0dc1f6a920104b16bcd2e8cf824c1c6de9d54e65"} Sep 10 04:42:49.148219 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:49.148164 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfjbl/must-gather-4925t" podStartSLOduration=2.175031215 podStartE2EDuration="3.148147316s" totalImagesPullingTime="973.116101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:42:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:49.146247815 +0000 UTC m=+990.325453557" watchObservedRunningTime="2026-09-10 04:42:49.148147316 +0000 UTC m=+990.327353090" Sep 10 04:42:49.829977 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:49.829922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mfb5v_6fd51def-abce-4b16-b3fe-5726ed40beea/global-pull-secret-syncer/0.log" Sep 10 04:42:49.907359 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:49.907333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8dnfh_a177953c-a1a4-45f5-9387-160fe1319eaa/konnectivity-agent/0.log" Sep 10 04:42:49.972700 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:49.972667 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-39.ec2.internal_ddc035b1f6b36816b1b1df70406f05f5/haproxy/0.log" Sep 10 04:42:54.562641 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:54.562572 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f5ccc9c68-cn2vv_f7a77e40-91db-4fd3-9772-dc571792f323/authorino/0.log" Sep 10 04:42:54.734720 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:54.734672 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-bkf7v_44027bf6-ebf8-4df8-8473-eabf159cc519/manager/0.log" Sep 10 04:42:56.290125 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.290034 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:42:56.290621 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:42:56.290313 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:42:56.497615 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.497576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-98bgq_39e4e57d-d703-4471-8868-62e7e551ec69/cluster-monitoring-operator/0.log" Sep 10 04:42:56.527964 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.527899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zs7bz_21167426-504a-47ef-8cef-aa8e88c9a9ef/kube-state-metrics/0.log" Sep 10 04:42:56.543536 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.543463 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zs7bz_21167426-504a-47ef-8cef-aa8e88c9a9ef/kube-rbac-proxy-main/0.log" Sep 10 04:42:56.562979 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.562926 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zs7bz_21167426-504a-47ef-8cef-aa8e88c9a9ef/kube-rbac-proxy-self/0.log" Sep 10 04:42:56.587031 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.586958 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b95fc577c-fjchh_fefd63d7-6545-456f-8247-1b5bf0263bb0/metrics-server/0.log" Sep 10 04:42:56.614803 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.614776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-cqdrc_d42cd242-0fd1-4aec-bf40-0896f181fd3a/monitoring-plugin/0.log" Sep 10 04:42:56.663976 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.663919 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4l9mx_b913a895-cae1-4969-ab74-f895c7af234c/node-exporter/0.log" Sep 10 04:42:56.686432 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.686402 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4l9mx_b913a895-cae1-4969-ab74-f895c7af234c/kube-rbac-proxy/0.log" Sep 10 04:42:56.708227 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.708190 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4l9mx_b913a895-cae1-4969-ab74-f895c7af234c/init-textfile/0.log" Sep 10 04:42:56.904425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.904328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vwzpg_d940592e-1c91-4d6b-9596-ffccbf5a1e04/kube-rbac-proxy-main/0.log" Sep 10 04:42:56.934467 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.934394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vwzpg_d940592e-1c91-4d6b-9596-ffccbf5a1e04/kube-rbac-proxy-self/0.log" Sep 10 04:42:56.953517 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.953492 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vwzpg_d940592e-1c91-4d6b-9596-ffccbf5a1e04/openshift-state-metrics/0.log" Sep 10 04:42:56.992200 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:56.992132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ebf0b04-6fa8-4c83-a648-064610f417dc/prometheus/0.log" Sep 10 04:42:57.011402 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.011368 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ebf0b04-6fa8-4c83-a648-064610f417dc/config-reloader/0.log" Sep 10 04:42:57.049729 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.049697 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ebf0b04-6fa8-4c83-a648-064610f417dc/thanos-sidecar/0.log" Sep 10 04:42:57.092411 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.091309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ebf0b04-6fa8-4c83-a648-064610f417dc/kube-rbac-proxy-web/0.log" Sep 10 04:42:57.128959 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.120747 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ebf0b04-6fa8-4c83-a648-064610f417dc/kube-rbac-proxy/0.log" Sep 10 04:42:57.144883 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.144822 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ebf0b04-6fa8-4c83-a648-064610f417dc/kube-rbac-proxy-thanos/0.log" Sep 10 04:42:57.168343 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.168251 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9ebf0b04-6fa8-4c83-a648-064610f417dc/init-config-reloader/0.log" Sep 10 04:42:57.271361 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.271336 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-jtg8r_1497f8c0-436c-4e6f-84a9-38a3fa9aac91/prometheus-operator-admission-webhook/0.log" Sep 10 04:42:57.388181 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.388148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f68468458-zgzbj_9a61c7c1-6315-40cc-8a92-bd26d78016fe/thanos-query/0.log" Sep 10 04:42:57.407200 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.407130 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f68468458-zgzbj_9a61c7c1-6315-40cc-8a92-bd26d78016fe/kube-rbac-proxy-web/0.log" Sep 10 04:42:57.427806 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.427721 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f68468458-zgzbj_9a61c7c1-6315-40cc-8a92-bd26d78016fe/kube-rbac-proxy/0.log" Sep 10 04:42:57.446727 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.446700 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f68468458-zgzbj_9a61c7c1-6315-40cc-8a92-bd26d78016fe/prom-label-proxy/0.log" Sep 10 04:42:57.477526 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.477499 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f68468458-zgzbj_9a61c7c1-6315-40cc-8a92-bd26d78016fe/kube-rbac-proxy-rules/0.log" Sep 10 04:42:57.496761 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:57.496714 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f68468458-zgzbj_9a61c7c1-6315-40cc-8a92-bd26d78016fe/kube-rbac-proxy-metrics/0.log" Sep 10 04:42:59.476214 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.476176 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/1.log" Sep 10 04:42:59.482910 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.482884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-gmvpw_3cc1f1dd-b5d0-4c8a-b917-9d8d9a83f5a9/console-operator/2.log" Sep 10 04:42:59.644923 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.644887 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj"] Sep 10 04:42:59.649482 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.649461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.651698 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.651667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-lib-modules\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.651840 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.651726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtwvw\" (UniqueName: \"kubernetes.io/projected/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-kube-api-access-xtwvw\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.651840 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.651756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-sys\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.651840 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.651825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-podres\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.652035 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.651872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-proc\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.658079 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.658054 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj"] Sep 10 04:42:59.752521 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-podres\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.752681 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-proc\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.752681 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-lib-modules\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.752681 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtwvw\" (UniqueName: \"kubernetes.io/projected/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-kube-api-access-xtwvw\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.752681 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-sys\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.752889 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-proc\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.752889 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-podres\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.752889 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.752779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-sys\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.753109 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.753086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-lib-modules\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.761142 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.761113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtwvw\" (UniqueName: \"kubernetes.io/projected/ac81d98f-b5aa-4936-b640-6af15f0bd6d5-kube-api-access-xtwvw\") pod \"perf-node-gather-daemonset-8l5bj\" (UID: \"ac81d98f-b5aa-4936-b640-6af15f0bd6d5\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:42:59.964207 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:42:59.964166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:43:00.081394 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:00.081363 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-64fsx_ba970170-1f2d-4860-bffd-53891b6b0710/download-server/0.log" Sep 10 04:43:00.265371 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:00.265337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj"] Sep 10 04:43:00.270116 ip-10-0-129-39 kubenswrapper[2578]: W0910 04:43:00.269350 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac81d98f_b5aa_4936_b640_6af15f0bd6d5.slice/crio-45524ec683c01c2ce4e3bdd1bcc4a45d108113f3bb3fcec96c556c0d21407436 WatchSource:0}: Error finding container 45524ec683c01c2ce4e3bdd1bcc4a45d108113f3bb3fcec96c556c0d21407436: Status 404 returned error can't find the container with id 45524ec683c01c2ce4e3bdd1bcc4a45d108113f3bb3fcec96c556c0d21407436 Sep 10 04:43:00.734199 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:00.734131 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-jvzll_0a439850-c330-454a-b338-6ae2b045b6b9/volume-data-source-validator/0.log" Sep 10 04:43:01.227833 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:01.227795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" event={"ID":"ac81d98f-b5aa-4936-b640-6af15f0bd6d5","Type":"ContainerStarted","Data":"9f4e5471a6ce48811b43dfcf4b3b0593f957294acf640158acfcf35cca8abf94"} Sep 10 04:43:01.228120 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:01.228100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" event={"ID":"ac81d98f-b5aa-4936-b640-6af15f0bd6d5","Type":"ContainerStarted","Data":"45524ec683c01c2ce4e3bdd1bcc4a45d108113f3bb3fcec96c556c0d21407436"} Sep 10 04:43:01.228980 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:01.228958 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:43:01.250655 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:01.250578 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" podStartSLOduration=2.250555694 podStartE2EDuration="2.250555694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:43:01.24308274 +0000 UTC m=+1002.422288479" watchObservedRunningTime="2026-09-10 04:43:01.250555694 +0000 UTC m=+1002.429761432" Sep 10 04:43:01.870528 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:01.870497 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h6vhr_8391c7a9-ac44-4c5c-81ef-294def14a6a8/dns/0.log" Sep 10 04:43:01.889498 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:01.889470 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h6vhr_8391c7a9-ac44-4c5c-81ef-294def14a6a8/kube-rbac-proxy/0.log" Sep 10 04:43:01.912844 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:01.912806 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9klcc_dba58b6d-a2a6-408d-a3e8-2ce8aa3d3778/dns-node-resolver/0.log" Sep 10 04:43:02.537620 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:02.537591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxq8f_168b05f1-90ad-4efa-90b0-58fbc982ff48/node-ca/0.log" Sep 10 04:43:03.491055 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:03.491025 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-mfms5_418cdeb6-8375-4484-b0fd-a994443c0af4/kube-auth-proxy/0.log" Sep 10 04:43:03.555878 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:03.555841 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-n7jmc_ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd/payload-processing/0.log" Sep 10 04:43:04.195071 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:04.195040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bx6zz_99b96eb5-9593-4741-b02f-4fa003bc30ea/serve-healthcheck-canary/0.log" Sep 10 04:43:04.799802 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:04.799776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nqx5f_1e0918d0-6235-4b4a-bd5b-540bc67f140c/kube-rbac-proxy/0.log" Sep 10 04:43:04.819847 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:04.819823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nqx5f_1e0918d0-6235-4b4a-bd5b-540bc67f140c/exporter/0.log" Sep 10 04:43:04.838448 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:04.838422 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nqx5f_1e0918d0-6235-4b4a-bd5b-540bc67f140c/extractor/0.log" Sep 10 04:43:07.045751 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:07.045716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-6thxj_d027d3ac-0493-4e44-bc07-b37f81f4191c/manager/0.log" Sep 10 04:43:07.067605 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:07.067577 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-6thxj_d027d3ac-0493-4e44-bc07-b37f81f4191c/copy-manifests/0.log" Sep 10 04:43:08.253314 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:08.253285 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-8l5bj" Sep 10 04:43:08.289570 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:08.289547 2578 scope.go:117] "RemoveContainer" containerID="d0a84f0d617a000ead79eff3aa6894545b806dd214191841f85a96fe9a5b7dea" Sep 10 04:43:08.289736 ip-10-0-129-39 kubenswrapper[2578]: E0910 04:43:08.289717 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-k82tb_llm(45636df1-9b64-4f2c-b371-cf1a7fd426a5)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-k82tb" podUID="45636df1-9b64-4f2c-b371-cf1a7fd426a5" Sep 10 04:43:08.305860 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:08.305832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f5554b4b-rk6x6_7d9c0f9a-8d20-42be-89a7-ae27fe4b98c8/manager/0.log" Sep 10 04:43:08.331417 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:08.331391 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jkvvb_f688456c-bdcf-4b55-b17a-0292aa1b6660/openshift-lws-operator/0.log" Sep 10 04:43:10.379475 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:10.379440 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-mfms5_418cdeb6-8375-4484-b0fd-a994443c0af4/kube-auth-proxy/0.log" Sep 10 04:43:10.446268 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:10.446240 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-n7jmc_ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd/payload-processing/0.log" Sep 10 04:43:11.742547 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:11.742510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-mfms5_418cdeb6-8375-4484-b0fd-a994443c0af4/kube-auth-proxy/0.log" Sep 10 04:43:11.801244 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:11.801207 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-n7jmc_ea511f09-b3a4-4ca5-a5a8-a06c9f9279fd/payload-processing/0.log" Sep 10 04:43:13.672596 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:13.672554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-nbdln_06ddeb2c-9349-44f8-b5b5-beb4f3644e67/migrator/0.log" Sep 10 04:43:13.695425 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:13.695399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-nbdln_06ddeb2c-9349-44f8-b5b5-beb4f3644e67/graceful-termination/0.log" Sep 10 04:43:15.314848 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.314820 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jcps_4133922b-1aea-4f2b-a8e7-b3aaa93485d6/kube-multus-additional-cni-plugins/0.log" Sep 10 04:43:15.340306 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.340283 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jcps_4133922b-1aea-4f2b-a8e7-b3aaa93485d6/egress-router-binary-copy/0.log" Sep 10 04:43:15.363404 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.363384 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jcps_4133922b-1aea-4f2b-a8e7-b3aaa93485d6/cni-plugins/0.log" Sep 10 04:43:15.380400 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.380377 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jcps_4133922b-1aea-4f2b-a8e7-b3aaa93485d6/bond-cni-plugin/0.log" Sep 10 04:43:15.401788 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.401765 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jcps_4133922b-1aea-4f2b-a8e7-b3aaa93485d6/routeoverride-cni/0.log" Sep 10 04:43:15.418641 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.418618 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jcps_4133922b-1aea-4f2b-a8e7-b3aaa93485d6/whereabouts-cni-bincopy/0.log" Sep 10 04:43:15.436025 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.436000 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jcps_4133922b-1aea-4f2b-a8e7-b3aaa93485d6/whereabouts-cni/0.log" Sep 10 04:43:15.465506 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.465486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kpbl6_6746c33b-e34e-455c-b81c-36a4fff92671/kube-multus/0.log" Sep 10 04:43:15.488118 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.487746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-65vps_5f180f4c-4210-41ef-8601-951bece8a406/network-metrics-daemon/0.log" Sep 10 04:43:15.503041 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:15.503021 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-65vps_5f180f4c-4210-41ef-8601-951bece8a406/kube-rbac-proxy/0.log" Sep 10 04:43:16.342389 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.342342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-controller/0.log" Sep 10 04:43:16.359050 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.359027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/1.log" Sep 10 04:43:16.359218 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.359105 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovn-acl-logging/0.log" Sep 10 04:43:16.376391 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.376371 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/kube-rbac-proxy-node/0.log" Sep 10 04:43:16.396921 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.396900 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 04:43:16.416745 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.416728 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/northd/0.log" Sep 10 04:43:16.435075 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.435057 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/nbdb/0.log" Sep 10 04:43:16.456890 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.456863 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/sbdb/0.log" Sep 10 04:43:16.499868 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:16.499837 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48n48_a018a8b0-0d3a-4663-925e-8bcbb50ec5b5/ovnkube-controller/0.log" Sep 10 04:43:17.950976 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:17.950927 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-hpkqq_20597051-07ce-495a-a465-2ae9e9d8796a/check-endpoints/0.log" Sep 10 04:43:18.023569 ip-10-0-129-39 kubenswrapper[2578]: I0910 04:43:18.023546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zb5qd_42b6e19f-71b1-43ba-be33-795b8d5dd2b3/network-check-target-container/0.log"