Jul 01 17:15:12.321949 ip-10-0-129-36 systemd[1]: Starting Kubernetes Kubelet... Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.718574 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724449 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724461 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724464 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724467 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724472 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724475 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724478 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:15:12.760099 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724481 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724483 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724486 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724489 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724492 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724495 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724497 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724500 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724503 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724506 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724508 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724511 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724514 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724517 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724519 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724523 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724525 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724528 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724531 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724534 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:15:12.762159 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724536 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724539 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724541 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724544 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724546 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724549 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724552 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724554 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724558 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724561 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724564 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724566 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724568 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724571 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724573 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724576 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724578 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724582 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724584 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724587 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:15:12.774931 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724591 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724593 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724596 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724598 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724601 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724603 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724606 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724609 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724612 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724615 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724617 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724620 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724634 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724638 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724651 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724653 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724656 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724659 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724661 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724664 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:15:12.776689 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724667 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724670 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724673 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724675 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724678 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724681 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724683 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724686 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724688 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724693 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724698 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724701 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724705 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724708 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724711 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724715 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724718 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724721 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724724 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:15:12.778815 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724726 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724729 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724732 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724735 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724737 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724742 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724744 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724747 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724750 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724752 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724755 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724759 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.724763 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725491 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725500 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725503 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725508 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725511 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725513 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:15:12.790552 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725516 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:15:12.790502 ip-10-0-129-36 systemd[1]: Started Kubernetes Kubelet. Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725519 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725521 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725524 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725527 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725529 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725532 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725534 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725537 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725540 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725543 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725546 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725549 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725552 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725554 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725557 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725560 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725562 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725565 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725568 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:15:12.791981 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725570 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725573 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725575 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725577 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725580 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725583 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725585 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725588 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725590 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725593 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725596 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725599 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725601 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725603 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725607 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725609 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725612 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725615 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725617 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725620 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:15:12.794416 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725647 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725650 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725653 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725655 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725658 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725661 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725663 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725666 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725669 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725671 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725674 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725676 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725679 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725682 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725684 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725688 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725690 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725695 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725699 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725706 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:15:12.809152 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725709 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725712 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725714 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725719 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725723 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725725 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725729 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725731 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725734 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725737 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725739 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725742 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725745 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725748 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725752 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725755 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725758 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725761 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725764 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:15:12.811517 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725767 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725771 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725774 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725777 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725780 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725782 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725784 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725787 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725789 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725792 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725794 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725797 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725801 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.725804 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726191 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726196 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726199 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726201 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726204 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:15:12.814174 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726209 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726213 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726216 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726219 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726222 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726225 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726227 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726230 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726233 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726236 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726239 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726241 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726244 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726247 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726249 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726252 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726254 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726257 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726259 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726261 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:15:12.816294 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726264 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726266 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726269 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726271 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726273 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726278 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726280 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726285 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726287 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726290 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726293 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726295 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726298 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726301 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726303 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726306 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726309 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726329 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726333 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726337 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:15:12.818699 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726340 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726343 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726346 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726349 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726351 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726354 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726357 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726360 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726362 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726365 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726367 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726370 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726372 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726375 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726377 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726380 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726382 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726386 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726388 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726393 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:15:12.830500 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726395 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726398 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726400 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726405 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726408 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726411 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726414 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726417 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726420 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726424 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726426 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726429 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726432 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726435 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726437 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726440 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726442 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726445 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726447 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726450 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:15:12.833365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726453 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726455 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726458 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726460 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726463 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726465 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726467 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726470 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726472 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726477 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726480 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726484 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726486 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.726489 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726562 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726577 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726587 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726594 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726598 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726602 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726606 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 17:15:12.846670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726610 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726614 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726617 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726620 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726640 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726646 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726651 2566 flags.go:64] FLAG: --cgroup-root="" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726655 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726658 2566 flags.go:64] FLAG: --client-ca-file="" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726661 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726666 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726670 2566 flags.go:64] FLAG: --cluster-domain="" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726673 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726677 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726680 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726684 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726688 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726691 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726694 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726698 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726703 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726706 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726710 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726713 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 17:15:12.863037 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726716 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726720 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726724 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726727 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726730 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726733 2566 flags.go:64] FLAG: --enable-server="true" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726736 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726741 2566 flags.go:64] FLAG: --event-burst="100" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726744 2566 flags.go:64] FLAG: --event-qps="50" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726747 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726750 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726753 2566 flags.go:64] FLAG: --eviction-hard="" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726757 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726760 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726763 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726766 2566 flags.go:64] FLAG: --eviction-soft="" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726768 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726771 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726774 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726777 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726780 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726783 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726786 2566 flags.go:64] FLAG: --feature-gates="" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726790 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726792 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 17:15:13.018839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726795 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726799 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726801 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726806 2566 flags.go:64] FLAG: --help="false" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726809 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726813 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726816 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726819 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726823 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726826 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726829 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726832 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726835 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726838 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726841 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726844 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726847 2566 flags.go:64] FLAG: --kube-reserved="" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726850 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726853 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726856 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726859 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726861 2566 flags.go:64] FLAG: --lock-file="" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726864 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726867 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 17:15:13.021765 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726870 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726875 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726878 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726881 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726884 2566 flags.go:64] FLAG: --logging-format="text" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726887 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726890 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726893 2566 flags.go:64] FLAG: --manifest-url="" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726896 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726901 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726904 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726910 2566 flags.go:64] FLAG: --max-pods="110" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726912 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726917 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726920 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726923 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726926 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726929 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726932 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726939 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726942 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726945 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726948 2566 flags.go:64] FLAG: --pod-cidr="" Jul 01 17:15:13.034269 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726951 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726956 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726959 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726962 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726965 2566 flags.go:64] FLAG: --port="10250" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726968 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726971 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060bb27818a31da3c" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726974 2566 flags.go:64] FLAG: --qos-reserved="" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726977 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726980 2566 flags.go:64] FLAG: --register-node="true" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726983 2566 flags.go:64] FLAG: --register-with-taints="" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726987 2566 flags.go:64] FLAG: --registry-burst="10" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726990 2566 flags.go:64] FLAG: --registry-qps="5" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726993 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726995 2566 flags.go:64] FLAG: --reserved-memory="" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.726999 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727002 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727005 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727008 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727011 2566 flags.go:64] FLAG: --runonce="false" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727016 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727019 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727022 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727026 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727029 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727032 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 17:15:13.035526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727035 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727038 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727041 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727043 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727046 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727050 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727053 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727056 2566 flags.go:64] FLAG: --system-cgroups="" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727059 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727064 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727067 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727070 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727074 2566 flags.go:64] FLAG: --tls-min-version="" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727077 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727079 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727082 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727085 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727088 2566 flags.go:64] FLAG: --v="2" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727091 2566 flags.go:64] FLAG: --version="false" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727095 2566 flags.go:64] FLAG: --vmodule="" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727099 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727102 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727223 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727226 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:15:13.041881 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727229 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727232 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727236 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727238 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727241 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727245 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727247 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727250 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727252 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727255 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727258 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727260 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727262 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727265 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727268 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727270 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727273 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727276 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727278 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:15:13.042682 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727281 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727283 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727286 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727288 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727291 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727293 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727295 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727298 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727300 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727303 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727306 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727308 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727312 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727316 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727319 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727325 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727328 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727330 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727334 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727337 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:15:13.043317 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727339 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727342 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727345 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727347 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727350 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727353 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727355 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727358 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727361 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727363 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727366 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727368 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727371 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727373 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727377 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727380 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727383 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727386 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727388 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:15:13.044671 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727391 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727393 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727396 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727399 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727401 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727403 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727406 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727409 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727413 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727415 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727418 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727424 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727427 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727430 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727432 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727435 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727437 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727440 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727443 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727445 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:15:13.046062 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727448 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727450 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727453 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727456 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727458 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727461 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727463 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727466 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727469 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727471 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727474 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727476 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727479 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727481 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727484 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727486 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727488 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727491 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:15:13.048400 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.727494 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.727502 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.735505 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.735527 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.735547 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.735553 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735614 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735619 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735637 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735643 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735646 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735649 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735652 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735655 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:15:13.050365 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735659 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735664 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735667 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735669 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735672 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735675 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735677 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735680 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735682 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735685 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735688 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735690 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735693 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735697 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735700 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735703 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735712 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735715 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735718 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735721 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:15:13.052307 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735723 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735726 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735729 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735732 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735735 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735738 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735740 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735743 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735746 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735751 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735754 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735757 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735760 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735762 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735765 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735768 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735770 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735773 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735776 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735779 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:15:13.052875 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735783 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735786 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735789 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735792 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735796 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735799 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735801 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735804 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735807 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735809 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735812 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735815 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735817 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735820 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735823 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735825 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735828 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735830 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735833 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735836 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:15:13.054962 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735838 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735843 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735845 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735848 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735851 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735854 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735856 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735859 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735861 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735864 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735866 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735876 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735879 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735881 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735884 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735886 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735889 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735892 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735894 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:15:13.056597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735898 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735901 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735903 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735906 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735909 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735911 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735913 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735916 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735919 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735921 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735924 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.735926 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.735932 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736052 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736058 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:15:13.057737 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736064 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736067 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736070 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736073 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736076 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736079 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736082 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736085 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736088 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736090 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736094 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736096 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736099 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736101 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736104 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736107 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736110 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736113 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736116 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736120 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:15:13.058525 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736124 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736127 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736130 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736133 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736135 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736138 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736141 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736144 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736147 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736149 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736152 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736155 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736159 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736161 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736164 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736166 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736169 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736172 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736174 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:15:13.059550 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736178 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736182 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736184 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736187 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736191 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736193 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736196 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736198 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736201 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736204 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736209 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736212 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736215 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736218 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736221 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736223 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736226 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736228 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736230 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736233 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:15:13.060371 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736236 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736239 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736241 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736244 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736246 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736250 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736253 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736255 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736258 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736261 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736263 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736266 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736268 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736271 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736273 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736276 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736278 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736282 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736284 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736287 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:15:13.061190 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736289 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736292 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736296 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736299 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736301 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736304 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736306 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736309 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736311 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736314 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736316 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736319 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736321 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736324 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736326 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736329 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736331 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:15:13.062017 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:12.736335 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.736340 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.736457 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.738444 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.739927 2566 server.go:1019] "Starting client certificate rotation" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.740030 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.740071 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.742547 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.743730 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.753193 2566 log.go:25] "Validated CRI v1 runtime API" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.755181 2566 log.go:25] "Validated CRI v1 image API" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.761225 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 17:15:13.062647 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.763574 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ceb85bd-f011-4221-b411-2c1e2bd6ed64:/dev/nvme0n1p4 d40305ac-a359-4d13-8cf0-062a5da43da4:/dev/nvme0n1p3] Jul 01 17:15:13.063249 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.763589 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.769474 2566 manager.go:216] Machine: {Timestamp:2026-07-01 17:15:12.767806433 +0000 UTC m=+0.328533724 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099384 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ab8358e2d057e1e58a5c543ddca6 SystemUUID:ec20ab83-58e2-d057-e1e5-8a5c543ddca6 BootID:7e2e8cce-24a2-4833-b877-dbf69a9ebe22 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e0:7c:97:b8:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e0:7c:97:b8:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:72:41:8b:ab:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.770393 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.770516 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.773918 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.773955 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.774848 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.774865 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 17:15:13.063358 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.774876 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.774969 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.775405 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.776440 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.779537 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.779680 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.779709 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.779719 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.779736 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.779747 2566 kubelet.go:398] "Adding apiserver pod source" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.779756 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.780095 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.780110 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.782026 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.783330 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.783358 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.783976 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.783991 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.783998 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784003 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784011 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784017 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784128 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784135 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784143 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784148 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784157 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.784165 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.785805 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.785818 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.789549 2566 server.go:1268] "Started kubelet" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.789819 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.789886 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.790501 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.790515 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.790977 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.791231 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.791230 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.793224 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 01 17:15:13.063912 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.793457 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgtc4" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.795431 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.795765 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-36.ec2.internal.18be39da6d96452e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-36.ec2.internal,UID:ip-10-0-129-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-36.ec2.internal,},FirstTimestamp:2026-07-01 17:15:12.789513518 +0000 UTC m=+0.350240805,LastTimestamp:2026-07-01 17:15:12.789513518 +0000 UTC m=+0.350240805,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-36.ec2.internal,}" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.797448 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.797448 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.797518 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.798153 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.798168 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.798154 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.798314 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.798322 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.798998 2566 factory.go:55] Registering systemd factory Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.799015 2566 factory.go:223] Registration of the systemd container factory successfully Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.799686 2566 factory.go:153] Registering CRI-O factory Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.799701 2566 factory.go:223] Registration of the crio container factory successfully Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.799747 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.799773 2566 factory.go:103] Registering Raw factory Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.799786 2566 manager.go:1196] Started watching for new ooms in manager Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.800108 2566 manager.go:349] Starting recovery of all containers Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.800546 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgtc4" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.806159 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.806176 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.814505 2566 manager.go:354] Recovery completed Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.820472 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.822290 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.822316 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.822326 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.822852 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.822864 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.822864 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.822937 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.823509 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:15:13.064949 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.823531 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.823540 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.824156 2566 policy_none.go:49] "None policy: Start" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.824169 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.824179 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.825100 2566 policy_none.go:47] "Start" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.872871 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.874167 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.874218 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.874248 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.874279 2566 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.877009 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.881870 2566 manager.go:337] "Starting Device Plugin manager" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.881902 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.881947 2566 server.go:87] "Starting device plugin registration server" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.882251 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.882263 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.882374 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.882492 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.882503 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.883056 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.883112 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.975332 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal"] Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.975441 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.976499 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.976528 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.976542 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978019 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978173 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978204 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978794 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978807 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978823 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978833 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978845 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.978835 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.979927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.979949 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:15:13.178036 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.980579 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.980600 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.980612 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.983251 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.984013 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.984042 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.984055 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.984073 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:12.993515 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:12.993533 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-36.ec2.internal\": node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.000125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54aea7e6d57584afd61101d481f4054f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"54aea7e6d57584afd61101d481f4054f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.000157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89149ae4cf017bd46857159b6a684787-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"89149ae4cf017bd46857159b6a684787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.000178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54aea7e6d57584afd61101d481f4054f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"54aea7e6d57584afd61101d481f4054f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:13.006242 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-36.ec2.internal\" not found" node="ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:13.010592 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-36.ec2.internal\" not found" node="ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:13.066362 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.101110 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54aea7e6d57584afd61101d481f4054f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"54aea7e6d57584afd61101d481f4054f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.101138 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54aea7e6d57584afd61101d481f4054f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"54aea7e6d57584afd61101d481f4054f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.101156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89149ae4cf017bd46857159b6a684787-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"89149ae4cf017bd46857159b6a684787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.101198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54aea7e6d57584afd61101d481f4054f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"54aea7e6d57584afd61101d481f4054f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.101232 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89149ae4cf017bd46857159b6a684787-config\") pod \"kube-apiserver-proxy-ip-10-0-129-36.ec2.internal\" (UID: \"89149ae4cf017bd46857159b6a684787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179731 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.101192 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54aea7e6d57584afd61101d481f4054f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal\" (UID: \"54aea7e6d57584afd61101d481f4054f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.179731 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:13.167197 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:13.273875 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:13.267677 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:13.371201 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.309555 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.371201 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:13.313814 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Jul 01 17:15:13.371201 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:13.368030 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:15.393698 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:13.468286 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:15.494770 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:15.399444 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:15.494770 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.494213 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:15:15.584203 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:15.500478 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:15.584203 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.569912 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 17:15:15.584203 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.570097 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 17:15:15.584203 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.570095 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 17:15:15.709433 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:15.601336 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:15.709433 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.634668 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 17:10:14 +0000 UTC" deadline="2028-04-16 19:52:51.838982856 +0000 UTC" Jul 01 17:15:15.709433 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.634692 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15722h37m36.204293977s" Jul 01 17:15:15.709433 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:15.701924 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:15.796531 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:15.786586 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89149ae4cf017bd46857159b6a684787.slice/crio-f5734dfa7bdb61a237cae902434b153f75c6f8be5d24d3bf1be302992b0a2698 WatchSource:0}: Error finding container f5734dfa7bdb61a237cae902434b153f75c6f8be5d24d3bf1be302992b0a2698: Status 404 returned error can't find the container with id f5734dfa7bdb61a237cae902434b153f75c6f8be5d24d3bf1be302992b0a2698 Jul 01 17:15:15.796531 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.790581 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:15:15.882729 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:15.802768 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-36.ec2.internal\" not found" Jul 01 17:15:15.882729 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.861268 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:15:15.882729 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:15.880899 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54aea7e6d57584afd61101d481f4054f.slice/crio-bf69863283e3b864cc3dd5249c55c8ba74f9513fa835d2529aa3324726f40eac WatchSource:0}: Error finding container bf69863283e3b864cc3dd5249c55c8ba74f9513fa835d2529aa3324726f40eac: Status 404 returned error can't find the container with id bf69863283e3b864cc3dd5249c55c8ba74f9513fa835d2529aa3324726f40eac Jul 01 17:15:15.928289 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.928263 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" Jul 01 17:15:15.936598 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.936577 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:15:15.938543 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.938530 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" Jul 01 17:15:15.949168 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:15.949147 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:15:16.089542 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.089453 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:15:16.610800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.610741 2566 apiserver.go:52] "Watching apiserver" Jul 01 17:15:16.620888 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.620860 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 17:15:16.621394 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.621359 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-bltzn","kube-system/global-pull-secret-syncer-7bxz7","kube-system/konnectivity-agent-5j7vj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9","openshift-cluster-node-tuning-operator/tuned-9f9hj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal","openshift-multus/multus-additional-cni-plugins-g8nks","openshift-multus/network-metrics-daemon-sjvp6","openshift-network-diagnostics/network-check-target-tnj7f","kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal","openshift-dns/node-resolver-2777j","openshift-image-registry/node-ca-bh6mg","openshift-multus/multus-nzb4x","openshift-network-operator/iptables-alerter-wsg8p"] Jul 01 17:15:16.623244 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.623222 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.624137 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.624110 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.625666 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.625392 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.627637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.626470 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 17:15:16.627637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.626678 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 17:15:16.627637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.627026 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 17:15:16.627637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.627219 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 17:15:16.627637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.627267 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nfqvz\"" Jul 01 17:15:16.627637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.627464 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hbk4m\"" Jul 01 17:15:16.627637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.627498 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 17:15:16.628025 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.627686 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 17:15:16.628565 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.628538 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 17:15:16.628661 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.628596 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 17:15:16.628778 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.628763 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7j995\"" Jul 01 17:15:16.628876 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.628863 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 17:15:16.629144 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.629125 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.631122 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.630411 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.631687 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.631648 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.632223 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.632185 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 17:15:16.632223 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.632206 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gcgqx\"" Jul 01 17:15:16.632356 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.632252 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 17:15:16.632356 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.632330 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 17:15:16.632996 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.632826 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:15:16.633135 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.633115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:16.633909 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.633184 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:16.634201 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.634132 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pxn68\"" Jul 01 17:15:16.637219 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.634943 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 17:15:16.637219 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.635250 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.637219 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.635297 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:15:16.638120 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.638098 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 17:15:16.638216 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.637920 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:16.638216 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.638190 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 17:15:16.638319 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.638217 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-47q82\"" Jul 01 17:15:16.638368 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.638327 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:16.640010 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.639983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.640752 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.640715 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 17:15:16.641749 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.641724 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.642430 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642401 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qxl8n\"" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642639 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-cni-multus\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642698 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642781 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/557a6a46-5859-48eb-80c7-37341eaa71d1-agent-certs\") pod \"konnectivity-agent-5j7vj\" (UID: \"557a6a46-5859-48eb-80c7-37341eaa71d1\") " pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.642832 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642846 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-cni-bin\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-system-cni-dir\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642928 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642936 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-device-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.642985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643008 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a675bfef-5893-42a0-a512-57a99525fad2-cni-binary-copy\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-os-release\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.643164 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-os-release\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-k8s-cni-cncf-io\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643185 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-kubelet\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvtm\" (UniqueName: \"kubernetes.io/projected/4d6eb582-8684-4064-8f26-e43ff8a093bc-kube-api-access-tfvtm\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cnibin\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-hostroot\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643305 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-conf-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643328 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-etc-kubernetes\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-registration-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-sys-fs\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a675bfef-5893-42a0-a512-57a99525fad2-multus-daemon-config\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-multus-certs\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.643914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5m6\" (UniqueName: \"kubernetes.io/projected/a675bfef-5893-42a0-a512-57a99525fad2-kube-api-access-qx5m6\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/557a6a46-5859-48eb-80c7-37341eaa71d1-konnectivity-ca\") pod \"konnectivity-agent-5j7vj\" (UID: \"557a6a46-5859-48eb-80c7-37341eaa71d1\") " pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-socket-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-cni-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-cnibin\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsjkc\" (UniqueName: \"kubernetes.io/projected/65beb9bf-9a21-42b9-8a07-78a2056f2a69-kube-api-access-wsjkc\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-system-cni-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643778 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-socket-dir-parent\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-netns\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.643821 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.644015 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pbzgr\"" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.644065 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.644309 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.644403 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.644595 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 17:15:16.644641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.644612 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-55nkr\"" Jul 01 17:15:16.646062 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.646026 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:15:16.672692 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.672649 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9dm6d" Jul 01 17:15:16.679254 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.679231 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9dm6d" Jul 01 17:15:16.709477 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.709391 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"54aea7e6d57584afd61101d481f4054f","Type":"ContainerStarted","Data":"bf69863283e3b864cc3dd5249c55c8ba74f9513fa835d2529aa3324726f40eac"} Jul 01 17:15:16.710692 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.710664 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" event={"ID":"89149ae4cf017bd46857159b6a684787","Type":"ContainerStarted","Data":"f5734dfa7bdb61a237cae902434b153f75c6f8be5d24d3bf1be302992b0a2698"} Jul 01 17:15:16.730442 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.730362 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 17:15:16.744832 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.744799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvtm\" (UniqueName: \"kubernetes.io/projected/4d6eb582-8684-4064-8f26-e43ff8a093bc-kube-api-access-tfvtm\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.744998 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.744842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-systemd\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.744998 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.744864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.744998 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.744921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.745189 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-kubelet-config\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.745189 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/def04042-a611-4c77-8aa2-d531743ab9f4-etc-tuned\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.745189 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-conf-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.745189 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-etc-kubernetes\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.745378 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-conf-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.745378 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745248 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-registration-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.745378 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745281 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-etc-kubernetes\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.745378 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:16.745378 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7gvk\" (UniqueName: \"kubernetes.io/projected/111da01d-53a9-42e6-abe2-34fbffd31333-kube-api-access-v7gvk\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-ovnkube-config\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745424 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7cx\" (UniqueName: \"kubernetes.io/projected/13b24819-945c-45e3-96d9-f1ed546fb00d-kube-api-access-bk7cx\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745426 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-registration-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-kubernetes\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-multus-certs\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5m6\" (UniqueName: \"kubernetes.io/projected/a675bfef-5893-42a0-a512-57a99525fad2-kube-api-access-qx5m6\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-ovn\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-env-overrides\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3ca5874-cebc-4b61-af4e-1e60f7537a45-hosts-file\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.745662 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysctl-d\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-var-lib-kubelet\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqd9\" (UniqueName: \"kubernetes.io/projected/def04042-a611-4c77-8aa2-d531743ab9f4-kube-api-access-2xqd9\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsjkc\" (UniqueName: \"kubernetes.io/projected/65beb9bf-9a21-42b9-8a07-78a2056f2a69-kube-api-access-wsjkc\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-socket-dir-parent\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-netns\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-cni-multus\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/557a6a46-5859-48eb-80c7-37341eaa71d1-agent-certs\") pod \"konnectivity-agent-5j7vj\" (UID: \"557a6a46-5859-48eb-80c7-37341eaa71d1\") " pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-multus-certs\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/135aec59-03b2-4348-9134-5fd5c62cc137-serviceca\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7jb9\" (UniqueName: \"kubernetes.io/projected/135aec59-03b2-4348-9134-5fd5c62cc137-kube-api-access-l7jb9\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745980 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-system-cni-dir\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.745985 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-cni-multus\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746026 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-netns\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-system-cni-dir\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-socket-dir-parent\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-run-netns\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3ca5874-cebc-4b61-af4e-1e60f7537a45-tmp-dir\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-systemd\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-lib-modules\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def04042-a611-4c77-8aa2-d531743ab9f4-tmp\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746420 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-node-log\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746447 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a675bfef-5893-42a0-a512-57a99525fad2-cni-binary-copy\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-os-release\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvtc\" (UniqueName: \"kubernetes.io/projected/99540372-1d60-4570-9a6d-0651d17c939e-kube-api-access-qxvtc\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.746819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cnibin\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-cni-netd\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cnibin\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746701 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-slash\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-hostroot\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99540372-1d60-4570-9a6d-0651d17c939e-host-slash\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746878 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-hostroot\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746927 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-kubelet\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.746997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-cni-bin\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-sys-fs\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a675bfef-5893-42a0-a512-57a99525fad2-multus-daemon-config\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/557a6a46-5859-48eb-80c7-37341eaa71d1-konnectivity-ca\") pod \"konnectivity-agent-5j7vj\" (UID: \"557a6a46-5859-48eb-80c7-37341eaa71d1\") " pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.747554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747118 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-socket-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747144 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-os-release\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-log-socket\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747187 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-ovnkube-script-lib\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747190 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-sys-fs\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-cni-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-cnibin\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747272 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-socket-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/135aec59-03b2-4348-9134-5fd5c62cc137-host\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747344 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-run\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.748248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747449 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-system-cni-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747496 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-cnibin\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a675bfef-5893-42a0-a512-57a99525fad2-cni-binary-copy\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99540372-1d60-4570-9a6d-0651d17c939e-iptables-alerter-script\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-systemd-units\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysconfig\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-cni-bin\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747656 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-system-cni-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747709 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a675bfef-5893-42a0-a512-57a99525fad2-multus-daemon-config\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-cni-bin\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-var-lib-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.748800 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.747786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-etc-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.755429 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.755398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/557a6a46-5859-48eb-80c7-37341eaa71d1-konnectivity-ca\") pod \"konnectivity-agent-5j7vj\" (UID: \"557a6a46-5859-48eb-80c7-37341eaa71d1\") " pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.755689 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.755665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.755875 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.755846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65beb9bf-9a21-42b9-8a07-78a2056f2a69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.756098 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13b24819-945c-45e3-96d9-f1ed546fb00d-ovn-node-metrics-cert\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.756188 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-dbus\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.756188 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756129 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/557a6a46-5859-48eb-80c7-37341eaa71d1-agent-certs\") pod \"konnectivity-agent-5j7vj\" (UID: \"557a6a46-5859-48eb-80c7-37341eaa71d1\") " pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.756188 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-device-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.756328 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.756328 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-multus-cni-dir\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.756328 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wrbf\" (UniqueName: \"kubernetes.io/projected/e3ca5874-cebc-4b61-af4e-1e60f7537a45-kube-api-access-8wrbf\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.756469 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-modprobe-d\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.756469 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysctl-conf\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.756469 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756408 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-sys\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.756469 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-host\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.756469 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65beb9bf-9a21-42b9-8a07-78a2056f2a69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.756714 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756478 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d6eb582-8684-4064-8f26-e43ff8a093bc-device-dir\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.756714 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-os-release\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.756714 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-k8s-cni-cncf-io\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.756714 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-kubelet\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.756714 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756622 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-os-release\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.756948 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756728 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-run-k8s-cni-cncf-io\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.756948 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.756779 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a675bfef-5893-42a0-a512-57a99525fad2-host-var-lib-kubelet\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.760104 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.760077 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvtm\" (UniqueName: \"kubernetes.io/projected/4d6eb582-8684-4064-8f26-e43ff8a093bc-kube-api-access-tfvtm\") pod \"aws-ebs-csi-driver-node-nd8c9\" (UID: \"4d6eb582-8684-4064-8f26-e43ff8a093bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.760219 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.760128 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsjkc\" (UniqueName: \"kubernetes.io/projected/65beb9bf-9a21-42b9-8a07-78a2056f2a69-kube-api-access-wsjkc\") pod \"multus-additional-cni-plugins-g8nks\" (UID: \"65beb9bf-9a21-42b9-8a07-78a2056f2a69\") " pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.760531 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.760509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5m6\" (UniqueName: \"kubernetes.io/projected/a675bfef-5893-42a0-a512-57a99525fad2-kube-api-access-qx5m6\") pod \"multus-nzb4x\" (UID: \"a675bfef-5893-42a0-a512-57a99525fad2\") " pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.814051 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.814007 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:15:16.857864 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857822 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99540372-1d60-4570-9a6d-0651d17c939e-host-slash\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.857864 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-kubelet\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-cni-bin\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857910 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-log-socket\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-ovnkube-script-lib\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/135aec59-03b2-4348-9134-5fd5c62cc137-host\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-cni-bin\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858019 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-log-socket\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-run\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99540372-1d60-4570-9a6d-0651d17c939e-host-slash\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.857973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-kubelet\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858096 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/135aec59-03b2-4348-9134-5fd5c62cc137-host\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99540372-1d60-4570-9a6d-0651d17c939e-iptables-alerter-script\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858122 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-run\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.858166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-systemd-units\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-systemd-units\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysconfig\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-var-lib-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-etc-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.858271 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858280 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysconfig\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.858334 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret podName:00db3ae7-3f11-4ad8-8e2a-4a484f552b97 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:17.358316928 +0000 UTC m=+3.088639115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret") pod "global-pull-secret-syncer-7bxz7" (UID: "00db3ae7-3f11-4ad8-8e2a-4a484f552b97") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858337 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-var-lib-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858341 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-etc-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858364 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13b24819-945c-45e3-96d9-f1ed546fb00d-ovn-node-metrics-cert\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-dbus\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858414 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wrbf\" (UniqueName: \"kubernetes.io/projected/e3ca5874-cebc-4b61-af4e-1e60f7537a45-kube-api-access-8wrbf\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.858852 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-modprobe-d\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysctl-conf\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-sys\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-host\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-systemd\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858568 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858643 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-ovnkube-script-lib\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858655 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-kubelet-config\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99540372-1d60-4570-9a6d-0651d17c939e-iptables-alerter-script\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858689 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/def04042-a611-4c77-8aa2-d531743ab9f4-etc-tuned\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-dbus\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-sys\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7gvk\" (UniqueName: \"kubernetes.io/projected/111da01d-53a9-42e6-abe2-34fbffd31333-kube-api-access-v7gvk\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:16.859530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858763 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-host\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858773 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-openvswitch\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-ovnkube-config\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858725 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-kubelet-config\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7cx\" (UniqueName: \"kubernetes.io/projected/13b24819-945c-45e3-96d9-f1ed546fb00d-kube-api-access-bk7cx\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858817 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858828 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-kubernetes\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysctl-conf\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-ovn\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858859 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-systemd\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-env-overrides\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3ca5874-cebc-4b61-af4e-1e60f7537a45-hosts-file\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysctl-d\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858991 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-var-lib-kubelet\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859014 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqd9\" (UniqueName: \"kubernetes.io/projected/def04042-a611-4c77-8aa2-d531743ab9f4-kube-api-access-2xqd9\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3ca5874-cebc-4b61-af4e-1e60f7537a45-hosts-file\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.858828 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-modprobe-d\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-kubernetes\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/135aec59-03b2-4348-9134-5fd5c62cc137-serviceca\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7jb9\" (UniqueName: \"kubernetes.io/projected/135aec59-03b2-4348-9134-5fd5c62cc137-kube-api-access-l7jb9\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859154 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-var-lib-kubelet\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-run-netns\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-run-netns\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-run-ovn\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3ca5874-cebc-4b61-af4e-1e60f7537a45-tmp-dir\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-systemd\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859252 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-lib-modules\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.859273 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def04042-a611-4c77-8aa2-d531743ab9f4-tmp\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.860951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-sysctl-d\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-node-log\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859319 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-etc-systemd\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.859341 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:17.359322973 +0000 UTC m=+3.089645164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-ovnkube-config\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-node-log\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13b24819-945c-45e3-96d9-f1ed546fb00d-env-overrides\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvtc\" (UniqueName: \"kubernetes.io/projected/99540372-1d60-4570-9a6d-0651d17c939e-kube-api-access-qxvtc\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859431 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def04042-a611-4c77-8aa2-d531743ab9f4-lib-modules\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-cni-netd\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859481 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-slash\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859501 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3ca5874-cebc-4b61-af4e-1e60f7537a45-tmp-dir\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859556 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-slash\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13b24819-945c-45e3-96d9-f1ed546fb00d-host-cni-netd\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.861774 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.859773 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/135aec59-03b2-4348-9134-5fd5c62cc137-serviceca\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.862668 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.862644 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/def04042-a611-4c77-8aa2-d531743ab9f4-etc-tuned\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.862839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.862813 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def04042-a611-4c77-8aa2-d531743ab9f4-tmp\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.862951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.862923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13b24819-945c-45e3-96d9-f1ed546fb00d-ovn-node-metrics-cert\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.867468 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.867441 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:15:16.867468 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.867472 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:15:16.867661 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.867486 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6zq4k for pod openshift-network-diagnostics/network-check-target-tnj7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:16.867661 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:16.867597 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k podName:1781a910-62f2-436b-8b03-637048b12be6 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:17.367578314 +0000 UTC m=+3.097900521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6zq4k" (UniqueName: "kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k") pod "network-check-target-tnj7f" (UID: "1781a910-62f2-436b-8b03-637048b12be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:16.870322 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.870293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvtc\" (UniqueName: \"kubernetes.io/projected/99540372-1d60-4570-9a6d-0651d17c939e-kube-api-access-qxvtc\") pod \"iptables-alerter-wsg8p\" (UID: \"99540372-1d60-4570-9a6d-0651d17c939e\") " pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.872656 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.872627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wrbf\" (UniqueName: \"kubernetes.io/projected/e3ca5874-cebc-4b61-af4e-1e60f7537a45-kube-api-access-8wrbf\") pod \"node-resolver-2777j\" (UID: \"e3ca5874-cebc-4b61-af4e-1e60f7537a45\") " pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:16.872770 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.872657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7jb9\" (UniqueName: \"kubernetes.io/projected/135aec59-03b2-4348-9134-5fd5c62cc137-kube-api-access-l7jb9\") pod \"node-ca-bh6mg\" (UID: \"135aec59-03b2-4348-9134-5fd5c62cc137\") " pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.873239 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.873213 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7gvk\" (UniqueName: \"kubernetes.io/projected/111da01d-53a9-42e6-abe2-34fbffd31333-kube-api-access-v7gvk\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:16.873666 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.873636 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7cx\" (UniqueName: \"kubernetes.io/projected/13b24819-945c-45e3-96d9-f1ed546fb00d-kube-api-access-bk7cx\") pod \"ovnkube-node-bltzn\" (UID: \"13b24819-945c-45e3-96d9-f1ed546fb00d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.874229 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.874206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqd9\" (UniqueName: \"kubernetes.io/projected/def04042-a611-4c77-8aa2-d531743ab9f4-kube-api-access-2xqd9\") pod \"tuned-9f9hj\" (UID: \"def04042-a611-4c77-8aa2-d531743ab9f4\") " pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.939907 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.939873 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g8nks" Jul 01 17:15:16.948920 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.948883 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzb4x" Jul 01 17:15:16.958492 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.958462 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bh6mg" Jul 01 17:15:16.963450 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.963423 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:16.971462 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.971441 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" Jul 01 17:15:16.978322 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.978305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" Jul 01 17:15:16.986796 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.986781 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wsg8p" Jul 01 17:15:16.994538 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.994517 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:16.999147 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:16.999128 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2777j" Jul 01 17:15:17.362530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:17.362501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:17.362699 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:17.362583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:17.362699 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.362668 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:17.362699 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.362669 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:17.362854 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.362719 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:18.362703871 +0000 UTC m=+4.093026059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:17.362854 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.362731 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret podName:00db3ae7-3f11-4ad8-8e2a-4a484f552b97 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:18.362725676 +0000 UTC m=+4.093047874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret") pod "global-pull-secret-syncer-7bxz7" (UID: "00db3ae7-3f11-4ad8-8e2a-4a484f552b97") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:17.462917 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:17.462881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:17.463086 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.463044 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:15:17.463086 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.463065 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:15:17.463086 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.463079 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6zq4k for pod openshift-network-diagnostics/network-check-target-tnj7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:17.463220 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:17.463142 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k podName:1781a910-62f2-436b-8b03-637048b12be6 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:18.463123798 +0000 UTC m=+4.193445992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zq4k" (UniqueName: "kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k") pod "network-check-target-tnj7f" (UID: "1781a910-62f2-436b-8b03-637048b12be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:17.681226 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:17.681111 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:10:16 +0000 UTC" deadline="2028-01-31 17:56:59.1172943 +0000 UTC" Jul 01 17:15:17.681226 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:17.681150 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13896h41m41.436149072s" Jul 01 17:15:17.681428 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:17.681336 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:15:17.780827 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.780791 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ca5874_cebc_4b61_af4e_1e60f7537a45.slice/crio-fbb6eb4d37529ba9c77b329c4faea38643954922045d0a2a03216f4ba0c26ef7 WatchSource:0}: Error finding container fbb6eb4d37529ba9c77b329c4faea38643954922045d0a2a03216f4ba0c26ef7: Status 404 returned error can't find the container with id fbb6eb4d37529ba9c77b329c4faea38643954922045d0a2a03216f4ba0c26ef7 Jul 01 17:15:17.785485 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.785459 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b24819_945c_45e3_96d9_f1ed546fb00d.slice/crio-6c7cff9d88e66cf0883f0e006a746783f1cbf017caab4533fee303fdeb837c91 WatchSource:0}: Error finding container 6c7cff9d88e66cf0883f0e006a746783f1cbf017caab4533fee303fdeb837c91: Status 404 returned error can't find the container with id 6c7cff9d88e66cf0883f0e006a746783f1cbf017caab4533fee303fdeb837c91 Jul 01 17:15:17.787330 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.787307 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda675bfef_5893_42a0_a512_57a99525fad2.slice/crio-9bbddcb7ea9c4be83e9d24e760e62d2b47deaf1dc36550751a503b0788ed273d WatchSource:0}: Error finding container 9bbddcb7ea9c4be83e9d24e760e62d2b47deaf1dc36550751a503b0788ed273d: Status 404 returned error can't find the container with id 9bbddcb7ea9c4be83e9d24e760e62d2b47deaf1dc36550751a503b0788ed273d Jul 01 17:15:17.788538 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.788518 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135aec59_03b2_4348_9134_5fd5c62cc137.slice/crio-eccee21d8b6c8072b4cab37806a907fd87f89b3514342cef5cf93823f09151b6 WatchSource:0}: Error finding container eccee21d8b6c8072b4cab37806a907fd87f89b3514342cef5cf93823f09151b6: Status 404 returned error can't find the container with id eccee21d8b6c8072b4cab37806a907fd87f89b3514342cef5cf93823f09151b6 Jul 01 17:15:17.788867 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.788831 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99540372_1d60_4570_9a6d_0651d17c939e.slice/crio-5ba65d3a4357f0484619b89060b606ccded08d2104ac00b40e259e30f0b5f308 WatchSource:0}: Error finding container 5ba65d3a4357f0484619b89060b606ccded08d2104ac00b40e259e30f0b5f308: Status 404 returned error can't find the container with id 5ba65d3a4357f0484619b89060b606ccded08d2104ac00b40e259e30f0b5f308 Jul 01 17:15:17.789927 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.789909 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65beb9bf_9a21_42b9_8a07_78a2056f2a69.slice/crio-1702b5e2c219edd9c5cb9cd383b644e10cdba78fcbe6ad02f001e7f3d8dd473b WatchSource:0}: Error finding container 1702b5e2c219edd9c5cb9cd383b644e10cdba78fcbe6ad02f001e7f3d8dd473b: Status 404 returned error can't find the container with id 1702b5e2c219edd9c5cb9cd383b644e10cdba78fcbe6ad02f001e7f3d8dd473b Jul 01 17:15:17.791185 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.791160 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6eb582_8684_4064_8f26_e43ff8a093bc.slice/crio-68020b50b7a6f013414bc6f1c6027e7cd848bbd2f3df0194a331dff3451e4e4f WatchSource:0}: Error finding container 68020b50b7a6f013414bc6f1c6027e7cd848bbd2f3df0194a331dff3451e4e4f: Status 404 returned error can't find the container with id 68020b50b7a6f013414bc6f1c6027e7cd848bbd2f3df0194a331dff3451e4e4f Jul 01 17:15:17.791711 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.791646 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef04042_a611_4c77_8aa2_d531743ab9f4.slice/crio-eda0c22c44ae1ba8ad29968ee604c631f73a83f0d4cf20b8386e8ee7d5598f76 WatchSource:0}: Error finding container eda0c22c44ae1ba8ad29968ee604c631f73a83f0d4cf20b8386e8ee7d5598f76: Status 404 returned error can't find the container with id eda0c22c44ae1ba8ad29968ee604c631f73a83f0d4cf20b8386e8ee7d5598f76 Jul 01 17:15:17.793528 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:17.793442 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557a6a46_5859_48eb_80c7_37341eaa71d1.slice/crio-5ccc1554b57d9c9b25f63bffa2eb87febfac40445ade70f0a4fc92678c55fb54 WatchSource:0}: Error finding container 5ccc1554b57d9c9b25f63bffa2eb87febfac40445ade70f0a4fc92678c55fb54: Status 404 returned error can't find the container with id 5ccc1554b57d9c9b25f63bffa2eb87febfac40445ade70f0a4fc92678c55fb54 Jul 01 17:15:18.370611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.370515 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:18.370611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.370603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:18.370829 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.370654 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:18.370829 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.370722 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:18.370829 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.370738 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret podName:00db3ae7-3f11-4ad8-8e2a-4a484f552b97 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:20.370715828 +0000 UTC m=+6.101038041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret") pod "global-pull-secret-syncer-7bxz7" (UID: "00db3ae7-3f11-4ad8-8e2a-4a484f552b97") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:18.370829 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.370774 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:20.370758356 +0000 UTC m=+6.101080551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:18.472410 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.471731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:18.472410 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.471961 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:15:18.472410 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.471980 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:15:18.472410 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.471992 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6zq4k for pod openshift-network-diagnostics/network-check-target-tnj7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:18.472410 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.472066 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k podName:1781a910-62f2-436b-8b03-637048b12be6 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:20.472047171 +0000 UTC m=+6.202369375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zq4k" (UniqueName: "kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k") pod "network-check-target-tnj7f" (UID: "1781a910-62f2-436b-8b03-637048b12be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:18.682282 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.682121 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:10:16 +0000 UTC" deadline="2028-03-21 08:00:18.32227948 +0000 UTC" Jul 01 17:15:18.682282 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.682180 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15086h44m59.640102707s" Jul 01 17:15:18.707817 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.707773 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:18.707984 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.707916 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:18.708381 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.708357 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:18.708487 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.708466 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:18.708563 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.708547 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:18.708636 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:18.708619 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:18.721575 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.721539 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5j7vj" event={"ID":"557a6a46-5859-48eb-80c7-37341eaa71d1","Type":"ContainerStarted","Data":"5ccc1554b57d9c9b25f63bffa2eb87febfac40445ade70f0a4fc92678c55fb54"} Jul 01 17:15:18.724598 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.724480 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wsg8p" event={"ID":"99540372-1d60-4570-9a6d-0651d17c939e","Type":"ContainerStarted","Data":"5ba65d3a4357f0484619b89060b606ccded08d2104ac00b40e259e30f0b5f308"} Jul 01 17:15:18.726365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.726263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bh6mg" event={"ID":"135aec59-03b2-4348-9134-5fd5c62cc137","Type":"ContainerStarted","Data":"eccee21d8b6c8072b4cab37806a907fd87f89b3514342cef5cf93823f09151b6"} Jul 01 17:15:18.739654 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.739587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzb4x" event={"ID":"a675bfef-5893-42a0-a512-57a99525fad2","Type":"ContainerStarted","Data":"9bbddcb7ea9c4be83e9d24e760e62d2b47deaf1dc36550751a503b0788ed273d"} Jul 01 17:15:18.743388 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.743357 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"6c7cff9d88e66cf0883f0e006a746783f1cbf017caab4533fee303fdeb837c91"} Jul 01 17:15:18.747539 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.747505 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2777j" event={"ID":"e3ca5874-cebc-4b61-af4e-1e60f7537a45","Type":"ContainerStarted","Data":"fbb6eb4d37529ba9c77b329c4faea38643954922045d0a2a03216f4ba0c26ef7"} Jul 01 17:15:18.751304 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.751245 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" event={"ID":"def04042-a611-4c77-8aa2-d531743ab9f4","Type":"ContainerStarted","Data":"eda0c22c44ae1ba8ad29968ee604c631f73a83f0d4cf20b8386e8ee7d5598f76"} Jul 01 17:15:18.753129 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.753061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" event={"ID":"4d6eb582-8684-4064-8f26-e43ff8a093bc","Type":"ContainerStarted","Data":"68020b50b7a6f013414bc6f1c6027e7cd848bbd2f3df0194a331dff3451e4e4f"} Jul 01 17:15:18.757752 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.757692 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerStarted","Data":"1702b5e2c219edd9c5cb9cd383b644e10cdba78fcbe6ad02f001e7f3d8dd473b"} Jul 01 17:15:18.774538 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.773744 2566 generic.go:356] "Generic (PLEG): container finished" podID="54aea7e6d57584afd61101d481f4054f" containerID="f9bae17fa7bfbd0ffe99b11892b5767b3760e2f975c9d00f34763b734f5a7fd8" exitCode=0 Jul 01 17:15:18.774538 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.773833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"54aea7e6d57584afd61101d481f4054f","Type":"ContainerDied","Data":"f9bae17fa7bfbd0ffe99b11892b5767b3760e2f975c9d00f34763b734f5a7fd8"} Jul 01 17:15:18.789071 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.789022 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" event={"ID":"89149ae4cf017bd46857159b6a684787","Type":"ContainerStarted","Data":"033384126e8f7e6563803fdf5cd687ea07fb1886e3208ff52d770af743d11c68"} Jul 01 17:15:18.806076 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:18.805921 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-36.ec2.internal" podStartSLOduration=3.8059007019999997 podStartE2EDuration="3.805900702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:18.804930662 +0000 UTC m=+4.535252885" watchObservedRunningTime="2026-07-01 17:15:18.805900702 +0000 UTC m=+4.536222914" Jul 01 17:15:19.818911 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:19.818817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" event={"ID":"54aea7e6d57584afd61101d481f4054f","Type":"ContainerStarted","Data":"061faaecbf4124ac21f05c5852168465f7227b92bd69d61fa72efce723f96284"} Jul 01 17:15:20.391820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:20.391775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:20.391993 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:20.391898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:20.392216 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.392197 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:20.392313 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.392268 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:24.392249348 +0000 UTC m=+10.122571541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:20.392742 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.392721 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:20.392883 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.392798 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret podName:00db3ae7-3f11-4ad8-8e2a-4a484f552b97 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:24.392780701 +0000 UTC m=+10.123102892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret") pod "global-pull-secret-syncer-7bxz7" (UID: "00db3ae7-3f11-4ad8-8e2a-4a484f552b97") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:20.492526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:20.492440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:20.492716 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.492668 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:15:20.492716 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.492701 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:15:20.492716 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.492718 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6zq4k for pod openshift-network-diagnostics/network-check-target-tnj7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:20.492880 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.492783 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k podName:1781a910-62f2-436b-8b03-637048b12be6 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:24.49276315 +0000 UTC m=+10.223085360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zq4k" (UniqueName: "kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k") pod "network-check-target-tnj7f" (UID: "1781a910-62f2-436b-8b03-637048b12be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:20.707001 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:20.706840 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:20.707001 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.706980 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:20.707226 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:20.706850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:20.707226 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:20.707052 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:20.707226 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.707115 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:20.707513 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:20.707444 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:22.706618 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:22.706461 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:22.706618 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:22.706491 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:22.706618 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:22.706606 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:22.707211 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:22.706692 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:22.707211 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:22.706693 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:22.707211 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:22.706822 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:24.423850 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:24.423804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:24.424334 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:24.423940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:24.424334 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.424082 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:24.424334 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.424142 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:32.424123246 +0000 UTC m=+18.154445438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:24.424334 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.424082 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:24.424334 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.424213 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret podName:00db3ae7-3f11-4ad8-8e2a-4a484f552b97 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:32.424192477 +0000 UTC m=+18.154514664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret") pod "global-pull-secret-syncer-7bxz7" (UID: "00db3ae7-3f11-4ad8-8e2a-4a484f552b97") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:24.525205 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:24.525146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:24.525412 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.525334 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:15:24.525412 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.525361 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:15:24.525412 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.525376 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6zq4k for pod openshift-network-diagnostics/network-check-target-tnj7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:24.525569 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.525434 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k podName:1781a910-62f2-436b-8b03-637048b12be6 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:32.525416378 +0000 UTC m=+18.255738578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zq4k" (UniqueName: "kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k") pod "network-check-target-tnj7f" (UID: "1781a910-62f2-436b-8b03-637048b12be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:24.711712 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:24.711631 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:24.711882 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.711751 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:24.711882 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:24.711772 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:24.711988 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.711882 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:24.711988 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:24.711945 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:24.712107 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:24.712021 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:26.705318 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:26.705281 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:26.705750 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:26.705425 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:26.705811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:26.705753 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:26.705811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:26.705768 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:26.705921 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:26.705879 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:26.706052 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:26.706003 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:28.708381 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:28.708349 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:28.708381 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:28.708373 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:28.708996 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:28.708373 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:28.708996 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:28.708477 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:28.708996 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:28.708531 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:28.708996 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:28.708634 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:30.704886 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:30.704852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:30.705344 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:30.704853 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:30.705344 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:30.704984 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:30.705344 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:30.704998 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:30.705344 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:30.705096 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:30.705344 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:30.705179 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:32.490798 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:32.490755 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:32.491339 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:32.490842 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:32.491339 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.490926 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:32.491339 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.490962 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:32.491339 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.491011 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret podName:00db3ae7-3f11-4ad8-8e2a-4a484f552b97 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:48.490988785 +0000 UTC m=+34.221310981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret") pod "global-pull-secret-syncer-7bxz7" (UID: "00db3ae7-3f11-4ad8-8e2a-4a484f552b97") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:32.491339 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.491051 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:48.49101809 +0000 UTC m=+34.221340288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:32.592173 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:32.592131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:32.592341 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.592288 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:15:32.592341 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.592315 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:15:32.592341 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.592331 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6zq4k for pod openshift-network-diagnostics/network-check-target-tnj7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:32.592442 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.592404 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k podName:1781a910-62f2-436b-8b03-637048b12be6 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:48.592382774 +0000 UTC m=+34.322704988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zq4k" (UniqueName: "kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k") pod "network-check-target-tnj7f" (UID: "1781a910-62f2-436b-8b03-637048b12be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:32.705246 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:32.705163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:32.705246 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:32.705209 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:32.705430 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:32.705164 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:32.705430 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.705298 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:32.705430 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.705368 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:32.705585 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:32.705448 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:34.705707 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:34.705670 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:34.706171 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:34.705780 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:34.706171 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:34.705816 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:34.706171 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:34.705932 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:34.706171 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:34.705963 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:34.706171 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:34.706097 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:36.707054 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.705660 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:36.707054 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:36.705799 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:36.707054 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.706081 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:36.707054 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:36.706203 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:36.707054 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.706268 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:36.707054 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:36.706355 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:36.855512 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.855308 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2777j" event={"ID":"e3ca5874-cebc-4b61-af4e-1e60f7537a45","Type":"ContainerStarted","Data":"9df3b2e05f9ea62976634b2c8f8d5e0818c2bb49bb059bf0aef78cd49629d251"} Jul 01 17:15:36.857063 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.857012 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" event={"ID":"def04042-a611-4c77-8aa2-d531743ab9f4","Type":"ContainerStarted","Data":"fe879dbfd02767bd797eb87f97c8ff547a85fe73015fe61aa49bab1bb7d04c6f"} Jul 01 17:15:36.859062 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.859019 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerStarted","Data":"4e65234d9aaf0c9366d004e7dabc0bc658610e8545f7d22a92aa4eacfce54fee"} Jul 01 17:15:36.861684 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.861152 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5j7vj" event={"ID":"557a6a46-5859-48eb-80c7-37341eaa71d1","Type":"ContainerStarted","Data":"13d83b51467092e8afc36f3b174a92ae844a81a989730400121bf4277a693ffe"} Jul 01 17:15:36.864311 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.863936 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bh6mg" event={"ID":"135aec59-03b2-4348-9134-5fd5c62cc137","Type":"ContainerStarted","Data":"4fd51d768475e39771055b8d474f66826814afad7eded3a55ff93d6ccadb4a29"} Jul 01 17:15:36.865604 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.865564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzb4x" event={"ID":"a675bfef-5893-42a0-a512-57a99525fad2","Type":"ContainerStarted","Data":"a92fb5982571aabb673f73d81b1df03cc6b662ae058181ac513a196aa92ad724"} Jul 01 17:15:36.873150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.873026 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-36.ec2.internal" podStartSLOduration=21.872987193 podStartE2EDuration="21.872987193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:19.835576885 +0000 UTC m=+5.565899100" watchObservedRunningTime="2026-07-01 17:15:36.872987193 +0000 UTC m=+22.603309406" Jul 01 17:15:36.873520 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.873446 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2777j" podStartSLOduration=4.041190293 podStartE2EDuration="22.87343286s" totalImagesPullingTime="18.832242567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:36.87312844 +0000 UTC m=+22.603450651" watchObservedRunningTime="2026-07-01 17:15:36.87343286 +0000 UTC m=+22.603755073" Jul 01 17:15:36.924139 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.924081 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nzb4x" podStartSLOduration=4.07633291 podStartE2EDuration="22.924063019s" totalImagesPullingTime="18.847730109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:36.923530186 +0000 UTC m=+22.653852395" watchObservedRunningTime="2026-07-01 17:15:36.924063019 +0000 UTC m=+22.654385230" Jul 01 17:15:36.968962 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:36.968907 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9f9hj" podStartSLOduration=4.145732084 podStartE2EDuration="22.968889891s" totalImagesPullingTime="18.823157807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:36.949530434 +0000 UTC m=+22.679852645" watchObservedRunningTime="2026-07-01 17:15:36.968889891 +0000 UTC m=+22.699212101" Jul 01 17:15:37.001632 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.001584 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5j7vj" podStartSLOduration=8.445696832 podStartE2EDuration="23.001563045s" totalImagesPullingTime="14.555866213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:36.981268349 +0000 UTC m=+22.711590558" watchObservedRunningTime="2026-07-01 17:15:37.001563045 +0000 UTC m=+22.731885258" Jul 01 17:15:37.001988 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.001965 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bh6mg" podStartSLOduration=4.177230402 podStartE2EDuration="23.001960189s" totalImagesPullingTime="18.824729787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:37.001408271 +0000 UTC m=+22.731730473" watchObservedRunningTime="2026-07-01 17:15:37.001960189 +0000 UTC m=+22.732282406" Jul 01 17:15:37.870725 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.870544 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:15:37.871458 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.871010 2566 generic.go:356] "Generic (PLEG): container finished" podID="13b24819-945c-45e3-96d9-f1ed546fb00d" containerID="807ae873287fa6e8cd861bbca9f15b22fe16f5af6c6b4fcbeff92e41f304806f" exitCode=1 Jul 01 17:15:37.871458 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.871089 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"534f60ec72a6e97857e7314b062a7b57c4cfaa9de3b12bc4541e45cf32437bbb"} Jul 01 17:15:37.871458 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.871181 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"68c7e0c3011e0f6408310108101802dd25d902cfe1e1409cc57f91936aaa707b"} Jul 01 17:15:37.871458 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.871218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"9012b0aeffdab3cf115dd3610dbd1a7650b79f528181f0200e8e45346685e16d"} Jul 01 17:15:37.871458 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.871257 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"7a432a2bf5392d464e611e5c7dd4906fd964bb7340574044a4207f0be6a980d4"} Jul 01 17:15:37.871458 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.871299 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerDied","Data":"807ae873287fa6e8cd861bbca9f15b22fe16f5af6c6b4fcbeff92e41f304806f"} Jul 01 17:15:37.871458 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.871341 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"846741c92a5170058578cdbf0fcb5cea0294ebdd3da137f78ae0fc48ae769d3c"} Jul 01 17:15:37.872555 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.872535 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" event={"ID":"4d6eb582-8684-4064-8f26-e43ff8a093bc","Type":"ContainerStarted","Data":"ec513c3c4dbae00438f56079c4f27538b51847666b6ae17bf6f42540210c0193"} Jul 01 17:15:37.873787 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.873765 2566 generic.go:356] "Generic (PLEG): container finished" podID="65beb9bf-9a21-42b9-8a07-78a2056f2a69" containerID="4e65234d9aaf0c9366d004e7dabc0bc658610e8545f7d22a92aa4eacfce54fee" exitCode=0 Jul 01 17:15:37.873861 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:37.873836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerDied","Data":"4e65234d9aaf0c9366d004e7dabc0bc658610e8545f7d22a92aa4eacfce54fee"} Jul 01 17:15:38.081988 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.081958 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:38.082681 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.082665 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:38.255750 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.255722 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 17:15:38.705535 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.705491 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:38.705807 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.705493 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:38.705807 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:38.705604 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:38.705807 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:38.705710 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:38.705807 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.705496 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:38.705957 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:38.705809 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:38.728046 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.727948 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T17:15:38.255736526Z","UUID":"9654d5c6-bd16-454f-aab5-a68f547caf9e","Handler":null,"Name":"","Endpoint":""} Jul 01 17:15:38.729572 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.729553 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 17:15:38.729674 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.729590 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 17:15:38.877522 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.877484 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wsg8p" event={"ID":"99540372-1d60-4570-9a6d-0651d17c939e","Type":"ContainerStarted","Data":"2ba41f6a9232b2b0233ec1a869a88fba13e9e0b18bd3ead50b169dc21745a8f8"} Jul 01 17:15:38.879290 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.879267 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" event={"ID":"4d6eb582-8684-4064-8f26-e43ff8a093bc","Type":"ContainerStarted","Data":"76e67d995a6efff773719c65d0f70e16c2bb3ff2a225f80617b69e2d991d49f5"} Jul 01 17:15:38.879448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.879401 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:38.879879 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.879864 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5j7vj" Jul 01 17:15:38.894453 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:38.894402 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wsg8p" podStartSLOduration=6.064951944 podStartE2EDuration="24.894387534s" totalImagesPullingTime="18.82943559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:38.894115456 +0000 UTC m=+24.624437677" watchObservedRunningTime="2026-07-01 17:15:38.894387534 +0000 UTC m=+24.624709742" Jul 01 17:15:39.893880 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:39.893669 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:15:39.894587 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:39.894563 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"c84917cc9c7b9b633664bdbf999056c8bad8658308b1c17091c5e41c6e8d2081"} Jul 01 17:15:39.897003 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:39.896971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" event={"ID":"4d6eb582-8684-4064-8f26-e43ff8a093bc","Type":"ContainerStarted","Data":"7b78879cd50a790e837dfab1723568177f905d0b56f44498fac6a2ba065771f2"} Jul 01 17:15:39.914262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:39.914207 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nd8c9" podStartSLOduration=4.452262479 podStartE2EDuration="25.914193014s" totalImagesPullingTime="21.461930535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:39.914072174 +0000 UTC m=+25.644394382" watchObservedRunningTime="2026-07-01 17:15:39.914193014 +0000 UTC m=+25.644515225" Jul 01 17:15:40.705557 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:40.705522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:40.705808 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:40.705532 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:40.705808 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:40.705654 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:40.705808 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:40.705535 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:40.705808 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:40.705766 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:40.705990 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:40.705812 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:41.906257 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:41.905980 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:15:41.907102 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:41.906619 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"a21e497d9c39c4404baecff5d670ca522bf217fa1ffba946b6abda8bb2b6d6c1"} Jul 01 17:15:41.907102 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:41.906933 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:41.907102 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:41.907001 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:41.907248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:41.907212 2566 scope.go:117] "RemoveContainer" containerID="807ae873287fa6e8cd861bbca9f15b22fe16f5af6c6b4fcbeff92e41f304806f" Jul 01 17:15:41.924685 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:41.924663 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:41.924799 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:41.924776 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:42.705150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:42.705116 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:42.705352 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:42.705116 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:42.705352 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:42.705248 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:42.705352 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:42.705259 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:42.705352 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:42.705342 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:42.705559 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:42.705426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:42.917787 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:42.917566 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:15:42.918272 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:42.917961 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" event={"ID":"13b24819-945c-45e3-96d9-f1ed546fb00d","Type":"ContainerStarted","Data":"7325140eee7b0d66663a0f18ba856e814547090bc6bdb13d32fa26d546fa8377"} Jul 01 17:15:42.918272 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:42.918202 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 17:15:42.963101 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:42.961303 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" podStartSLOduration=9.927799527 podStartE2EDuration="28.961277837s" totalImagesPullingTime="19.03347831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:42.948966086 +0000 UTC m=+28.679288298" watchObservedRunningTime="2026-07-01 17:15:42.961277837 +0000 UTC m=+28.691600048" Jul 01 17:15:43.921163 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:43.921131 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 17:15:43.927493 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:43.927462 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7bxz7"] Jul 01 17:15:43.927642 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:43.927630 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:43.927759 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:43.927738 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:43.930468 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:43.930428 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tnj7f"] Jul 01 17:15:43.930671 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:43.930533 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:43.930671 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:43.930635 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:43.931184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:43.931164 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sjvp6"] Jul 01 17:15:43.931302 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:43.931284 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:43.931423 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:43.931391 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:44.924706 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:44.924673 2566 generic.go:356] "Generic (PLEG): container finished" podID="65beb9bf-9a21-42b9-8a07-78a2056f2a69" containerID="792f40f509d4c16e8fe67ec98de5bb4211ec954f99cfa32be6211be17a333865" exitCode=0 Jul 01 17:15:44.924706 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:44.924712 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerDied","Data":"792f40f509d4c16e8fe67ec98de5bb4211ec954f99cfa32be6211be17a333865"} Jul 01 17:15:45.705133 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:45.705101 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:45.705133 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:45.705123 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:45.705133 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:45.705134 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:45.705488 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:45.705215 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:45.705488 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:45.705303 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:45.705488 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:45.705391 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:45.931685 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:45.931650 2566 generic.go:356] "Generic (PLEG): container finished" podID="65beb9bf-9a21-42b9-8a07-78a2056f2a69" containerID="c862c2cde958767c6aacaa429692fa6d3ee3e192fa5e016874a6cd6d8350186a" exitCode=0 Jul 01 17:15:45.932198 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:45.931704 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerDied","Data":"c862c2cde958767c6aacaa429692fa6d3ee3e192fa5e016874a6cd6d8350186a"} Jul 01 17:15:46.265335 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:46.265308 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:15:46.265570 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:46.265556 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 17:15:46.275395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:46.275345 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" podUID="13b24819-945c-45e3-96d9-f1ed546fb00d" containerName="ovnkube-controller" probeResult="failure" output="" Jul 01 17:15:46.284165 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:46.284132 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" podUID="13b24819-945c-45e3-96d9-f1ed546fb00d" containerName="ovnkube-controller" probeResult="failure" output="" Jul 01 17:15:46.936316 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:46.936243 2566 generic.go:356] "Generic (PLEG): container finished" podID="65beb9bf-9a21-42b9-8a07-78a2056f2a69" containerID="e91a5f18f7551f763797756614ff1f559a4e6c1ba7955f9c41187427afdfef16" exitCode=0 Jul 01 17:15:46.936316 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:46.936286 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerDied","Data":"e91a5f18f7551f763797756614ff1f559a4e6c1ba7955f9c41187427afdfef16"} Jul 01 17:15:47.705383 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:47.705354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:47.705552 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:47.705389 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:47.705552 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:47.705389 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:47.705552 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:47.705459 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bxz7" podUID="00db3ae7-3f11-4ad8-8e2a-4a484f552b97" Jul 01 17:15:47.705716 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:47.705567 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnj7f" podUID="1781a910-62f2-436b-8b03-637048b12be6" Jul 01 17:15:47.705716 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:47.705668 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:15:48.506908 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:48.506875 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:48.507363 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:48.506946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:48.507363 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.507047 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:48.507363 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.507081 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:48.507363 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.507128 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret podName:00db3ae7-3f11-4ad8-8e2a-4a484f552b97 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:20.507108677 +0000 UTC m=+66.237430867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret") pod "global-pull-secret-syncer-7bxz7" (UID: "00db3ae7-3f11-4ad8-8e2a-4a484f552b97") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:15:48.507363 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.507148 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:20.507137544 +0000 UTC m=+66.237459735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:15:48.608240 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:48.608198 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:48.608427 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.608397 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:15:48.608427 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.608424 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:15:48.608526 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.608439 2566 projected.go:196] Error preparing data for projected volume kube-api-access-6zq4k for pod openshift-network-diagnostics/network-check-target-tnj7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:48.608526 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:48.608507 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k podName:1781a910-62f2-436b-8b03-637048b12be6 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:20.608489987 +0000 UTC m=+66.338812182 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zq4k" (UniqueName: "kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k") pod "network-check-target-tnj7f" (UID: "1781a910-62f2-436b-8b03-637048b12be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:15:49.533069 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.532962 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-36.ec2.internal" event="NodeReady" Jul 01 17:15:49.533810 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.533149 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 17:15:49.566748 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.566718 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c9d9c594f-bnrc8"] Jul 01 17:15:49.569441 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.569413 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.572748 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.572717 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 17:15:49.573000 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.572985 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 17:15:49.573132 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.573070 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 17:15:49.573405 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.573391 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jkmfz\"" Jul 01 17:15:49.577200 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.577153 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5g4lc"] Jul 01 17:15:49.579510 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.579486 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:49.579869 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.579789 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 17:15:49.583476 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.583255 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pdmx6"] Jul 01 17:15:49.584185 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.584049 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 17:15:49.584298 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.584267 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 17:15:49.584475 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.584455 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 17:15:49.584609 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.584588 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5zq94\"" Jul 01 17:15:49.585486 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.585466 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9d9c594f-bnrc8"] Jul 01 17:15:49.585589 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.585564 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.588247 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.588226 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 17:15:49.588898 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.588536 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 17:15:49.588898 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.588613 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pcm4c\"" Jul 01 17:15:49.588898 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.588696 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5g4lc"] Jul 01 17:15:49.594860 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.594840 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdmx6"] Jul 01 17:15:49.705589 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.705549 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:15:49.705812 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.705650 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:15:49.705892 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.705845 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:15:49.709313 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.709292 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:15:49.709612 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.709577 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:15:49.709612 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.709599 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:15:49.709761 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.709661 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnmdh\"" Jul 01 17:15:49.709908 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.709891 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:15:49.710062 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.709891 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-875gr\"" Jul 01 17:15:49.715330 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shzjt\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-kube-api-access-shzjt\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715438 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-config-volume\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.715438 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-trusted-ca\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715541 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-certificates\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715541 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpbq5\" (UniqueName: \"kubernetes.io/projected/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-kube-api-access-vpbq5\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.715541 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715492 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-image-registry-private-configuration\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715541 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715515 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.715717 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-installation-pull-secrets\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715717 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z7x2\" (UniqueName: \"kubernetes.io/projected/f0e11878-5c46-44db-be7b-98cf985e634d-kube-api-access-8z7x2\") pod \"ingress-canary-5g4lc\" (UID: \"f0e11878-5c46-44db-be7b-98cf985e634d\") " pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:49.715717 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715905 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-bound-sa-token\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715905 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715792 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e37b99e8-516f-429d-bbe9-d02fbae0a836-ca-trust-extracted\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.715905 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-tmp-dir\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.715905 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.715872 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0e11878-5c46-44db-be7b-98cf985e634d-cert\") pod \"ingress-canary-5g4lc\" (UID: \"f0e11878-5c46-44db-be7b-98cf985e634d\") " pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:49.816255 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpbq5\" (UniqueName: \"kubernetes.io/projected/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-kube-api-access-vpbq5\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.816472 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-image-registry-private-configuration\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.816472 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816307 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.816472 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:49.816407 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:15:49.816472 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:49.816468 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:15:50.316450041 +0000 UTC m=+36.046772228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:15:49.816684 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816611 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-installation-pull-secrets\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.816684 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z7x2\" (UniqueName: \"kubernetes.io/projected/f0e11878-5c46-44db-be7b-98cf985e634d-kube-api-access-8z7x2\") pod \"ingress-canary-5g4lc\" (UID: \"f0e11878-5c46-44db-be7b-98cf985e634d\") " pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:49.816786 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.816830 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-bound-sa-token\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.816880 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816861 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e37b99e8-516f-429d-bbe9-d02fbae0a836-ca-trust-extracted\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.816933 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-tmp-dir\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.816933 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816911 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0e11878-5c46-44db-be7b-98cf985e634d-cert\") pod \"ingress-canary-5g4lc\" (UID: \"f0e11878-5c46-44db-be7b-98cf985e634d\") " pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:49.816933 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:49.816917 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:15:49.817115 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:49.816937 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:15:49.817115 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shzjt\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-kube-api-access-shzjt\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.817115 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.816966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-config-volume\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.817115 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:49.816993 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:50.316973623 +0000 UTC m=+36.047295828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:15:49.817115 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.817099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-trusted-ca\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.817397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.817144 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-certificates\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.817397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.817249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-tmp-dir\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.817397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.817314 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e37b99e8-516f-429d-bbe9-d02fbae0a836-ca-trust-extracted\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.818931 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.818746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-config-volume\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.822103 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.819620 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-certificates\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.822594 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.822356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0e11878-5c46-44db-be7b-98cf985e634d-cert\") pod \"ingress-canary-5g4lc\" (UID: \"f0e11878-5c46-44db-be7b-98cf985e634d\") " pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:49.822942 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.822874 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-trusted-ca\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.823428 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.823399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-installation-pull-secrets\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.824094 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.824011 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-image-registry-private-configuration\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.826359 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.826317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpbq5\" (UniqueName: \"kubernetes.io/projected/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-kube-api-access-vpbq5\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:49.826498 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.826466 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-bound-sa-token\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.826600 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.826571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z7x2\" (UniqueName: \"kubernetes.io/projected/f0e11878-5c46-44db-be7b-98cf985e634d-kube-api-access-8z7x2\") pod \"ingress-canary-5g4lc\" (UID: \"f0e11878-5c46-44db-be7b-98cf985e634d\") " pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:49.826772 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.826731 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shzjt\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-kube-api-access-shzjt\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:49.890715 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:49.890664 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5g4lc" Jul 01 17:15:50.321049 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:50.320996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:50.321255 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:50.321134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:50.321255 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:50.321156 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:15:50.321255 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:50.321180 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:15:50.321255 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:50.321241 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:51.321223825 +0000 UTC m=+37.051546012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:15:50.321255 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:50.321244 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:15:50.321516 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:50.321284 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:15:51.321273224 +0000 UTC m=+37.051595411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:15:50.915594 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:50.915557 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5g4lc"] Jul 01 17:15:51.006597 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:15:51.006526 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e11878_5c46_44db_be7b_98cf985e634d.slice/crio-7e77b9f8be83a5e1ee0f63974225a6e25fb6d1b793dcb5acbe081781fc13e5b4 WatchSource:0}: Error finding container 7e77b9f8be83a5e1ee0f63974225a6e25fb6d1b793dcb5acbe081781fc13e5b4: Status 404 returned error can't find the container with id 7e77b9f8be83a5e1ee0f63974225a6e25fb6d1b793dcb5acbe081781fc13e5b4 Jul 01 17:15:51.329618 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.329586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:51.329618 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.329626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:51.329808 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:51.329732 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:15:51.329808 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:51.329732 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:15:51.329808 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:51.329801 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:15:53.329784462 +0000 UTC m=+39.060106650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:15:51.329898 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:51.329742 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:15:51.329898 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:51.329865 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:53.329854337 +0000 UTC m=+39.060176524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:15:51.576451 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.576394 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:51.663998 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.663960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:51.718332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.718301 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:51.951770 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.951682 2566 generic.go:356] "Generic (PLEG): container finished" podID="65beb9bf-9a21-42b9-8a07-78a2056f2a69" containerID="dceee50a6abb145a61606e3dbb459cc27d73eb2d9f3515a7f30b24258b8599e8" exitCode=0 Jul 01 17:15:51.952309 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.951761 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerDied","Data":"dceee50a6abb145a61606e3dbb459cc27d73eb2d9f3515a7f30b24258b8599e8"} Jul 01 17:15:51.953325 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:51.953302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5g4lc" event={"ID":"f0e11878-5c46-44db-be7b-98cf985e634d","Type":"ContainerStarted","Data":"7e77b9f8be83a5e1ee0f63974225a6e25fb6d1b793dcb5acbe081781fc13e5b4"} Jul 01 17:15:52.401905 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:52.401662 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:52.504740 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:52.504704 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:52.959753 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:52.959719 2566 generic.go:356] "Generic (PLEG): container finished" podID="65beb9bf-9a21-42b9-8a07-78a2056f2a69" containerID="625b8ec4eb39f378f44c4ab04e501b9ee6dbf26a0f72cca44a1fedde9516fa6a" exitCode=0 Jul 01 17:15:52.960211 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:52.959783 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerDied","Data":"625b8ec4eb39f378f44c4ab04e501b9ee6dbf26a0f72cca44a1fedde9516fa6a"} Jul 01 17:15:53.344775 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:53.344747 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:53.344890 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:53.344785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:53.344890 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:53.344883 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:15:53.345066 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:53.344897 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:15:53.345066 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:53.344944 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:15:57.344927343 +0000 UTC m=+43.075249548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:15:53.345066 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:53.344999 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:15:53.345177 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:53.345088 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:15:57.345069986 +0000 UTC m=+43.075392191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:15:53.965982 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:53.965939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8nks" event={"ID":"65beb9bf-9a21-42b9-8a07-78a2056f2a69","Type":"ContainerStarted","Data":"7a447e66ed6a6938aac71edb3d626e767d78524ce734539c07a000120415085a"} Jul 01 17:15:53.967413 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:53.967393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5g4lc" event={"ID":"f0e11878-5c46-44db-be7b-98cf985e634d","Type":"ContainerStarted","Data":"08cfcbb1cb18e9c22150fe5dc721ca425696ecd8f25d19c6d48d28999142a208"} Jul 01 17:15:53.990584 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:53.990528 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g8nks" podStartSLOduration=9.562075507 podStartE2EDuration="39.990512914s" totalImagesPullingTime="30.428437407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:53.990323207 +0000 UTC m=+39.720645411" watchObservedRunningTime="2026-07-01 17:15:53.990512914 +0000 UTC m=+39.720835122" Jul 01 17:15:54.211394 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:54.211353 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:54.312564 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:54.312531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:55.295221 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:55.295191 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:15:57.376053 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:57.376002 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:15:57.376448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:15:57.376072 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:15:57.376448 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:57.376157 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:15:57.376448 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:57.376181 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:15:57.376448 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:57.376192 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:15:57.376448 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:57.376246 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:16:05.376225607 +0000 UTC m=+51.106547808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:15:57.376448 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:15:57.376260 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:05.376254154 +0000 UTC m=+51.106576341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:16:00.719743 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:00.719708 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:00.784930 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:00.784893 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:00.882858 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:00.882825 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:00.939562 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:00.939531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:01.802332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:01.802303 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:01.901798 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:01.901766 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:04.748079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:04.748019 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:05.426229 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:05.426184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:16:05.426413 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:05.426240 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:16:05.426413 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:05.426340 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:05.426413 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:05.426407 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:16:21.426391037 +0000 UTC m=+67.156713228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:16:05.426552 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:05.426343 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:16:05.426552 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:05.426433 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:16:05.426552 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:05.426471 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:21.426461069 +0000 UTC m=+67.156783271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:16:13.509956 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:13.509920 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:13.610381 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:13.610348 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:16.285603 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:16.285570 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bltzn" Jul 01 17:16:16.317607 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:16.317546 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5g4lc" podStartSLOduration=25.00433041 podStartE2EDuration="27.317530779s" totalImagesPullingTime="2.313200369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:15:54.006507851 +0000 UTC m=+39.736830061" watchObservedRunningTime="2026-07-01 17:16:16.317530779 +0000 UTC m=+62.047852966" Jul 01 17:16:16.448324 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:16.448285 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:16.545016 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:16.544940 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:17.870603 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:17.870564 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:17.940521 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:17.940487 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:18.354740 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:18.354708 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:18.416018 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:18.415985 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:18.899431 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:18.899401 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:18.999670 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:18.999645 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:20.531542 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.531504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:16:20.531959 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.531565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:16:20.534785 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.534761 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:16:20.534904 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.534889 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:16:20.542418 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:20.542392 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 17:16:20.542521 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:20.542485 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:24.542461725 +0000 UTC m=+130.272783927 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : secret "metrics-daemon-secret" not found Jul 01 17:16:20.545971 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.545951 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00db3ae7-3f11-4ad8-8e2a-4a484f552b97-original-pull-secret\") pod \"global-pull-secret-syncer-7bxz7\" (UID: \"00db3ae7-3f11-4ad8-8e2a-4a484f552b97\") " pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:16:20.625398 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.625346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bxz7" Jul 01 17:16:20.632597 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.632572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:16:20.636190 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.636163 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:16:20.646997 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.646969 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:16:20.657235 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.657198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zq4k\" (UniqueName: \"kubernetes.io/projected/1781a910-62f2-436b-8b03-637048b12be6-kube-api-access-6zq4k\") pod \"network-check-target-tnj7f\" (UID: \"1781a910-62f2-436b-8b03-637048b12be6\") " pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:16:20.752490 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.752361 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7bxz7"] Jul 01 17:16:20.754951 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:16:20.754926 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00db3ae7_3f11_4ad8_8e2a_4a484f552b97.slice/crio-4de94a043ed8ac1ebd691467d712c7eda864f20ae972a34e7dc24c1b39c2006c WatchSource:0}: Error finding container 4de94a043ed8ac1ebd691467d712c7eda864f20ae972a34e7dc24c1b39c2006c: Status 404 returned error can't find the container with id 4de94a043ed8ac1ebd691467d712c7eda864f20ae972a34e7dc24c1b39c2006c Jul 01 17:16:20.933300 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.933269 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-875gr\"" Jul 01 17:16:20.940891 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:20.940866 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:16:21.033621 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:21.033585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7bxz7" event={"ID":"00db3ae7-3f11-4ad8-8e2a-4a484f552b97","Type":"ContainerStarted","Data":"4de94a043ed8ac1ebd691467d712c7eda864f20ae972a34e7dc24c1b39c2006c"} Jul 01 17:16:21.060832 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:21.060809 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tnj7f"] Jul 01 17:16:21.063239 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:16:21.063215 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1781a910_62f2_436b_8b03_637048b12be6.slice/crio-aefa669054e9eb6d708cdaadf030a0847045953c743d1f0d89acf34b38ac087a WatchSource:0}: Error finding container aefa669054e9eb6d708cdaadf030a0847045953c743d1f0d89acf34b38ac087a: Status 404 returned error can't find the container with id aefa669054e9eb6d708cdaadf030a0847045953c743d1f0d89acf34b38ac087a Jul 01 17:16:21.439259 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:21.439219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:16:21.439259 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:21.439265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:16:21.439473 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:21.439372 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:21.439473 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:21.439374 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:16:21.439473 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:21.439430 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:16:21.439473 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:21.439435 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:16:53.439418526 +0000 UTC m=+99.169740713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:16:21.439473 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:21.439475 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:53.439458169 +0000 UTC m=+99.169780376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:16:22.038557 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:22.038512 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tnj7f" event={"ID":"1781a910-62f2-436b-8b03-637048b12be6","Type":"ContainerStarted","Data":"aefa669054e9eb6d708cdaadf030a0847045953c743d1f0d89acf34b38ac087a"} Jul 01 17:16:26.050183 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:26.050145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7bxz7" event={"ID":"00db3ae7-3f11-4ad8-8e2a-4a484f552b97","Type":"ContainerStarted","Data":"9121433cb9560f331b60479704e0872e5641e4ad6f6c66e944337ee74681e867"} Jul 01 17:16:26.051527 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:26.051503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tnj7f" event={"ID":"1781a910-62f2-436b-8b03-637048b12be6","Type":"ContainerStarted","Data":"2a09815b623033822c68049721b49dc61d79de1d10f6db3be54ea7b7e5a14de4"} Jul 01 17:16:26.051657 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:26.051558 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:16:26.073323 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:26.073268 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7bxz7" podStartSLOduration=66.052082845 podStartE2EDuration="1m11.073251574s" totalImagesPullingTime="5.021168729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:26.07177648 +0000 UTC m=+71.802098687" watchObservedRunningTime="2026-07-01 17:16:26.073251574 +0000 UTC m=+71.803573784" Jul 01 17:16:26.088720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:26.088675 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tnj7f" podStartSLOduration=67.37916776 podStartE2EDuration="1m12.088660078s" totalImagesPullingTime="4.709492318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:26.087791483 +0000 UTC m=+71.818113688" watchObservedRunningTime="2026-07-01 17:16:26.088660078 +0000 UTC m=+71.818982304" Jul 01 17:16:39.824454 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:39.824338 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:39.894559 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:39.894530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:39.962389 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:39.962353 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:16:53.462470 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:53.462420 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:16:53.462885 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:53.462484 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:16:53.462885 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:53.462575 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:16:53.462885 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:53.462592 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:16:53.462885 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:53.462636 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:57.462622843 +0000 UTC m=+163.192945031 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:16:53.462885 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:53.462574 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:53.462885 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:16:53.462723 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:17:57.462708654 +0000 UTC m=+163.193030843 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:16:57.056576 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:16:57.056544 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tnj7f" Jul 01 17:17:13.285333 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:17:13.285293 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:17:24.592014 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:17:24.591973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:17:24.592490 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:24.592136 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 17:17:24.592490 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:24.592213 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:26.592196401 +0000 UTC m=+252.322518589 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : secret "metrics-daemon-secret" not found Jul 01 17:17:52.581180 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:52.581130 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" Jul 01 17:17:52.599373 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:52.599339 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pdmx6" podUID="a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e" Jul 01 17:17:52.717172 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:52.717132 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:17:53.256714 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:17:53.256677 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:17:53.256924 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:17:53.256677 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdmx6" Jul 01 17:17:57.520319 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:17:57.520279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:17:57.520711 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:17:57.520324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:17:57.520711 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:57.520430 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:17:57.520711 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:57.520441 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d9c594f-bnrc8: secret "image-registry-tls" not found Jul 01 17:17:57.520711 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:57.520486 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls podName:e37b99e8-516f-429d-bbe9-d02fbae0a836 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:59.520472359 +0000 UTC m=+285.250794547 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls") pod "image-registry-7c9d9c594f-bnrc8" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836") : secret "image-registry-tls" not found Jul 01 17:17:57.520711 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:57.520429 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:17:57.520711 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:17:57.520569 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls podName:a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e nodeName:}" failed. No retries permitted until 2026-07-01 17:19:59.520552869 +0000 UTC m=+285.250875056 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls") pod "dns-default-pdmx6" (UID: "a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e") : secret "dns-default-metrics-tls" not found Jul 01 17:18:04.706769 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:18:04.706727 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:18:13.355402 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:18:13.355322 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:26.634749 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:26.634691 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:19:26.635299 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:26.634840 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 17:19:26.635299 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:26.634905 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs podName:111da01d-53a9-42e6-abe2-34fbffd31333 nodeName:}" failed. No retries permitted until 2026-07-01 17:21:28.634888829 +0000 UTC m=+374.365211016 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs") pod "network-metrics-daemon-sjvp6" (UID: "111da01d-53a9-42e6-abe2-34fbffd31333") : secret "metrics-daemon-secret" not found Jul 01 17:19:38.064803 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.064719 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps"] Jul 01 17:19:38.066567 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.066551 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx"] Jul 01 17:19:38.066690 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.066673 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.068210 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.068188 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss"] Jul 01 17:19:38.068343 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.068311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:38.070151 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.070134 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-zxml7"] Jul 01 17:19:38.070271 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.070256 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.071079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.071060 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:19:38.071174 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.071112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 17:19:38.071966 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.071949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.072414 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.072395 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 17:19:38.072660 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.072645 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 17:19:38.073697 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.073677 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 17:19:38.073776 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.073732 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:19:38.075332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.075307 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 17:19:38.075332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.075322 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 17:19:38.075332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.075330 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-27grt\"" Jul 01 17:19:38.075332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.075337 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 17:19:38.075544 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.075330 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-r8x4s\"" Jul 01 17:19:38.075544 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.075375 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 17:19:38.076566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.076551 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 17:19:38.076668 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.076620 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 17:19:38.076668 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.076638 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rrtqb\"" Jul 01 17:19:38.076668 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.076641 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 17:19:38.077043 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.077016 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 17:19:38.077107 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.077018 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 17:19:38.077107 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.077019 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p9p7m\"" Jul 01 17:19:38.080948 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.080926 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 17:19:38.087292 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.087274 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-zxml7"] Jul 01 17:19:38.090380 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.090360 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps"] Jul 01 17:19:38.091498 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.091259 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss"] Jul 01 17:19:38.092189 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.092172 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx"] Jul 01 17:19:38.217705 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfd4caac-b92f-464b-a545-34be46e076d5-config\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.217865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.217865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c01bd920-04dd-4dca-84b5-e6c8880e3091-tmp\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.217865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c01bd920-04dd-4dca-84b5-e6c8880e3091-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.217865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/176efdf6-5997-42d2-b992-82ac3d3ca59e-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.217865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:38.217865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75sx4\" (UniqueName: \"kubernetes.io/projected/bfd4caac-b92f-464b-a545-34be46e076d5-kube-api-access-75sx4\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.218076 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217871 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfd4caac-b92f-464b-a545-34be46e076d5-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.218076 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clmfp\" (UniqueName: \"kubernetes.io/projected/176efdf6-5997-42d2-b992-82ac3d3ca59e-kube-api-access-clmfp\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.218076 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.217951 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlhfk\" (UniqueName: \"kubernetes.io/projected/c01bd920-04dd-4dca-84b5-e6c8880e3091-kube-api-access-dlhfk\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.218076 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.218015 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c01bd920-04dd-4dca-84b5-e6c8880e3091-service-ca-bundle\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.218076 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.218074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c01bd920-04dd-4dca-84b5-e6c8880e3091-serving-cert\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.218232 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.218104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c01bd920-04dd-4dca-84b5-e6c8880e3091-snapshots\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.218232 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.218125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpbt5\" (UniqueName: \"kubernetes.io/projected/6918627f-867c-45b0-8e5d-051559046a85-kube-api-access-zpbt5\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:38.296196 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.296154 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:38.319313 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c01bd920-04dd-4dca-84b5-e6c8880e3091-snapshots\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.319313 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpbt5\" (UniqueName: \"kubernetes.io/projected/6918627f-867c-45b0-8e5d-051559046a85-kube-api-access-zpbt5\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:38.319313 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfd4caac-b92f-464b-a545-34be46e076d5-config\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.319519 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.319519 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c01bd920-04dd-4dca-84b5-e6c8880e3091-tmp\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.319519 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319356 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c01bd920-04dd-4dca-84b5-e6c8880e3091-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.319519 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.319456 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:38.319519 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/176efdf6-5997-42d2-b992-82ac3d3ca59e-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.319519 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.319529 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls podName:176efdf6-5997-42d2-b992-82ac3d3ca59e nodeName:}" failed. No retries permitted until 2026-07-01 17:19:38.819508557 +0000 UTC m=+264.549830760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4cgss" (UID: "176efdf6-5997-42d2-b992-82ac3d3ca59e") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319568 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sx4\" (UniqueName: \"kubernetes.io/projected/bfd4caac-b92f-464b-a545-34be46e076d5-kube-api-access-75sx4\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.319582 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319598 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfd4caac-b92f-464b-a545-34be46e076d5-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.319635 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls podName:6918627f-867c-45b0-8e5d-051559046a85 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:38.81961954 +0000 UTC m=+264.549941732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-nmsxx" (UID: "6918627f-867c-45b0-8e5d-051559046a85") : secret "samples-operator-tls" not found Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319663 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clmfp\" (UniqueName: \"kubernetes.io/projected/176efdf6-5997-42d2-b992-82ac3d3ca59e-kube-api-access-clmfp\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlhfk\" (UniqueName: \"kubernetes.io/projected/c01bd920-04dd-4dca-84b5-e6c8880e3091-kube-api-access-dlhfk\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.319791 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c01bd920-04dd-4dca-84b5-e6c8880e3091-service-ca-bundle\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.320242 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c01bd920-04dd-4dca-84b5-e6c8880e3091-serving-cert\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.320242 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c01bd920-04dd-4dca-84b5-e6c8880e3091-tmp\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.320242 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.319952 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfd4caac-b92f-464b-a545-34be46e076d5-config\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.320242 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.320070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c01bd920-04dd-4dca-84b5-e6c8880e3091-snapshots\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.320393 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.320313 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/176efdf6-5997-42d2-b992-82ac3d3ca59e-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.320607 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.320580 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c01bd920-04dd-4dca-84b5-e6c8880e3091-service-ca-bundle\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.320607 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.320603 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c01bd920-04dd-4dca-84b5-e6c8880e3091-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.321900 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.321882 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfd4caac-b92f-464b-a545-34be46e076d5-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.322012 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.321997 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c01bd920-04dd-4dca-84b5-e6c8880e3091-serving-cert\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.332097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.332070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75sx4\" (UniqueName: \"kubernetes.io/projected/bfd4caac-b92f-464b-a545-34be46e076d5-kube-api-access-75sx4\") pod \"service-ca-operator-5d7b7dc95c-hncps\" (UID: \"bfd4caac-b92f-464b-a545-34be46e076d5\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.332219 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.332198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpbt5\" (UniqueName: \"kubernetes.io/projected/6918627f-867c-45b0-8e5d-051559046a85-kube-api-access-zpbt5\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:38.332436 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.332422 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clmfp\" (UniqueName: \"kubernetes.io/projected/176efdf6-5997-42d2-b992-82ac3d3ca59e-kube-api-access-clmfp\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.332836 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.332817 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlhfk\" (UniqueName: \"kubernetes.io/projected/c01bd920-04dd-4dca-84b5-e6c8880e3091-kube-api-access-dlhfk\") pod \"insights-operator-5f67b55555-zxml7\" (UID: \"c01bd920-04dd-4dca-84b5-e6c8880e3091\") " pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.376783 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.376757 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" Jul 01 17:19:38.393724 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.393691 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:38.396142 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.396121 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-zxml7" Jul 01 17:19:38.500634 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.500604 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps"] Jul 01 17:19:38.503551 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:19:38.503519 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd4caac_b92f_464b_a545_34be46e076d5.slice/crio-0d3314ef240b06dad86168eb45a52ec474310b1eceaf3cc4a843f66191fa2800 WatchSource:0}: Error finding container 0d3314ef240b06dad86168eb45a52ec474310b1eceaf3cc4a843f66191fa2800: Status 404 returned error can't find the container with id 0d3314ef240b06dad86168eb45a52ec474310b1eceaf3cc4a843f66191fa2800 Jul 01 17:19:38.523171 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.523140 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-zxml7"] Jul 01 17:19:38.526098 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:19:38.526064 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01bd920_04dd_4dca_84b5_e6c8880e3091.slice/crio-2f06e817d71630e830315dbd769a7af3d7e858aabf314ac803e1e621c5feb152 WatchSource:0}: Error finding container 2f06e817d71630e830315dbd769a7af3d7e858aabf314ac803e1e621c5feb152: Status 404 returned error can't find the container with id 2f06e817d71630e830315dbd769a7af3d7e858aabf314ac803e1e621c5feb152 Jul 01 17:19:38.824691 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.824646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:38.824691 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:38.824702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:38.824939 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.824823 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:38.824939 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.824902 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls podName:176efdf6-5997-42d2-b992-82ac3d3ca59e nodeName:}" failed. No retries permitted until 2026-07-01 17:19:39.824882554 +0000 UTC m=+265.555204762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4cgss" (UID: "176efdf6-5997-42d2-b992-82ac3d3ca59e") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:38.824939 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.824831 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:19:38.825123 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:38.824960 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls podName:6918627f-867c-45b0-8e5d-051559046a85 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:39.824948644 +0000 UTC m=+265.555270832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-nmsxx" (UID: "6918627f-867c-45b0-8e5d-051559046a85") : secret "samples-operator-tls" not found Jul 01 17:19:39.506566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:39.506526 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" event={"ID":"bfd4caac-b92f-464b-a545-34be46e076d5","Type":"ContainerStarted","Data":"0d3314ef240b06dad86168eb45a52ec474310b1eceaf3cc4a843f66191fa2800"} Jul 01 17:19:39.507790 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:39.507749 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-zxml7" event={"ID":"c01bd920-04dd-4dca-84b5-e6c8880e3091","Type":"ContainerStarted","Data":"2f06e817d71630e830315dbd769a7af3d7e858aabf314ac803e1e621c5feb152"} Jul 01 17:19:39.832365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:39.832338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:39.832526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:39.832375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:39.832526 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:39.832479 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:19:39.832526 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:39.832480 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:39.832645 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:39.832534 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls podName:176efdf6-5997-42d2-b992-82ac3d3ca59e nodeName:}" failed. No retries permitted until 2026-07-01 17:19:41.832518239 +0000 UTC m=+267.562840426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4cgss" (UID: "176efdf6-5997-42d2-b992-82ac3d3ca59e") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:39.832645 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:39.832548 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls podName:6918627f-867c-45b0-8e5d-051559046a85 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:41.83254153 +0000 UTC m=+267.562863717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-nmsxx" (UID: "6918627f-867c-45b0-8e5d-051559046a85") : secret "samples-operator-tls" not found Jul 01 17:19:40.323782 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:40.323747 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:40.385893 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:40.385856 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:41.515954 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:41.515847 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" event={"ID":"bfd4caac-b92f-464b-a545-34be46e076d5","Type":"ContainerStarted","Data":"74cd582f195ef463f8ac48393c8897689815474fec3459b58d68d23ddec93b33"} Jul 01 17:19:41.517368 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:41.517336 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-zxml7" event={"ID":"c01bd920-04dd-4dca-84b5-e6c8880e3091","Type":"ContainerStarted","Data":"06a370a3f2524c67369986b299acb3a66f21b732c474d6b230b5cf1b817b2cd6"} Jul 01 17:19:41.537856 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:41.537805 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" podStartSLOduration=0.878887856 podStartE2EDuration="3.53778599s" totalImagesPullingTime="2.658898134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:19:41.536016193 +0000 UTC m=+267.266338412" watchObservedRunningTime="2026-07-01 17:19:41.53778599 +0000 UTC m=+267.268108200" Jul 01 17:19:41.569943 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:41.569890 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-zxml7" podStartSLOduration=0.933123685 podStartE2EDuration="3.569869962s" totalImagesPullingTime="2.636746277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:19:41.569682762 +0000 UTC m=+267.300004982" watchObservedRunningTime="2026-07-01 17:19:41.569869962 +0000 UTC m=+267.300192171" Jul 01 17:19:41.850349 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:41.850310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:41.850349 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:41.850351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:41.850580 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:41.850452 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:19:41.850580 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:41.850458 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:41.850580 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:41.850526 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls podName:6918627f-867c-45b0-8e5d-051559046a85 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:45.850498832 +0000 UTC m=+271.580821019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-nmsxx" (UID: "6918627f-867c-45b0-8e5d-051559046a85") : secret "samples-operator-tls" not found Jul 01 17:19:41.850580 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:41.850539 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls podName:176efdf6-5997-42d2-b992-82ac3d3ca59e nodeName:}" failed. No retries permitted until 2026-07-01 17:19:45.850533867 +0000 UTC m=+271.580856054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4cgss" (UID: "176efdf6-5997-42d2-b992-82ac3d3ca59e") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:41.996786 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:41.996738 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:42.093282 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.093220 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:42.165466 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.165376 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9ljck"] Jul 01 17:19:42.168743 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.168716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.168892 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.168716 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:42.171829 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.171677 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 17:19:42.171829 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.171760 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b7kxs\"" Jul 01 17:19:42.171829 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.171677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 17:19:42.185158 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.185130 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ljck"] Jul 01 17:19:42.236706 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.236673 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:42.354407 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.354369 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.354407 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.354405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmwrn\" (UniqueName: \"kubernetes.io/projected/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-api-access-rmwrn\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.354612 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.354506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-data-volume\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.354612 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.354578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-crio-socket\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.354612 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.354601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.455792 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.455708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-crio-socket\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.455792 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.455748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.455792 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.455778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.456087 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.455797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmwrn\" (UniqueName: \"kubernetes.io/projected/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-api-access-rmwrn\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.456087 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.455847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-data-volume\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.456087 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.455850 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:19:42.456087 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.455887 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:19:42.456087 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.455921 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:42.955902115 +0000 UTC m=+268.686224307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : configmap "kube-rbac-proxy" not found Jul 01 17:19:42.456087 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.455923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-crio-socket\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.456087 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.455958 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:42.955942031 +0000 UTC m=+268.686264225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : secret "insights-runtime-extractor-tls" not found Jul 01 17:19:42.456302 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.456178 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-data-volume\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.464869 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.464848 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmwrn\" (UniqueName: \"kubernetes.io/projected/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-api-access-rmwrn\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.791823 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.791742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:42.899666 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.899623 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:42.961766 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.961729 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.961927 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.961824 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:42.961927 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.961839 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:19:42.961927 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.961894 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:19:42.961927 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.961904 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:43.961884758 +0000 UTC m=+269.692206969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : secret "insights-runtime-extractor-tls" not found Jul 01 17:19:42.962094 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:42.961944 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:43.961932825 +0000 UTC m=+269.692255012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : configmap "kube-rbac-proxy" not found Jul 01 17:19:42.988256 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.988227 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv"] Jul 01 17:19:42.990161 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.990146 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" Jul 01 17:19:42.995553 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.995532 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 17:19:42.996471 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.996139 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 17:19:42.996471 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:42.996205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j8kwd\"" Jul 01 17:19:43.036686 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.036657 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv"] Jul 01 17:19:43.040287 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.040256 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:43.139703 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.139666 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:43.163863 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.163833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vxcl\" (UniqueName: \"kubernetes.io/projected/dd6867e4-c818-4c6f-a88d-faf57990cc23-kube-api-access-5vxcl\") pod \"migrator-786f9fbc5-bsvrv\" (UID: \"dd6867e4-c818-4c6f-a88d-faf57990cc23\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" Jul 01 17:19:43.241696 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.241659 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:43.264321 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.264293 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vxcl\" (UniqueName: \"kubernetes.io/projected/dd6867e4-c818-4c6f-a88d-faf57990cc23-kube-api-access-5vxcl\") pod \"migrator-786f9fbc5-bsvrv\" (UID: \"dd6867e4-c818-4c6f-a88d-faf57990cc23\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" Jul 01 17:19:43.272575 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.272555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vxcl\" (UniqueName: \"kubernetes.io/projected/dd6867e4-c818-4c6f-a88d-faf57990cc23-kube-api-access-5vxcl\") pod \"migrator-786f9fbc5-bsvrv\" (UID: \"dd6867e4-c818-4c6f-a88d-faf57990cc23\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" Jul 01 17:19:43.298380 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.298353 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" Jul 01 17:19:43.417951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.417928 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv"] Jul 01 17:19:43.420234 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:19:43.420204 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6867e4_c818_4c6f_a88d_faf57990cc23.slice/crio-3336f00a3389176850b88320a662ae5a08cd514d439d5d6fdce981d056dec164 WatchSource:0}: Error finding container 3336f00a3389176850b88320a662ae5a08cd514d439d5d6fdce981d056dec164: Status 404 returned error can't find the container with id 3336f00a3389176850b88320a662ae5a08cd514d439d5d6fdce981d056dec164 Jul 01 17:19:43.495958 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.495928 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:43.524618 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.524584 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" event={"ID":"dd6867e4-c818-4c6f-a88d-faf57990cc23","Type":"ContainerStarted","Data":"3336f00a3389176850b88320a662ae5a08cd514d439d5d6fdce981d056dec164"} Jul 01 17:19:43.595961 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.595929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:43.966781 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.966751 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2777j_e3ca5874-cebc-4b61-af4e-1e60f7537a45/dns-node-resolver/0.log" Jul 01 17:19:43.970042 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.970011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:43.970151 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:43.970065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:43.970151 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:43.970139 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:19:43.970237 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:43.970181 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:19:43.970237 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:43.970205 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:45.970186651 +0000 UTC m=+271.700508840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : configmap "kube-rbac-proxy" not found Jul 01 17:19:43.970237 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:43.970225 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:45.970212495 +0000 UTC m=+271.700534706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : secret "insights-runtime-extractor-tls" not found Jul 01 17:19:44.964018 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:44.963991 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bh6mg_135aec59-03b2-4348-9134-5fd5c62cc137/node-ca/0.log" Jul 01 17:19:45.132640 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.132608 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:45.193368 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.193338 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:45.532127 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.532019 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" event={"ID":"dd6867e4-c818-4c6f-a88d-faf57990cc23","Type":"ContainerStarted","Data":"d54692fe7b2163a3a71be04be957b320c1157adc6661939b02a337332e9c1ce6"} Jul 01 17:19:45.532127 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.532094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" event={"ID":"dd6867e4-c818-4c6f-a88d-faf57990cc23","Type":"ContainerStarted","Data":"fe6cc156e4b81215ab6c5369ecd5ee7efc1aaff68b62392825d795812038e494"} Jul 01 17:19:45.549625 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.549582 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-bsvrv" podStartSLOduration=1.7604683300000001 podStartE2EDuration="3.54956623s" totalImagesPullingTime="1.7890979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:19:45.548290412 +0000 UTC m=+271.278612622" watchObservedRunningTime="2026-07-01 17:19:45.54956623 +0000 UTC m=+271.279888439" Jul 01 17:19:45.644833 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.644802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:45.771671 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.771639 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5g4lc_f0e11878-5c46-44db-be7b-98cf985e634d/serve-healthcheck-canary/0.log" Jul 01 17:19:45.791046 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.790970 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:45.886438 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.886404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:45.886616 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.886448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:45.886616 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.886558 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:45.886616 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.886570 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 17:19:45.886724 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.886624 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls podName:176efdf6-5997-42d2-b992-82ac3d3ca59e nodeName:}" failed. No retries permitted until 2026-07-01 17:19:53.886604287 +0000 UTC m=+279.616926488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4cgss" (UID: "176efdf6-5997-42d2-b992-82ac3d3ca59e") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:45.886724 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.886644 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls podName:6918627f-867c-45b0-8e5d-051559046a85 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:53.88663561 +0000 UTC m=+279.616957801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-nmsxx" (UID: "6918627f-867c-45b0-8e5d-051559046a85") : secret "samples-operator-tls" not found Jul 01 17:19:45.987530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.987490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:45.987702 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:45.987552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:45.987702 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.987622 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:19:45.987702 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.987681 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:19:45.987805 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.987704 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:49.987684257 +0000 UTC m=+275.718006463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : configmap "kube-rbac-proxy" not found Jul 01 17:19:45.987805 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:45.987720 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:49.987712476 +0000 UTC m=+275.718034663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : secret "insights-runtime-extractor-tls" not found Jul 01 17:19:46.046754 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:46.046661 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:48.960442 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:48.960407 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:49.059879 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:49.059823 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:49.160986 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:49.160949 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:49.261427 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:49.261351 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:49.362496 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:49.362463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:49.462782 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:49.462752 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:50.021082 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:50.021025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:50.021476 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:50.021117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:50.021476 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:50.021148 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:19:50.021476 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:50.021222 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:58.02120136 +0000 UTC m=+283.751523553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : configmap "kube-rbac-proxy" not found Jul 01 17:19:50.021476 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:50.021241 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:19:50.021476 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:50.021276 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:19:58.021266092 +0000 UTC m=+283.751588280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : secret "insights-runtime-extractor-tls" not found Jul 01 17:19:50.926218 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:50.926190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:51.044556 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:51.044530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:51.644140 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:51.644107 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:51.848939 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:51.848906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:52.135243 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:52.135208 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:52.467430 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:52.467362 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:52.637165 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:52.637135 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:52.835024 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:52.834995 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:53.040525 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.040469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:53.243608 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.243524 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:53.838470 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.838433 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:53.894832 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.894804 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:53.950851 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.950820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:19:53.951023 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.950857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:53.951023 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:53.950976 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:53.951170 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:53.951070 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls podName:176efdf6-5997-42d2-b992-82ac3d3ca59e nodeName:}" failed. No retries permitted until 2026-07-01 17:20:09.951049666 +0000 UTC m=+295.681371869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-4cgss" (UID: "176efdf6-5997-42d2-b992-82ac3d3ca59e") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:19:53.953231 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.953213 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6918627f-867c-45b0-8e5d-051559046a85-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nmsxx\" (UID: \"6918627f-867c-45b0-8e5d-051559046a85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:53.984858 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:53.984829 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" Jul 01 17:19:54.041591 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:54.041562 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:54.105718 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:54.105694 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx"] Jul 01 17:19:54.443303 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:54.443218 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:54.560942 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:54.560911 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" event={"ID":"6918627f-867c-45b0-8e5d-051559046a85","Type":"ContainerStarted","Data":"ae87d4dba44c494d3f1ec1b04920c5519db590d9530962cdfa615ce8670a6178"} Jul 01 17:19:54.640614 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:54.640585 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:55.180837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:55.180778 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:55.281281 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:55.281238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:55.463634 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:55.463538 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:55.837325 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:55.837302 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:56.068703 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.068676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:56.257636 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:56.257598 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" Jul 01 17:19:56.257636 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:56.257603 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pdmx6" podUID="a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e" Jul 01 17:19:56.454303 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.454214 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:56.568356 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.568327 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdmx6" Jul 01 17:19:56.568752 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.568363 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" event={"ID":"6918627f-867c-45b0-8e5d-051559046a85","Type":"ContainerStarted","Data":"3d80e102ab0e6693a47607dba99b287b27285d70b79887f33c9375ab1b35a097"} Jul 01 17:19:56.568752 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.568513 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:19:56.568752 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.568529 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" event={"ID":"6918627f-867c-45b0-8e5d-051559046a85","Type":"ContainerStarted","Data":"5c4b5269f083380a080d8bec625bfd1288d456274ebe9d076b22ef75b3d4a864"} Jul 01 17:19:56.586720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.586672 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nmsxx" podStartSLOduration=16.960487718 podStartE2EDuration="18.586657369s" totalImagesPullingTime="1.626169651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:19:56.585953117 +0000 UTC m=+282.316275325" watchObservedRunningTime="2026-07-01 17:19:56.586657369 +0000 UTC m=+282.316979578" Jul 01 17:19:56.637653 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:56.637621 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:57.244163 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:57.244121 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:57.636317 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:57.636283 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:57.791523 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:57.791482 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:57.892209 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:57.892126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:58.084440 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:58.084404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:58.084604 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:58.084454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:58.084604 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:58.084561 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:19:58.084681 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:19:58.084616 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls podName:df8c7f6e-b2e4-46b6-beba-c9facdbc8e90 nodeName:}" failed. No retries permitted until 2026-07-01 17:20:14.084600932 +0000 UTC m=+299.814923120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ljck" (UID: "df8c7f6e-b2e4-46b6-beba-c9facdbc8e90") : secret "insights-runtime-extractor-tls" not found Jul 01 17:19:58.084920 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:58.084900 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:19:58.088863 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:58.088842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:59.041590 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.041556 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:59.302550 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.302524 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:59.437156 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.437129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:59.597886 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.597804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:19:59.598051 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.597902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:19:59.600173 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.600139 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e-metrics-tls\") pod \"dns-default-pdmx6\" (UID: \"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e\") " pod="openshift-dns/dns-default-pdmx6" Jul 01 17:19:59.600301 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.600276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"image-registry-7c9d9c594f-bnrc8\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:19:59.635523 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.635497 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:59.873135 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.873049 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pcm4c\"" Jul 01 17:19:59.873135 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.873049 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jkmfz\"" Jul 01 17:19:59.879989 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.879967 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:19:59.880129 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:19:59.880072 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdmx6" Jul 01 17:20:00.010671 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:00.010651 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9d9c594f-bnrc8"] Jul 01 17:20:00.013226 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:00.013201 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37b99e8_516f_429d_bbe9_d02fbae0a836.slice/crio-e934d80fcca2e8a1b40d5cfe46e95f3cef34a857420a1f84e8d1fa36f4707be6 WatchSource:0}: Error finding container e934d80fcca2e8a1b40d5cfe46e95f3cef34a857420a1f84e8d1fa36f4707be6: Status 404 returned error can't find the container with id e934d80fcca2e8a1b40d5cfe46e95f3cef34a857420a1f84e8d1fa36f4707be6 Jul 01 17:20:00.024931 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:00.024909 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdmx6"] Jul 01 17:20:00.027765 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:00.027733 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a1bef4_8963_4ae7_94cc_d15fd4d7bc4e.slice/crio-91825b34749c5e5acce7f7bcf6713ed95598d3e2ced40f850c087530c5c998b8 WatchSource:0}: Error finding container 91825b34749c5e5acce7f7bcf6713ed95598d3e2ced40f850c087530c5c998b8: Status 404 returned error can't find the container with id 91825b34749c5e5acce7f7bcf6713ed95598d3e2ced40f850c087530c5c998b8 Jul 01 17:20:00.582727 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:00.582692 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" event={"ID":"e37b99e8-516f-429d-bbe9-d02fbae0a836","Type":"ContainerStarted","Data":"870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46"} Jul 01 17:20:00.583247 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:00.582749 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" event={"ID":"e37b99e8-516f-429d-bbe9-d02fbae0a836","Type":"ContainerStarted","Data":"e934d80fcca2e8a1b40d5cfe46e95f3cef34a857420a1f84e8d1fa36f4707be6"} Jul 01 17:20:00.583247 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:00.582814 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:20:00.584006 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:00.583974 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdmx6" event={"ID":"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e","Type":"ContainerStarted","Data":"91825b34749c5e5acce7f7bcf6713ed95598d3e2ced40f850c087530c5c998b8"} Jul 01 17:20:00.604145 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:00.604096 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" podStartSLOduration=264.604075936 podStartE2EDuration="4m24.604075936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:00.602766134 +0000 UTC m=+286.333088373" watchObservedRunningTime="2026-07-01 17:20:00.604075936 +0000 UTC m=+286.334398167" Jul 01 17:20:02.591619 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:02.591580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdmx6" event={"ID":"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e","Type":"ContainerStarted","Data":"adcf13708a4ab8cf0a3ecf0c84206356c213acab24cd5670499f7341221c0ab3"} Jul 01 17:20:02.592073 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:02.591636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdmx6" event={"ID":"a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e","Type":"ContainerStarted","Data":"d7fb0b850b8cde91e739e6f6defca013aeb420516d9bf8b8df3d10f86453c0c4"} Jul 01 17:20:02.592073 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:02.591699 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pdmx6" Jul 01 17:20:02.645716 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:02.645670 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pdmx6" podStartSLOduration=252.07383551 podStartE2EDuration="4m13.645656427s" totalImagesPullingTime="1.571820917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:02.644094852 +0000 UTC m=+288.374417061" watchObservedRunningTime="2026-07-01 17:20:02.645656427 +0000 UTC m=+288.375978636" Jul 01 17:20:06.520942 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:06.520908 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:06.582486 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:06.582445 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:06.856046 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:06.855996 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c9d9c594f-bnrc8"] Jul 01 17:20:07.002924 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:07.002891 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:07.101644 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:07.101598 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:07.707719 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:07.707678 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sjvp6" podUID="111da01d-53a9-42e6-abe2-34fbffd31333" Jul 01 17:20:09.979097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:09.979060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:20:09.981375 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:09.981347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/176efdf6-5997-42d2-b992-82ac3d3ca59e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-4cgss\" (UID: \"176efdf6-5997-42d2-b992-82ac3d3ca59e\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:20:10.189202 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:10.189161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" Jul 01 17:20:10.308429 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:10.308397 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss"] Jul 01 17:20:10.310967 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:10.310939 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176efdf6_5997_42d2_b992_82ac3d3ca59e.slice/crio-1670f517d4ac081174943095e9c11d1495f5f491f27ff3a616767f84ce15a205 WatchSource:0}: Error finding container 1670f517d4ac081174943095e9c11d1495f5f491f27ff3a616767f84ce15a205: Status 404 returned error can't find the container with id 1670f517d4ac081174943095e9c11d1495f5f491f27ff3a616767f84ce15a205 Jul 01 17:20:10.618335 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:10.618302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" event={"ID":"176efdf6-5997-42d2-b992-82ac3d3ca59e","Type":"ContainerStarted","Data":"1670f517d4ac081174943095e9c11d1495f5f491f27ff3a616767f84ce15a205"} Jul 01 17:20:12.496360 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.496257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:12.597936 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.597901 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pdmx6" Jul 01 17:20:12.598165 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.598022 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:12.627282 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.627239 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" event={"ID":"176efdf6-5997-42d2-b992-82ac3d3ca59e","Type":"ContainerStarted","Data":"22fc33bf6433bf49c6e3dec7cdba1ca25da0e6806dd7a8d50a2228e7e2a2610f"} Jul 01 17:20:12.644352 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.644291 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-4cgss" podStartSLOduration=32.778145589 podStartE2EDuration="34.644271057s" totalImagesPullingTime="1.866125468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:12.643114579 +0000 UTC m=+298.373436788" watchObservedRunningTime="2026-07-01 17:20:12.644271057 +0000 UTC m=+298.374593267" Jul 01 17:20:12.666090 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.666061 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl"] Jul 01 17:20:12.669319 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.669301 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:12.672286 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.672259 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xhj74\"" Jul 01 17:20:12.672420 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.672299 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 17:20:12.677096 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.677077 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl"] Jul 01 17:20:12.798172 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.798138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/866ffd74-cec9-4ace-9e81-4b16286665d9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-4fxhl\" (UID: \"866ffd74-cec9-4ace-9e81-4b16286665d9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:12.899329 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:12.899286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/866ffd74-cec9-4ace-9e81-4b16286665d9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-4fxhl\" (UID: \"866ffd74-cec9-4ace-9e81-4b16286665d9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:12.899517 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:12.899421 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 01 17:20:12.899517 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:12.899491 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866ffd74-cec9-4ace-9e81-4b16286665d9-tls-certificates podName:866ffd74-cec9-4ace-9e81-4b16286665d9 nodeName:}" failed. No retries permitted until 2026-07-01 17:20:13.399472494 +0000 UTC m=+299.129794684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/866ffd74-cec9-4ace-9e81-4b16286665d9-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" (UID: "866ffd74-cec9-4ace-9e81-4b16286665d9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 01 17:20:13.102718 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:13.102635 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:13.203488 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:13.203457 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:13.403672 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:13.403589 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/866ffd74-cec9-4ace-9e81-4b16286665d9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-4fxhl\" (UID: \"866ffd74-cec9-4ace-9e81-4b16286665d9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:13.405950 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:13.405930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/866ffd74-cec9-4ace-9e81-4b16286665d9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-4fxhl\" (UID: \"866ffd74-cec9-4ace-9e81-4b16286665d9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:13.578992 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:13.578959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:13.704694 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:13.704668 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl"] Jul 01 17:20:13.706763 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:13.706719 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866ffd74_cec9_4ace_9e81_4b16286665d9.slice/crio-00ba013899abecd0a3677cac68160ccdd4d7aa0770643285b4137abc1e8f5b27 WatchSource:0}: Error finding container 00ba013899abecd0a3677cac68160ccdd4d7aa0770643285b4137abc1e8f5b27: Status 404 returned error can't find the container with id 00ba013899abecd0a3677cac68160ccdd4d7aa0770643285b4137abc1e8f5b27 Jul 01 17:20:14.108097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.108068 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:20:14.110364 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.110339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df8c7f6e-b2e4-46b6-beba-c9facdbc8e90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ljck\" (UID: \"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90\") " pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:20:14.278733 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.278700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ljck" Jul 01 17:20:14.400620 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.400597 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ljck"] Jul 01 17:20:14.402785 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:14.402759 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8c7f6e_b2e4_46b6_beba_c9facdbc8e90.slice/crio-3b5d0f0937c980e787d2af7fb8ddf29c07e2743c68ebeb4e95d61b2e59f62bb6 WatchSource:0}: Error finding container 3b5d0f0937c980e787d2af7fb8ddf29c07e2743c68ebeb4e95d61b2e59f62bb6: Status 404 returned error can't find the container with id 3b5d0f0937c980e787d2af7fb8ddf29c07e2743c68ebeb4e95d61b2e59f62bb6 Jul 01 17:20:14.639188 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.639150 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ljck" event={"ID":"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90","Type":"ContainerStarted","Data":"3b5d0f0937c980e787d2af7fb8ddf29c07e2743c68ebeb4e95d61b2e59f62bb6"} Jul 01 17:20:14.640275 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.640244 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" event={"ID":"866ffd74-cec9-4ace-9e81-4b16286665d9","Type":"ContainerStarted","Data":"00ba013899abecd0a3677cac68160ccdd4d7aa0770643285b4137abc1e8f5b27"} Jul 01 17:20:14.649291 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.649270 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:20:14.649757 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.649730 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:20:14.652443 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:14.652396 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 17:20:15.646665 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:15.646633 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" event={"ID":"866ffd74-cec9-4ace-9e81-4b16286665d9","Type":"ContainerStarted","Data":"5cd599a308f396a62e67b528909b57f5e82a094eda58919d036cc8dca17d5131"} Jul 01 17:20:16.650865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:16.650831 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:16.656535 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:16.656507 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" Jul 01 17:20:16.667754 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:16.667691 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-4fxhl" podStartSLOduration=2.846360833 podStartE2EDuration="4.667677171s" totalImagesPullingTime="1.821316338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:16.667208841 +0000 UTC m=+302.397531053" watchObservedRunningTime="2026-07-01 17:20:16.667677171 +0000 UTC m=+302.397999359" Jul 01 17:20:16.863023 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:16.862978 2566 patch_prober.go:28] interesting pod/image-registry-7c9d9c594f-bnrc8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 17:20:16.863222 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:16.863069 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:20:17.694214 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:17.694170 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:17.763295 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:17.763262 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:17.974306 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:17.974231 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:18.188721 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:18.188702 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:20:18.661935 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:18.661897 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ljck" event={"ID":"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90","Type":"ContainerStarted","Data":"982b6a85956b95d473035ce81ff231dc075fd365c992c875f809f25fae3d1430"} Jul 01 17:20:19.173641 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:19.173610 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:19.329709 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:19.329680 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:19.499821 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:19.499789 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:19.600896 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:19.600862 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:19.668424 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:19.668398 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ljck" event={"ID":"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90","Type":"ContainerStarted","Data":"7b2ac504848e8a9b96f01ddd60c09cac0a7bc4bcf282d2504876840599bf48c6"} Jul 01 17:20:20.309675 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:20.309644 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:20.365976 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:20.365945 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:20.432246 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:20.432214 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:21.834368 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:21.834337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.080079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.080047 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.088043 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.087967 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm"] Jul 01 17:20:22.090134 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.090117 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.092838 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.092820 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 17:20:22.093063 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.093050 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:20:22.093605 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.093593 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f7kp2\"" Jul 01 17:20:22.094021 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.094008 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 17:20:22.104734 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.104713 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm"] Jul 01 17:20:22.116913 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.116892 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6gcxx"] Jul 01 17:20:22.119403 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.119386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.123166 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.123149 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 17:20:22.123524 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.123306 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 17:20:22.123524 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.123204 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 17:20:22.123524 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.123452 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cd8st\"" Jul 01 17:20:22.172713 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.172689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3007f534-0d67-4fec-95b5-3a8f1d549358-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.172833 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.172739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.172833 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.172767 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m22rp\" (UniqueName: \"kubernetes.io/projected/3007f534-0d67-4fec-95b5-3a8f1d549358-kube-api-access-m22rp\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.172833 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.172813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.185196 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.185165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.273567 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3007f534-0d67-4fec-95b5-3a8f1d549358-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.273768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273573 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-sys\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.273768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53e73249-b211-4214-9f21-2675308c0853-node-exporter-accelerators-collector-config\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.273768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-node-exporter-wtmp\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.273768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-tls\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.273768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9bml\" (UniqueName: \"kubernetes.io/projected/53e73249-b211-4214-9f21-2675308c0853-kube-api-access-h9bml\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.273768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273760 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m22rp\" (UniqueName: \"kubernetes.io/projected/3007f534-0d67-4fec-95b5-3a8f1d549358-kube-api-access-m22rp\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:22.273805 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53e73249-b211-4214-9f21-2675308c0853-metrics-client-ca\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:22.273878 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-tls podName:3007f534-0d67-4fec-95b5-3a8f1d549358 nodeName:}" failed. No retries permitted until 2026-07-01 17:20:22.773856629 +0000 UTC m=+308.504178843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-rmnfm" (UID: "3007f534-0d67-4fec-95b5-3a8f1d549358") : secret "openshift-state-metrics-tls" not found Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53e73249-b211-4214-9f21-2675308c0853-node-exporter-textfile\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.273987 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-root\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.274079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.274025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.274325 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.274235 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3007f534-0d67-4fec-95b5-3a8f1d549358-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.276367 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.276346 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.280786 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.280762 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.291451 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.291433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m22rp\" (UniqueName: \"kubernetes.io/projected/3007f534-0d67-4fec-95b5-3a8f1d549358-kube-api-access-m22rp\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.374945 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.374871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53e73249-b211-4214-9f21-2675308c0853-node-exporter-accelerators-collector-config\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.374945 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.374907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-node-exporter-wtmp\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.374945 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.374926 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-tls\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.374945 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.374947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9bml\" (UniqueName: \"kubernetes.io/projected/53e73249-b211-4214-9f21-2675308c0853-kube-api-access-h9bml\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.374978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53e73249-b211-4214-9f21-2675308c0853-metrics-client-ca\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375002 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53e73249-b211-4214-9f21-2675308c0853-node-exporter-textfile\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-root\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375092 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-node-exporter-wtmp\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375144 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-root\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-sys\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53e73249-b211-4214-9f21-2675308c0853-sys\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375611 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:22.375055 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 17:20:22.375611 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:22.375365 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-tls podName:53e73249-b211-4214-9f21-2675308c0853 nodeName:}" failed. No retries permitted until 2026-07-01 17:20:22.87534487 +0000 UTC m=+308.605667070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-tls") pod "node-exporter-6gcxx" (UID: "53e73249-b211-4214-9f21-2675308c0853") : secret "node-exporter-tls" not found Jul 01 17:20:22.375611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53e73249-b211-4214-9f21-2675308c0853-node-exporter-accelerators-collector-config\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375528 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53e73249-b211-4214-9f21-2675308c0853-metrics-client-ca\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.375611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.375527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53e73249-b211-4214-9f21-2675308c0853-node-exporter-textfile\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.377329 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.377309 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.384690 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.384667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.386287 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.386270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9bml\" (UniqueName: \"kubernetes.io/projected/53e73249-b211-4214-9f21-2675308c0853-kube-api-access-h9bml\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.487396 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.487369 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.681191 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.681102 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ljck" event={"ID":"df8c7f6e-b2e4-46b6-beba-c9facdbc8e90","Type":"ContainerStarted","Data":"3b2a324bc97f72e05787d4a17651fa0a337a714fafce7cbe5d8a9a0182361dde"} Jul 01 17:20:22.704684 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.704660 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.704911 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.704894 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:20:22.712526 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.712486 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9ljck" podStartSLOduration=33.367763464 podStartE2EDuration="40.712473012s" totalImagesPullingTime="7.344709548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:19:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:22.711369643 +0000 UTC m=+308.441691850" watchObservedRunningTime="2026-07-01 17:20:22.712473012 +0000 UTC m=+308.442795228" Jul 01 17:20:22.778597 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.778560 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.780925 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.780903 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3007f534-0d67-4fec-95b5-3a8f1d549358-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-rmnfm\" (UID: \"3007f534-0d67-4fec-95b5-3a8f1d549358\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:22.838426 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.838400 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:22.879848 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.879821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-tls\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.882606 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.882574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53e73249-b211-4214-9f21-2675308c0853-node-exporter-tls\") pod \"node-exporter-6gcxx\" (UID: \"53e73249-b211-4214-9f21-2675308c0853\") " pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:22.998958 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:22.998873 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" Jul 01 17:20:23.027637 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.027607 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6gcxx" Jul 01 17:20:23.036357 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.036331 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:23.038646 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:23.038496 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e73249_b211_4214_9f21_2675308c0853.slice/crio-b748f673f2fba0c21d5724cbef7fd7cb47b18d1b0131a07e1e5cf584511ba997 WatchSource:0}: Error finding container b748f673f2fba0c21d5724cbef7fd7cb47b18d1b0131a07e1e5cf584511ba997: Status 404 returned error can't find the container with id b748f673f2fba0c21d5724cbef7fd7cb47b18d1b0131a07e1e5cf584511ba997 Jul 01 17:20:23.136520 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.136489 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm"] Jul 01 17:20:23.139245 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:23.139218 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3007f534_0d67_4fec_95b5_3a8f1d549358.slice/crio-88fec75c969e4580b9083e6a9860822bf158c86b7821d9b820673b0e49a4caa2 WatchSource:0}: Error finding container 88fec75c969e4580b9083e6a9860822bf158c86b7821d9b820673b0e49a4caa2: Status 404 returned error can't find the container with id 88fec75c969e4580b9083e6a9860822bf158c86b7821d9b820673b0e49a4caa2 Jul 01 17:20:23.143067 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.143016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:23.252528 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.252413 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:23.686226 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.686184 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6gcxx" event={"ID":"53e73249-b211-4214-9f21-2675308c0853","Type":"ContainerStarted","Data":"b748f673f2fba0c21d5724cbef7fd7cb47b18d1b0131a07e1e5cf584511ba997"} Jul 01 17:20:23.688044 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.688011 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" event={"ID":"3007f534-0d67-4fec-95b5-3a8f1d549358","Type":"ContainerStarted","Data":"e5daf7b12309a9611b681619c193386726dac23ddeba816c84b7be7b316a443e"} Jul 01 17:20:23.688193 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.688094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" event={"ID":"3007f534-0d67-4fec-95b5-3a8f1d549358","Type":"ContainerStarted","Data":"b44993242be4a3dedd751ad473214d76111fd560b382ca4b50ed261378021e61"} Jul 01 17:20:23.688193 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:23.688127 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" event={"ID":"3007f534-0d67-4fec-95b5-3a8f1d549358","Type":"ContainerStarted","Data":"88fec75c969e4580b9083e6a9860822bf158c86b7821d9b820673b0e49a4caa2"} Jul 01 17:20:24.153653 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.153626 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:24.226449 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.226421 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dc5fc86c-zln8l"] Jul 01 17:20:24.230121 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.230101 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.233416 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.233390 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 17:20:24.233539 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.233430 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vgmgn\"" Jul 01 17:20:24.233539 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.233456 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fc15uecj93f5j\"" Jul 01 17:20:24.233539 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.233430 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 17:20:24.233693 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.233549 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 17:20:24.233745 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.233705 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 17:20:24.234608 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.234591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 17:20:24.244650 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.244628 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dc5fc86c-zln8l"] Jul 01 17:20:24.390965 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.390924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.390965 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.390968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-tls\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.391248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.390998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.391248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.391024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6m6\" (UniqueName: \"kubernetes.io/projected/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-kube-api-access-tn6m6\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.391248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.391074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.391248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.391119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.391248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.391152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-grpc-tls\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.391248 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.391202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-metrics-client-ca\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492013 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.491984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-grpc-tls\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492211 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-metrics-client-ca\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492211 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492211 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492132 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-tls\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492211 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492418 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6m6\" (UniqueName: \"kubernetes.io/projected/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-kube-api-access-tn6m6\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492418 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492418 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492370 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.492927 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.492903 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-metrics-client-ca\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.495350 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.495296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.495459 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.495360 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-grpc-tls\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.495459 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.495447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.495549 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.495482 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.495629 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.495605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.495708 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.495643 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-secret-thanos-querier-tls\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.503211 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.503187 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6m6\" (UniqueName: \"kubernetes.io/projected/d02f51f1-f0e7-44c5-a7de-3084747ffc2f-kube-api-access-tn6m6\") pod \"thanos-querier-7dc5fc86c-zln8l\" (UID: \"d02f51f1-f0e7-44c5-a7de-3084747ffc2f\") " pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.541196 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.541162 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:24.672481 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.672371 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:24.692692 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.692661 2566 generic.go:356] "Generic (PLEG): container finished" podID="53e73249-b211-4214-9f21-2675308c0853" containerID="0f2b2f0b21326bb7b5a19bd38e2d294943613ca7da9958870f665f2010f074f8" exitCode=0 Jul 01 17:20:24.692802 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.692764 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6gcxx" event={"ID":"53e73249-b211-4214-9f21-2675308c0853","Type":"ContainerDied","Data":"0f2b2f0b21326bb7b5a19bd38e2d294943613ca7da9958870f665f2010f074f8"} Jul 01 17:20:24.774498 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.774468 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:24.835836 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:24.835815 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dc5fc86c-zln8l"] Jul 01 17:20:24.838698 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:24.838676 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02f51f1_f0e7_44c5_a7de_3084747ffc2f.slice/crio-d1f815651e0586ed2b69242b0f81a72c57115ab2bebda47f7ac9a89b03e3267a WatchSource:0}: Error finding container d1f815651e0586ed2b69242b0f81a72c57115ab2bebda47f7ac9a89b03e3267a: Status 404 returned error can't find the container with id d1f815651e0586ed2b69242b0f81a72c57115ab2bebda47f7ac9a89b03e3267a Jul 01 17:20:25.190066 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.190014 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:25.292268 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.292237 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:25.674758 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.674724 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:25.698734 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.698702 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" event={"ID":"d02f51f1-f0e7-44c5-a7de-3084747ffc2f","Type":"ContainerStarted","Data":"d1f815651e0586ed2b69242b0f81a72c57115ab2bebda47f7ac9a89b03e3267a"} Jul 01 17:20:25.701450 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.701423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6gcxx" event={"ID":"53e73249-b211-4214-9f21-2675308c0853","Type":"ContainerStarted","Data":"7eeb61c5a73e0b34a2f6cb1c425a3d5702ab961082707171a717cd83313221af"} Jul 01 17:20:25.701594 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.701492 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6gcxx" event={"ID":"53e73249-b211-4214-9f21-2675308c0853","Type":"ContainerStarted","Data":"2c9676cf113edc84d7b9a53d1017c654c3144c3baf7b5063c58f0be46039a646"} Jul 01 17:20:25.704019 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.703989 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" event={"ID":"3007f534-0d67-4fec-95b5-3a8f1d549358","Type":"ContainerStarted","Data":"88e3488ecd451c58041cbf7b6a9b923f100cae4816c894565df7ae4a98eaa05b"} Jul 01 17:20:25.729354 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.729312 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6gcxx" podStartSLOduration=2.6888641570000003 podStartE2EDuration="3.729297428s" totalImagesPullingTime="978.015597ms" totalInitContainerRuntime="62.417674ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:25.728113544 +0000 UTC m=+311.458435753" watchObservedRunningTime="2026-07-01 17:20:25.729297428 +0000 UTC m=+311.459619637" Jul 01 17:20:25.819910 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:25.819867 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:26.510051 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.509982 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rmnfm" podStartSLOduration=3.023517872 podStartE2EDuration="4.50996436s" totalImagesPullingTime="1.486446488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:25.750984688 +0000 UTC m=+311.481306920" watchObservedRunningTime="2026-07-01 17:20:26.50996436 +0000 UTC m=+312.240286547" Jul 01 17:20:26.511050 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.511009 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f9c6fc89d-kz457"] Jul 01 17:20:26.514187 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.514172 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.517148 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.517123 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 17:20:26.517281 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.517135 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 17:20:26.517281 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.517241 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 17:20:26.519176 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.519151 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2iq4ro9nncdio\"" Jul 01 17:20:26.519176 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.519169 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:20:26.519302 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.519242 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xwl9t\"" Jul 01 17:20:26.524866 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.524846 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f9c6fc89d-kz457"] Jul 01 17:20:26.610583 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.610544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e94218-3433-41b3-b6da-517face3f560-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.610768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.610606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-secret-metrics-server-tls\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.610768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.610640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-secret-metrics-server-client-certs\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.610768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.610682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-client-ca-bundle\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.610768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.610724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a5e94218-3433-41b3-b6da-517face3f560-audit-log\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.611046 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.610756 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cmc\" (UniqueName: \"kubernetes.io/projected/a5e94218-3433-41b3-b6da-517face3f560-kube-api-access-48cmc\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.611046 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.610858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a5e94218-3433-41b3-b6da-517face3f560-metrics-server-audit-profiles\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711207 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e94218-3433-41b3-b6da-517face3f560-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711427 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-secret-metrics-server-tls\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711427 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-secret-metrics-server-client-certs\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711427 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-client-ca-bundle\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711427 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a5e94218-3433-41b3-b6da-517face3f560-audit-log\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711427 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cmc\" (UniqueName: \"kubernetes.io/projected/a5e94218-3433-41b3-b6da-517face3f560-kube-api-access-48cmc\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711691 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a5e94218-3433-41b3-b6da-517face3f560-metrics-server-audit-profiles\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.711784 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711760 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a5e94218-3433-41b3-b6da-517face3f560-audit-log\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.712067 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.711992 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5e94218-3433-41b3-b6da-517face3f560-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.712428 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.712408 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a5e94218-3433-41b3-b6da-517face3f560-metrics-server-audit-profiles\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.714240 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.714215 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-secret-metrics-server-tls\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.714349 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.714313 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-client-ca-bundle\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.714427 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.714407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a5e94218-3433-41b3-b6da-517face3f560-secret-metrics-server-client-certs\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.720272 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.720239 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cmc\" (UniqueName: \"kubernetes.io/projected/a5e94218-3433-41b3-b6da-517face3f560-kube-api-access-48cmc\") pod \"metrics-server-6f9c6fc89d-kz457\" (UID: \"a5e94218-3433-41b3-b6da-517face3f560\") " pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.823864 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.823834 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:26.861372 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.861345 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:20:26.867640 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.867613 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz"] Jul 01 17:20:26.873309 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.870705 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:26.873309 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.871362 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:26.874515 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.874491 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 17:20:26.875111 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.875093 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7mwns\"" Jul 01 17:20:26.880839 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:26.880817 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz"] Jul 01 17:20:27.010834 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.010802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:27.015010 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.014971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b02aabb7-2f30-4be6-9605-5230826df23e-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-bq7sz\" (UID: \"b02aabb7-2f30-4be6-9605-5230826df23e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:27.015153 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.015020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtm4\" (UniqueName: \"kubernetes.io/projected/b02aabb7-2f30-4be6-9605-5230826df23e-kube-api-access-jqtm4\") pod \"monitoring-plugin-cd8656b8-bq7sz\" (UID: \"b02aabb7-2f30-4be6-9605-5230826df23e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:27.116210 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.116117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b02aabb7-2f30-4be6-9605-5230826df23e-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-bq7sz\" (UID: \"b02aabb7-2f30-4be6-9605-5230826df23e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:27.116210 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.116167 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtm4\" (UniqueName: \"kubernetes.io/projected/b02aabb7-2f30-4be6-9605-5230826df23e-kube-api-access-jqtm4\") pod \"monitoring-plugin-cd8656b8-bq7sz\" (UID: \"b02aabb7-2f30-4be6-9605-5230826df23e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:27.119107 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.119072 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b02aabb7-2f30-4be6-9605-5230826df23e-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-bq7sz\" (UID: \"b02aabb7-2f30-4be6-9605-5230826df23e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:27.125607 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.125438 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtm4\" (UniqueName: \"kubernetes.io/projected/b02aabb7-2f30-4be6-9605-5230826df23e-kube-api-access-jqtm4\") pod \"monitoring-plugin-cd8656b8-bq7sz\" (UID: \"b02aabb7-2f30-4be6-9605-5230826df23e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:27.185350 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.184517 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:27.312270 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.312211 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f9c6fc89d-kz457"] Jul 01 17:20:27.317300 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:27.317269 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e94218_3433_41b3_b6da_517face3f560.slice/crio-fc5832dc5db40ae5c5a9b9cb72baba686a32e5c341f27d0dec883a1dca0bf48c WatchSource:0}: Error finding container fc5832dc5db40ae5c5a9b9cb72baba686a32e5c341f27d0dec883a1dca0bf48c: Status 404 returned error can't find the container with id fc5832dc5db40ae5c5a9b9cb72baba686a32e5c341f27d0dec883a1dca0bf48c Jul 01 17:20:27.359154 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.359133 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz"] Jul 01 17:20:27.362442 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:27.362419 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02aabb7_2f30_4be6_9605_5230826df23e.slice/crio-753a16efba1bf8c713ec5e88a1bab971a721732213464a47d4c45560203d8984 WatchSource:0}: Error finding container 753a16efba1bf8c713ec5e88a1bab971a721732213464a47d4c45560203d8984: Status 404 returned error can't find the container with id 753a16efba1bf8c713ec5e88a1bab971a721732213464a47d4c45560203d8984 Jul 01 17:20:27.363429 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.363407 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b7958654c-n7gks"] Jul 01 17:20:27.368093 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.368076 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.371317 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.371299 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-s5nvt\"" Jul 01 17:20:27.371411 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.371321 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 17:20:27.371684 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.371664 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 17:20:27.371768 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.371701 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 17:20:27.372151 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.371919 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 17:20:27.372151 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.372023 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 17:20:27.377917 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.377896 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 17:20:27.382995 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.382937 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b7958654c-n7gks"] Jul 01 17:20:27.518974 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.518944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrcqw\" (UniqueName: \"kubernetes.io/projected/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-kube-api-access-jrcqw\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.518974 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.518979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-telemeter-client-tls\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.519397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.519004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-secret-telemeter-client\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.519397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.519073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-serving-certs-ca-bundle\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.519397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.519114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.519397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.519140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-metrics-client-ca\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.519397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.519159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-federate-client-tls\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.519397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.519182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620307 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620224 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620307 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-metrics-client-ca\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620307 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-federate-client-tls\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620576 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620576 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620357 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrcqw\" (UniqueName: \"kubernetes.io/projected/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-kube-api-access-jrcqw\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620576 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-telemeter-client-tls\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620576 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-secret-telemeter-client\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.620576 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.620465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-serving-certs-ca-bundle\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.621214 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.621186 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-serving-certs-ca-bundle\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.621214 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.621212 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.621421 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.621189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-metrics-client-ca\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.622999 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.622971 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-secret-telemeter-client\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.623121 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.623092 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-federate-client-tls\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.623175 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.623159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.623210 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.623189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-telemeter-client-tls\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.631199 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.631180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrcqw\" (UniqueName: \"kubernetes.io/projected/cbf7dd61-4989-43e3-a4bf-69fbad5b91d4-kube-api-access-jrcqw\") pod \"telemeter-client-b7958654c-n7gks\" (UID: \"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4\") " pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.688110 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.688081 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" Jul 01 17:20:27.713752 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.713718 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" event={"ID":"d02f51f1-f0e7-44c5-a7de-3084747ffc2f","Type":"ContainerStarted","Data":"06923479ab5f22683568ddd5b579a3de6609141692951dea60f8618af396e124"} Jul 01 17:20:27.713865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.713808 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" event={"ID":"d02f51f1-f0e7-44c5-a7de-3084747ffc2f","Type":"ContainerStarted","Data":"04ba1fd23d306b06208035527200887c413d251f86c7a2717e582cbaad79298c"} Jul 01 17:20:27.713865 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.713853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" event={"ID":"d02f51f1-f0e7-44c5-a7de-3084747ffc2f","Type":"ContainerStarted","Data":"3fb0c01dc2a5700211d41900bd98d76cf4c02f227dcf19e933bec3d5e3d9d355"} Jul 01 17:20:27.714968 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.714937 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" event={"ID":"b02aabb7-2f30-4be6-9605-5230826df23e","Type":"ContainerStarted","Data":"753a16efba1bf8c713ec5e88a1bab971a721732213464a47d4c45560203d8984"} Jul 01 17:20:27.716392 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.716369 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" event={"ID":"a5e94218-3433-41b3-b6da-517face3f560","Type":"ContainerStarted","Data":"fc5832dc5db40ae5c5a9b9cb72baba686a32e5c341f27d0dec883a1dca0bf48c"} Jul 01 17:20:27.809678 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.809653 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:27.817901 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:27.817881 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b7958654c-n7gks"] Jul 01 17:20:27.821485 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:27.821455 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf7dd61_4989_43e3_a4bf_69fbad5b91d4.slice/crio-9d542129dc9938e1d8876b91adb0e12b8a1c18c1e6d2fae06b3e0d96522b72f4 WatchSource:0}: Error finding container 9d542129dc9938e1d8876b91adb0e12b8a1c18c1e6d2fae06b3e0d96522b72f4: Status 404 returned error can't find the container with id 9d542129dc9938e1d8876b91adb0e12b8a1c18c1e6d2fae06b3e0d96522b72f4 Jul 01 17:20:28.334578 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.334541 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:28.402611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.402576 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:20:28.406799 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.406771 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.410339 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410001 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:20:28.410339 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410016 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:20:28.410339 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410060 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:20:28.410339 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410250 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p5nqn\"" Jul 01 17:20:28.410339 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410322 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:20:28.410611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410357 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:20:28.410611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410434 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:20:28.410611 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.410446 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:20:28.411450 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.411423 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:20:28.411557 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.411524 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:20:28.412069 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.411935 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:20:28.412069 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.412022 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:20:28.412225 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.412122 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-u3c108th78n5\"" Jul 01 17:20:28.412374 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.412355 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:20:28.415655 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.415628 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:20:28.418701 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.418679 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:20:28.422639 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.422617 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:20:28.425483 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.425463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:28.529905 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.529865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.529918 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.529962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530258 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530375 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530395 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwtjk\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-kube-api-access-fwtjk\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530977 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530977 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530977 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530977 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530977 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530977 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.530977 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.530648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631155 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631155 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631155 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwtjk\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-kube-api-access-fwtjk\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631371 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631397 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631598 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.631811 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.631625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.633810 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.633557 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.633982 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.633941 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.634698 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.634574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.635711 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.636276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.636376 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.636988 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.637281 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.637829 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.637854 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.638531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.638789 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.639079 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.639025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.640439 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.640008 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.640439 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.640336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.640439 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.640396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.640639 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.640624 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.641270 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.641228 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.642763 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.642741 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwtjk\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-kube-api-access-fwtjk\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.643153 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.643132 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config\") pod \"prometheus-k8s-0\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.719951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.719710 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:28.726363 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:28.726265 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" event={"ID":"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4","Type":"ContainerStarted","Data":"9d542129dc9938e1d8876b91adb0e12b8a1c18c1e6d2fae06b3e0d96522b72f4"} Jul 01 17:20:29.113289 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.113251 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:29.210944 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.210898 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:29.311829 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.311797 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:29.498819 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.498776 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:29.560421 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.560331 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:20:29.561433 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.561380 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:29.561582 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:20:29.561554 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3c83ee_9379_4df8_bc00_32f8dc10a6a5.slice/crio-bb4fb7c98e126ad2f59a5bdb8b475b8f642e178f0a983885e62a27cb6817f69f WatchSource:0}: Error finding container bb4fb7c98e126ad2f59a5bdb8b475b8f642e178f0a983885e62a27cb6817f69f: Status 404 returned error can't find the container with id bb4fb7c98e126ad2f59a5bdb8b475b8f642e178f0a983885e62a27cb6817f69f Jul 01 17:20:29.734225 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.734134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" event={"ID":"d02f51f1-f0e7-44c5-a7de-3084747ffc2f","Type":"ContainerStarted","Data":"d60f552968a606eccbfcae02907637938a8165dedab6149880debb0e4577ab2b"} Jul 01 17:20:29.734225 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.734214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" event={"ID":"d02f51f1-f0e7-44c5-a7de-3084747ffc2f","Type":"ContainerStarted","Data":"d173f954ee43d814e1afec456669e2a37fbee9691cff558d93094844ad9f6c1d"} Jul 01 17:20:29.734439 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.734253 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" event={"ID":"d02f51f1-f0e7-44c5-a7de-3084747ffc2f","Type":"ContainerStarted","Data":"f0165a946269a724025a4ebb48290b80bc12d8f43db5206470eedf8b151d3ffe"} Jul 01 17:20:29.734439 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.734296 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:29.735705 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.735673 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" event={"ID":"a5e94218-3433-41b3-b6da-517face3f560","Type":"ContainerStarted","Data":"842a8efbbcd63bba1ccc5b678632765c343cf0c048a2d530da02e526a8218fab"} Jul 01 17:20:29.737168 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.737145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" event={"ID":"b02aabb7-2f30-4be6-9605-5230826df23e","Type":"ContainerStarted","Data":"4263708b4f63f1907d8bb62f3dfef7e669d253839631dd126fda15aa19d1d654"} Jul 01 17:20:29.737295 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.737277 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:29.738401 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.738379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerStarted","Data":"bb4fb7c98e126ad2f59a5bdb8b475b8f642e178f0a983885e62a27cb6817f69f"} Jul 01 17:20:29.743256 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.743238 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" Jul 01 17:20:29.761964 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.761927 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" podStartSLOduration=1.43223719 podStartE2EDuration="5.761915297s" totalImagesPullingTime="4.329678107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:29.76176685 +0000 UTC m=+315.492089060" watchObservedRunningTime="2026-07-01 17:20:29.761915297 +0000 UTC m=+315.492237557" Jul 01 17:20:29.776730 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.776661 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-bq7sz" podStartSLOduration=1.735858886 podStartE2EDuration="3.776644705s" totalImagesPullingTime="2.040785819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:29.776359174 +0000 UTC m=+315.506681385" watchObservedRunningTime="2026-07-01 17:20:29.776644705 +0000 UTC m=+315.506966909" Jul 01 17:20:29.800601 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:29.800550 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" podStartSLOduration=1.717492793 podStartE2EDuration="3.800529365s" totalImagesPullingTime="2.083036572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:29.798020318 +0000 UTC m=+315.528342579" watchObservedRunningTime="2026-07-01 17:20:29.800529365 +0000 UTC m=+315.530851575" Jul 01 17:20:30.744659 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:30.744566 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" event={"ID":"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4","Type":"ContainerStarted","Data":"12478b5819622207d84111a67709664735e14ff43590a8fd0b95f51d125c68dc"} Jul 01 17:20:31.753724 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:31.753689 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" event={"ID":"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4","Type":"ContainerStarted","Data":"dab260dd39e9ffa01aaac05ff39cce7e1fa38658027afc9e15f2dbd7e1fb19b3"} Jul 01 17:20:31.754169 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:31.753747 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" event={"ID":"cbf7dd61-4989-43e3-a4bf-69fbad5b91d4","Type":"ContainerStarted","Data":"e8363f4400397b061fd9d47d63e541824ffb7e6c7662a0fe8c9f014c6bc4c0f3"} Jul 01 17:20:31.755151 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:31.755125 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerID="5088a5b687f0e4c235f8f2e019203b82df3f329414516bc31ba1efc3d1fd2e18" exitCode=0 Jul 01 17:20:31.755262 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:31.755200 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"5088a5b687f0e4c235f8f2e019203b82df3f329414516bc31ba1efc3d1fd2e18"} Jul 01 17:20:31.778015 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:31.777970 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b7958654c-n7gks" podStartSLOduration=1.600219565 podStartE2EDuration="4.777951519s" totalImagesPullingTime="3.177731954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:31.775489085 +0000 UTC m=+317.505811317" watchObservedRunningTime="2026-07-01 17:20:31.777951519 +0000 UTC m=+317.508273727" Jul 01 17:20:31.875216 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:31.875178 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" containerName="registry" containerID="cri-o://870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46" gracePeriod=30 Jul 01 17:20:32.122900 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.122879 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:20:32.269664 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269630 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-certificates\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.269664 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269669 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-image-registry-private-configuration\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.269886 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269717 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shzjt\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-kube-api-access-shzjt\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.269886 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269736 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-bound-sa-token\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.269886 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269753 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e37b99e8-516f-429d-bbe9-d02fbae0a836-ca-trust-extracted\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.269886 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269776 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-trusted-ca\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.270085 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269864 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-installation-pull-secrets\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.270085 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.269925 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") pod \"e37b99e8-516f-429d-bbe9-d02fbae0a836\" (UID: \"e37b99e8-516f-429d-bbe9-d02fbae0a836\") " Jul 01 17:20:32.270242 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.270213 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:20:32.270491 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.270456 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:20:32.272377 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.272345 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:20:32.272487 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.272431 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-kube-api-access-shzjt" (OuterVolumeSpecName: "kube-api-access-shzjt") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "kube-api-access-shzjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:20:32.272487 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.272437 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:20:32.272577 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.272503 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:20:32.272577 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.272555 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:20:32.278141 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.278120 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37b99e8-516f-429d-bbe9-d02fbae0a836-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e37b99e8-516f-429d-bbe9-d02fbae0a836" (UID: "e37b99e8-516f-429d-bbe9-d02fbae0a836"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:20:32.371332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371300 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-certificates\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.371332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371328 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-image-registry-private-configuration\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.371332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371337 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shzjt\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-kube-api-access-shzjt\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.371545 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371347 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-bound-sa-token\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.371545 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371356 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e37b99e8-516f-429d-bbe9-d02fbae0a836-ca-trust-extracted\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.371545 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371365 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e37b99e8-516f-429d-bbe9-d02fbae0a836-trusted-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.371545 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371373 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e37b99e8-516f-429d-bbe9-d02fbae0a836-installation-pull-secrets\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.371545 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.371384 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e37b99e8-516f-429d-bbe9-d02fbae0a836-registry-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:20:32.761249 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.761219 2566 generic.go:356] "Generic (PLEG): container finished" podID="e37b99e8-516f-429d-bbe9-d02fbae0a836" containerID="870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46" exitCode=0 Jul 01 17:20:32.761664 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.761273 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" Jul 01 17:20:32.761664 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.761309 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" event={"ID":"e37b99e8-516f-429d-bbe9-d02fbae0a836","Type":"ContainerDied","Data":"870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46"} Jul 01 17:20:32.761664 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.761366 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d9c594f-bnrc8" event={"ID":"e37b99e8-516f-429d-bbe9-d02fbae0a836","Type":"ContainerDied","Data":"e934d80fcca2e8a1b40d5cfe46e95f3cef34a857420a1f84e8d1fa36f4707be6"} Jul 01 17:20:32.761664 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.761392 2566 scope.go:117] "RemoveContainer" containerID="870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46" Jul 01 17:20:32.771066 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.771027 2566 scope.go:117] "RemoveContainer" containerID="870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46" Jul 01 17:20:32.771394 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:20:32.771362 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46\": container with ID starting with 870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46 not found: ID does not exist" containerID="870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46" Jul 01 17:20:32.771490 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.771402 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46"} err="failed to get container status \"870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46\": rpc error: code = NotFound desc = could not find container \"870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46\": container with ID starting with 870b23dc67de38ed9d2d2bc72749aad2491d5e91c0eeb2df0611e0d4b91ebb46 not found: ID does not exist" Jul 01 17:20:32.780962 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.780941 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c9d9c594f-bnrc8"] Jul 01 17:20:32.786837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:32.786818 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c9d9c594f-bnrc8"] Jul 01 17:20:34.712554 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:34.712517 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" path="/var/lib/kubelet/pods/e37b99e8-516f-429d-bbe9-d02fbae0a836/volumes" Jul 01 17:20:35.231779 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:35.231744 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:35.418938 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:35.418906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:35.489934 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:35.489848 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:35.543453 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:35.543421 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:35.752284 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:35.752261 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dc5fc86c-zln8l" Jul 01 17:20:35.775795 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:35.775765 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerStarted","Data":"ca9893814abd74c46a34c38027f16e7832e1e7d507a2e15f1f600370a25f0fc7"} Jul 01 17:20:35.919004 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:35.918977 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.021170 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.021148 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.329450 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.329410 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.430642 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.430612 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.544727 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.544690 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.615717 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.615627 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.709304 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.709271 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.766485 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.766445 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:36.783021 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.782991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerStarted","Data":"47767542f1e17b4c92f9db1bb758ae2b009b4beb24f296fbfdb5273897770292"} Jul 01 17:20:36.783187 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.783073 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerStarted","Data":"33aa958b5de700527b2e54b158e3446419b2b4e9efbb1c6373bd04297d54d35c"} Jul 01 17:20:36.783187 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.783099 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerStarted","Data":"19b2eae072ec7e494f10fce7724137ae9bc750132a686a9fcd931ecf893e8cbc"} Jul 01 17:20:36.783187 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.783122 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerStarted","Data":"a01430b0cad8517caf8d539ac182b41494257e1514192872c77e84f21862333c"} Jul 01 17:20:36.783187 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.783145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerStarted","Data":"75a1413ea2532ba2e09e1335923a874deabc181505a6f701a0616b0027e79040"} Jul 01 17:20:36.814099 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.814024 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.373209965 podStartE2EDuration="8.814005058s" totalImagesPullingTime="5.41982891s" totalInitContainerRuntime="20.966183ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:20:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:20:36.813214067 +0000 UTC m=+322.543536277" watchObservedRunningTime="2026-07-01 17:20:36.814005058 +0000 UTC m=+322.544327267" Jul 01 17:20:36.906197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:36.906119 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:37.106346 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:37.106313 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:37.263476 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:37.263397 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:38.721025 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:38.720995 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:20:39.125173 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:39.125139 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:39.178729 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:39.178699 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:42.122183 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:42.122143 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:42.171790 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:42.171760 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:46.550361 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:46.550318 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:46.611059 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:46.611005 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:46.824591 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:46.824504 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:46.824591 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:46.824574 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:20:51.519400 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:51.519372 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:51.573676 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:51.573637 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:52.375976 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:52.375940 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:52.431789 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:52.431754 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:56.940167 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:56.940127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:20:57.039857 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:20:57.039827 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:00.745201 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:00.745160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:00.844081 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:00.844052 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:06.553275 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.553243 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:06.635019 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.634985 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:06.758994 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.758912 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:06.814194 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.814167 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:06.829980 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.829956 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:21:06.833639 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.833621 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f9c6fc89d-kz457" Jul 01 17:21:06.899809 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.899781 2566 generic.go:356] "Generic (PLEG): container finished" podID="c01bd920-04dd-4dca-84b5-e6c8880e3091" containerID="06a370a3f2524c67369986b299acb3a66f21b732c474d6b230b5cf1b817b2cd6" exitCode=0 Jul 01 17:21:06.899960 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.899847 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-zxml7" event={"ID":"c01bd920-04dd-4dca-84b5-e6c8880e3091","Type":"ContainerDied","Data":"06a370a3f2524c67369986b299acb3a66f21b732c474d6b230b5cf1b817b2cd6"} Jul 01 17:21:06.900286 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:06.900268 2566 scope.go:117] "RemoveContainer" containerID="06a370a3f2524c67369986b299acb3a66f21b732c474d6b230b5cf1b817b2cd6" Jul 01 17:21:07.361645 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.361562 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:07.419697 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.419663 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:07.752176 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.752077 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:07.850941 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.850909 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:07.905530 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.905496 2566 generic.go:356] "Generic (PLEG): container finished" podID="bfd4caac-b92f-464b-a545-34be46e076d5" containerID="74cd582f195ef463f8ac48393c8897689815474fec3459b58d68d23ddec93b33" exitCode=0 Jul 01 17:21:07.905712 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.905572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" event={"ID":"bfd4caac-b92f-464b-a545-34be46e076d5","Type":"ContainerDied","Data":"74cd582f195ef463f8ac48393c8897689815474fec3459b58d68d23ddec93b33"} Jul 01 17:21:07.905947 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.905928 2566 scope.go:117] "RemoveContainer" containerID="74cd582f195ef463f8ac48393c8897689815474fec3459b58d68d23ddec93b33" Jul 01 17:21:07.907299 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:07.907283 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-zxml7" event={"ID":"c01bd920-04dd-4dca-84b5-e6c8880e3091","Type":"ContainerStarted","Data":"bc1c69101e1584328b6c0e343f69616da58a42a778d4cef33c42c8917499d4ed"} Jul 01 17:21:08.867145 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:08.867118 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-4cgss_176efdf6-5997-42d2-b992-82ac3d3ca59e/cluster-monitoring-operator/0.log" Jul 01 17:21:08.912973 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:08.912944 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hncps" event={"ID":"bfd4caac-b92f-464b-a545-34be46e076d5","Type":"ContainerStarted","Data":"de53bc16c0f14aa2c88c33eabd8b0f5b7bad0811151d2e1526a382e71cbd2b07"} Jul 01 17:21:09.666308 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:09.666273 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f9c6fc89d-kz457_a5e94218-3433-41b3-b6da-517face3f560/metrics-server/0.log" Jul 01 17:21:09.866233 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:09.866207 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-bq7sz_b02aabb7-2f30-4be6-9605-5230826df23e/monitoring-plugin/0.log" Jul 01 17:21:10.666182 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:10.666152 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6gcxx_53e73249-b211-4214-9f21-2675308c0853/init-textfile/0.log" Jul 01 17:21:10.867334 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:10.867307 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6gcxx_53e73249-b211-4214-9f21-2675308c0853/node-exporter/0.log" Jul 01 17:21:11.066428 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:11.066399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6gcxx_53e73249-b211-4214-9f21-2675308c0853/kube-rbac-proxy/0.log" Jul 01 17:21:11.866403 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:11.866373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rmnfm_3007f534-0d67-4fec-95b5-3a8f1d549358/kube-rbac-proxy-main/0.log" Jul 01 17:21:12.065941 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:12.065913 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rmnfm_3007f534-0d67-4fec-95b5-3a8f1d549358/kube-rbac-proxy-self/0.log" Jul 01 17:21:12.266338 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:12.266261 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rmnfm_3007f534-0d67-4fec-95b5-3a8f1d549358/openshift-state-metrics/0.log" Jul 01 17:21:12.466556 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:12.466528 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/init-config-reloader/0.log" Jul 01 17:21:12.668511 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:12.668490 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/prometheus/0.log" Jul 01 17:21:12.866804 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:12.866778 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/config-reloader/0.log" Jul 01 17:21:13.066648 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:13.066619 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/thanos-sidecar/0.log" Jul 01 17:21:13.266729 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:13.266699 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/kube-rbac-proxy-web/0.log" Jul 01 17:21:13.467405 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:13.467316 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/kube-rbac-proxy/0.log" Jul 01 17:21:13.666021 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:13.665983 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/kube-rbac-proxy-thanos/0.log" Jul 01 17:21:14.266930 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:14.266904 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-4fxhl_866ffd74-cec9-4ace-9e81-4b16286665d9/prometheus-operator-admission-webhook/0.log" Jul 01 17:21:14.466323 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:14.466289 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b7958654c-n7gks_cbf7dd61-4989-43e3-a4bf-69fbad5b91d4/telemeter-client/0.log" Jul 01 17:21:14.667470 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:14.667447 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b7958654c-n7gks_cbf7dd61-4989-43e3-a4bf-69fbad5b91d4/reload/0.log" Jul 01 17:21:14.866617 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:14.866593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b7958654c-n7gks_cbf7dd61-4989-43e3-a4bf-69fbad5b91d4/kube-rbac-proxy/0.log" Jul 01 17:21:15.072335 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:15.072306 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/thanos-query/0.log" Jul 01 17:21:15.270722 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:15.270694 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy-web/0.log" Jul 01 17:21:15.466407 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:15.466334 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy/0.log" Jul 01 17:21:15.667718 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:15.667686 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/prom-label-proxy/0.log" Jul 01 17:21:15.869804 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:15.869771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy-rules/0.log" Jul 01 17:21:16.067295 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:16.067259 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy-metrics/0.log" Jul 01 17:21:21.509771 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:21.509737 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:21.568619 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:21.568512 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:27.581602 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:27.581566 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:27.682189 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:27.682124 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:28.679147 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.679112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:21:28.681379 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.681359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111da01d-53a9-42e6-abe2-34fbffd31333-metrics-certs\") pod \"network-metrics-daemon-sjvp6\" (UID: \"111da01d-53a9-42e6-abe2-34fbffd31333\") " pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:21:28.709360 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.709332 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnmdh\"" Jul 01 17:21:28.716083 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.716065 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjvp6" Jul 01 17:21:28.720564 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.720548 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:28.740502 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.740482 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:28.761676 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.761650 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:28.847685 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.847663 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sjvp6"] Jul 01 17:21:28.849380 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:21:28.849347 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111da01d_53a9_42e6_abe2_34fbffd31333.slice/crio-6a54e63004d121277a680fbba205cbb76edeb03753312ac589a06c3141e9765d WatchSource:0}: Error finding container 6a54e63004d121277a680fbba205cbb76edeb03753312ac589a06c3141e9765d: Status 404 returned error can't find the container with id 6a54e63004d121277a680fbba205cbb76edeb03753312ac589a06c3141e9765d Jul 01 17:21:28.995449 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:28.995372 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjvp6" event={"ID":"111da01d-53a9-42e6-abe2-34fbffd31333","Type":"ContainerStarted","Data":"6a54e63004d121277a680fbba205cbb76edeb03753312ac589a06c3141e9765d"} Jul 01 17:21:29.010249 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:29.010225 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:31.004700 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:31.004659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjvp6" event={"ID":"111da01d-53a9-42e6-abe2-34fbffd31333","Type":"ContainerStarted","Data":"1e145eeef5d728f9e0b00af2425186959d5cf4428de590b71a249e8d348862f4"} Jul 01 17:21:31.005084 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:31.004724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjvp6" event={"ID":"111da01d-53a9-42e6-abe2-34fbffd31333","Type":"ContainerStarted","Data":"aba9a4ab5530bef7d90fb10e5b4913900a723425859fbb69978228ca6030ade5"} Jul 01 17:21:31.026201 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:31.026152 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sjvp6" podStartSLOduration=375.949310263 podStartE2EDuration="6m17.026138494s" totalImagesPullingTime="1.076828231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:21:31.023858875 +0000 UTC m=+376.754181084" watchObservedRunningTime="2026-07-01 17:21:31.026138494 +0000 UTC m=+376.756460702" Jul 01 17:21:31.117752 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:31.117719 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:31.369155 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:31.369119 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:38.260312 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:38.260282 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:38.325985 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:38.325949 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:46.874954 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:46.874915 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:21:46.875506 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:46.875278 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="prometheus" containerID="cri-o://ca9893814abd74c46a34c38027f16e7832e1e7d507a2e15f1f600370a25f0fc7" gracePeriod=600 Jul 01 17:21:46.876109 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:46.875627 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://47767542f1e17b4c92f9db1bb758ae2b009b4beb24f296fbfdb5273897770292" gracePeriod=600 Jul 01 17:21:46.876109 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:46.875738 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy" containerID="cri-o://33aa958b5de700527b2e54b158e3446419b2b4e9efbb1c6373bd04297d54d35c" gracePeriod=600 Jul 01 17:21:46.876109 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:46.875805 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-web" containerID="cri-o://19b2eae072ec7e494f10fce7724137ae9bc750132a686a9fcd931ecf893e8cbc" gracePeriod=600 Jul 01 17:21:46.876109 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:46.875881 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="thanos-sidecar" containerID="cri-o://a01430b0cad8517caf8d539ac182b41494257e1514192872c77e84f21862333c" gracePeriod=600 Jul 01 17:21:46.876109 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:46.875950 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="config-reloader" containerID="cri-o://75a1413ea2532ba2e09e1335923a874deabc181505a6f701a0616b0027e79040" gracePeriod=600 Jul 01 17:21:47.072255 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072208 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerID="47767542f1e17b4c92f9db1bb758ae2b009b4beb24f296fbfdb5273897770292" exitCode=0 Jul 01 17:21:47.072255 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072242 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerID="33aa958b5de700527b2e54b158e3446419b2b4e9efbb1c6373bd04297d54d35c" exitCode=0 Jul 01 17:21:47.072255 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072252 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerID="19b2eae072ec7e494f10fce7724137ae9bc750132a686a9fcd931ecf893e8cbc" exitCode=0 Jul 01 17:21:47.072255 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072259 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerID="a01430b0cad8517caf8d539ac182b41494257e1514192872c77e84f21862333c" exitCode=0 Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072266 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerID="75a1413ea2532ba2e09e1335923a874deabc181505a6f701a0616b0027e79040" exitCode=0 Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072257 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"47767542f1e17b4c92f9db1bb758ae2b009b4beb24f296fbfdb5273897770292"} Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"33aa958b5de700527b2e54b158e3446419b2b4e9efbb1c6373bd04297d54d35c"} Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072274 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerID="ca9893814abd74c46a34c38027f16e7832e1e7d507a2e15f1f600370a25f0fc7" exitCode=0 Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072413 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"19b2eae072ec7e494f10fce7724137ae9bc750132a686a9fcd931ecf893e8cbc"} Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072455 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"a01430b0cad8517caf8d539ac182b41494257e1514192872c77e84f21862333c"} Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072495 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"75a1413ea2532ba2e09e1335923a874deabc181505a6f701a0616b0027e79040"} Jul 01 17:21:47.072566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.072534 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"ca9893814abd74c46a34c38027f16e7832e1e7d507a2e15f1f600370a25f0fc7"} Jul 01 17:21:47.147679 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.147654 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:47.243414 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243387 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243582 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243420 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243582 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243444 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-thanos-prometheus-http-client-file\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243582 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243468 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-web-config\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243582 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243504 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-trusted-ca-bundle\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243582 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243534 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config-out\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243582 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243565 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-metrics-client-ca\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243588 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-1\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243627 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-kube-rbac-proxy\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243650 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-metrics-client-certs\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243708 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-tls-assets\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243732 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243774 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-0\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243799 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-tls\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243826 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-grpc-tls\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243877 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-2\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.243902 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243900 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwtjk\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-kube-api-access-fwtjk\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.244492 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243927 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-db\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.244492 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243953 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-serving-certs-ca-bundle\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.244492 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243997 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-kubelet-serving-ca-bundle\") pod \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\" (UID: \"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5\") " Jul 01 17:21:47.244492 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.243986 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:47.244492 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.244319 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.244492 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.244399 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:47.244767 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.244657 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:47.246223 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.245690 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:47.246603 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.246575 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:47.247197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.246902 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:47.247308 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.246979 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.247385 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.247053 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config" (OuterVolumeSpecName: "config") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.247470 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.247148 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:47.247470 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.247151 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.247470 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.247313 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config-out" (OuterVolumeSpecName: "config-out") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:21:47.247835 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.247809 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:21:47.247938 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.247832 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.247938 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.247867 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.248184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.248158 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:21:47.248315 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.248291 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.248723 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.248705 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.249500 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.249477 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.249615 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.249596 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-kube-api-access-fwtjk" (OuterVolumeSpecName: "kube-api-access-fwtjk") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "kube-api-access-fwtjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:21:47.257133 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.257109 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-web-config" (OuterVolumeSpecName: "web-config") pod "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" (UID: "9e3c83ee-9379-4df8-bc00-32f8dc10a6a5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:47.345236 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345186 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345236 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345223 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345258 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-grpc-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345268 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345277 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwtjk\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-kube-api-access-fwtjk\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345285 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-db\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345295 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345304 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345312 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345323 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345331 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345340 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-web-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345349 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-config-out\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345356 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-configmap-metrics-client-ca\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345365 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345373 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-kube-rbac-proxy\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345382 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-metrics-client-certs\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345389 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-tls-assets\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:47.345448 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:47.345398 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:21:48.079157 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.079115 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e3c83ee-9379-4df8-bc00-32f8dc10a6a5","Type":"ContainerDied","Data":"bb4fb7c98e126ad2f59a5bdb8b475b8f642e178f0a983885e62a27cb6817f69f"} Jul 01 17:21:48.079566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.079171 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.079566 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.079216 2566 scope.go:117] "RemoveContainer" containerID="47767542f1e17b4c92f9db1bb758ae2b009b4beb24f296fbfdb5273897770292" Jul 01 17:21:48.087232 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.087136 2566 scope.go:117] "RemoveContainer" containerID="33aa958b5de700527b2e54b158e3446419b2b4e9efbb1c6373bd04297d54d35c" Jul 01 17:21:48.094205 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.094191 2566 scope.go:117] "RemoveContainer" containerID="19b2eae072ec7e494f10fce7724137ae9bc750132a686a9fcd931ecf893e8cbc" Jul 01 17:21:48.100757 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.100740 2566 scope.go:117] "RemoveContainer" containerID="a01430b0cad8517caf8d539ac182b41494257e1514192872c77e84f21862333c" Jul 01 17:21:48.105734 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.105712 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:21:48.107827 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.107666 2566 scope.go:117] "RemoveContainer" containerID="75a1413ea2532ba2e09e1335923a874deabc181505a6f701a0616b0027e79040" Jul 01 17:21:48.111732 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.111715 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:21:48.115193 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.115169 2566 scope.go:117] "RemoveContainer" containerID="ca9893814abd74c46a34c38027f16e7832e1e7d507a2e15f1f600370a25f0fc7" Jul 01 17:21:48.122377 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.122364 2566 scope.go:117] "RemoveContainer" containerID="5088a5b687f0e4c235f8f2e019203b82df3f329414516bc31ba1efc3d1fd2e18" Jul 01 17:21:48.137510 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137488 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:21:48.137776 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137764 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="init-config-reloader" Jul 01 17:21:48.137820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137777 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="init-config-reloader" Jul 01 17:21:48.137820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137791 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-thanos" Jul 01 17:21:48.137820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137797 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-thanos" Jul 01 17:21:48.137820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137804 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="config-reloader" Jul 01 17:21:48.137820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137810 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="config-reloader" Jul 01 17:21:48.137820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137817 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="thanos-sidecar" Jul 01 17:21:48.137820 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137823 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="thanos-sidecar" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137830 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" containerName="registry" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137836 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" containerName="registry" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137846 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="prometheus" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137851 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="prometheus" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137855 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137860 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137867 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-web" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137871 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-web" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137915 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="prometheus" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137922 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37b99e8-516f-429d-bbe9-d02fbae0a836" containerName="registry" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137930 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137936 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-web" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137942 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="kube-rbac-proxy-thanos" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137947 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="thanos-sidecar" Jul 01 17:21:48.138097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.137951 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" containerName="config-reloader" Jul 01 17:21:48.143155 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.143140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.146329 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146299 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:21:48.146440 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146365 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:21:48.146602 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146587 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:21:48.146602 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146594 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:21:48.146720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:21:48.146826 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146809 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:21:48.146889 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146810 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:21:48.146889 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146840 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:21:48.146983 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.146904 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:21:48.147380 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.147358 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:21:48.148201 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.148180 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-u3c108th78n5\"" Jul 01 17:21:48.148311 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.148190 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:21:48.148311 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.148240 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p5nqn\"" Jul 01 17:21:48.148311 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.148262 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:21:48.151787 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.151769 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:21:48.153321 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.153282 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:21:48.165118 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.165095 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:21:48.254068 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254010 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254068 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254297 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254139 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-config\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254297 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254297 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254297 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254297 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254297 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254442 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254505 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6psnj\" (UniqueName: \"kubernetes.io/projected/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-kube-api-access-6psnj\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254634 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.254720 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.254664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.355988 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.355955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.355988 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.355989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-config\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356068 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356136 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356197 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356463 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356439 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356485 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.356517 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.356934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357150 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357323 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6psnj\" (UniqueName: \"kubernetes.io/projected/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-kube-api-access-6psnj\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.357837 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.357560 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.359208 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.359180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.359208 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.359193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.359482 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.359460 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.360271 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.359887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.360271 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.360005 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.360271 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.360078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.360271 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.360244 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.361182 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.360546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-config\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.361182 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.360699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.361182 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.360894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.361182 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.361010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.361572 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.361552 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.361826 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.361810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.362195 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.362176 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.362629 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.362612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.368870 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.368847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6psnj\" (UniqueName: \"kubernetes.io/projected/559cd3ed-4f4a-431a-83b9-b3d5a90113d5-kube-api-access-6psnj\") pod \"prometheus-k8s-0\" (UID: \"559cd3ed-4f4a-431a-83b9-b3d5a90113d5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.452633 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.452559 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:48.585527 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.585502 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:21:48.586717 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:21:48.586692 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559cd3ed_4f4a_431a_83b9_b3d5a90113d5.slice/crio-17a961bc62d21ec31c468d3672c6f31c12ffd7e615f9b553910bb857ab650b82 WatchSource:0}: Error finding container 17a961bc62d21ec31c468d3672c6f31c12ffd7e615f9b553910bb857ab650b82: Status 404 returned error can't find the container with id 17a961bc62d21ec31c468d3672c6f31c12ffd7e615f9b553910bb857ab650b82 Jul 01 17:21:48.709794 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:48.709735 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e3c83ee-9379-4df8-bc00-32f8dc10a6a5" path="/var/lib/kubelet/pods/9e3c83ee-9379-4df8-bc00-32f8dc10a6a5/volumes" Jul 01 17:21:49.084528 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:49.084493 2566 generic.go:356] "Generic (PLEG): container finished" podID="559cd3ed-4f4a-431a-83b9-b3d5a90113d5" containerID="7ece7829b9b254974cd5195b97ad177501c53a8c8bbc7e37faa742e843c82e33" exitCode=0 Jul 01 17:21:49.084924 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:49.084581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerDied","Data":"7ece7829b9b254974cd5195b97ad177501c53a8c8bbc7e37faa742e843c82e33"} Jul 01 17:21:49.084924 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:49.084672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerStarted","Data":"17a961bc62d21ec31c468d3672c6f31c12ffd7e615f9b553910bb857ab650b82"} Jul 01 17:21:50.088341 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.088287 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:50.092677 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.092653 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerStarted","Data":"495d2f5ac9b99904ee494c973e07c56f80ec41bf84143b8df44e2a21e679f702"} Jul 01 17:21:50.092781 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.092709 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerStarted","Data":"7f04bd09babf8de59ea52dae1b03b47b12cde3750aee64fb0e0d6fdd2dfe2c94"} Jul 01 17:21:50.092781 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.092734 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerStarted","Data":"02dd6ef382bf31634d97c5f001cc582ef802285ef33e40048c908b798774c762"} Jul 01 17:21:50.092781 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.092758 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerStarted","Data":"06e55f9c3a24bd9cf27c898eb507db4265db7d07399297b9262292a7c29b6235"} Jul 01 17:21:50.092899 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.092782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerStarted","Data":"cdf6dd1bb230ab346ca8e3967f2b1aa9432853a6afdb57b0d9e1e6b6c9937df4"} Jul 01 17:21:50.092899 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.092806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"559cd3ed-4f4a-431a-83b9-b3d5a90113d5","Type":"ContainerStarted","Data":"22259403e301fadbdf672f1cb9bb1e30b32a48a05a48b2d50cff00cacc5a31f2"} Jul 01 17:21:50.127288 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.127240 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.109574307 podStartE2EDuration="2.127224239s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.649932ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:21:50.126967216 +0000 UTC m=+395.857289461" watchObservedRunningTime="2026-07-01 17:21:50.127224239 +0000 UTC m=+395.857546447" Jul 01 17:21:50.188431 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.188399 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:50.289533 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.289494 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:50.804809 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.804771 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:50.906975 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:50.906942 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:53.453698 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:53.453657 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:21:53.978939 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:53.978905 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:54.080060 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:21:54.079993 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:01.066807 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:01.066762 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:01.168060 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:01.168016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:01.228020 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:01.227987 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:06.535006 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:06.534966 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:06.633873 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:06.633839 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:37.917583 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:37.917487 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:37.980571 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:37.980538 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:48.453436 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:48.453348 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:22:48.468430 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:48.468401 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:22:48.854103 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:48.854060 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:48.950143 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:48.950110 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:49.195898 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:49.195816 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:49.297711 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:49.297675 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:22:49.339019 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:49.338998 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:22:49.397862 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:22:49.397826 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:17.078730 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:17.078688 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:17.183503 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:17.183472 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:22.610996 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:22.610955 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:22.916362 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:22.916280 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:23.002525 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:23.002495 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:23.108873 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:23.108842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:23.467281 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:23.467245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:23.568986 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:23.568951 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:23.768456 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:23.768381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:23.829628 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:23.829595 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:24.010300 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:24.010268 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:24.212723 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:24.212689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:24.309934 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:23:24.309906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:29.718489 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.718412 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:29.793685 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.793656 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-g8kzs"] Jul 01 17:24:29.797172 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.797151 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:29.800252 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.800223 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 01 17:24:29.801484 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.801458 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 17:24:29.801608 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.801460 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 17:24:29.801608 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.801465 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-pnsqz\"" Jul 01 17:24:29.805494 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.805466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-g8kzs\" (UID: \"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:29.805651 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.805531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhvc6\" (UniqueName: \"kubernetes.io/projected/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-kube-api-access-vhvc6\") pod \"llmisvc-controller-manager-67d95fdc48-g8kzs\" (UID: \"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:29.806152 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.806074 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:29.807474 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.807453 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-g8kzs"] Jul 01 17:24:29.884623 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.884589 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:29.905951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.905916 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-g8kzs\" (UID: \"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:29.906132 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.905955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhvc6\" (UniqueName: \"kubernetes.io/projected/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-kube-api-access-vhvc6\") pod \"llmisvc-controller-manager-67d95fdc48-g8kzs\" (UID: \"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:29.906132 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:24:29.906086 2566 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 17:24:29.906203 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:24:29.906153 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-cert podName:8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5 nodeName:}" failed. No retries permitted until 2026-07-01 17:24:30.406131009 +0000 UTC m=+556.136453197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-cert") pod "llmisvc-controller-manager-67d95fdc48-g8kzs" (UID: "8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5") : secret "llmisvc-webhook-server-cert" not found Jul 01 17:24:29.916681 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:29.916650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhvc6\" (UniqueName: \"kubernetes.io/projected/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-kube-api-access-vhvc6\") pod \"llmisvc-controller-manager-67d95fdc48-g8kzs\" (UID: \"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:30.152957 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.152917 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:30.254951 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.254912 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:30.352597 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.352571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:30.407347 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.407266 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:30.409420 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.409401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-g8kzs\" (UID: \"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:30.411748 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.411718 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-g8kzs\" (UID: \"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:30.484732 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.484699 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:30.708092 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.707987 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:30.839953 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:30.839918 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-g8kzs"] Jul 01 17:24:30.843127 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:24:30.843097 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8af7cc7e_02f4_49eb_ad52_fd64a8cc94c5.slice/crio-08085a01c5ea1e850fa8479a549cdf9c011041ed1ea6a089ac37f88bbff25120 WatchSource:0}: Error finding container 08085a01c5ea1e850fa8479a549cdf9c011041ed1ea6a089ac37f88bbff25120: Status 404 returned error can't find the container with id 08085a01c5ea1e850fa8479a549cdf9c011041ed1ea6a089ac37f88bbff25120 Jul 01 17:24:31.735414 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:31.735368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" event={"ID":"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5","Type":"ContainerStarted","Data":"08085a01c5ea1e850fa8479a549cdf9c011041ed1ea6a089ac37f88bbff25120"} Jul 01 17:24:32.741298 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:32.741262 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" event={"ID":"8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5","Type":"ContainerStarted","Data":"b380ea704f3f4ca9da860a583db4c8a6d136126f1d2d14ec4b49880204bace5a"} Jul 01 17:24:32.741693 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:32.741382 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:24:32.760434 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:24:32.760379 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" podStartSLOduration=2.014286812 podStartE2EDuration="3.76036179s" totalImagesPullingTime="1.746074978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:24:32.759785531 +0000 UTC m=+558.490107741" watchObservedRunningTime="2026-07-01 17:24:32.76036179 +0000 UTC m=+558.490683998" Jul 01 17:25:03.747044 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:03.747009 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-g8kzs" Jul 01 17:25:14.682324 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:14.682296 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:25:14.683258 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:14.683235 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:25:30.136025 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:30.135986 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:34.441332 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:34.441295 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:39.555626 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:39.555534 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:39.631286 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:39.631256 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:39.971711 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:39.971627 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:40.119396 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:40.119367 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:40.220801 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:40.220772 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:54.214552 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:54.214520 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:56.135342 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.135311 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-tpdfm"] Jul 01 17:25:56.138687 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.138671 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.141559 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.141535 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 17:25:56.141691 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.141537 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-sg2cj\"" Jul 01 17:25:56.147014 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.146989 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-tpdfm"] Jul 01 17:25:56.264836 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.264796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e7d312-fd38-4586-bce7-1171ea611273-model-cache\") pod \"s3-init-tpdfm\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.265019 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.264901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6g7\" (UniqueName: \"kubernetes.io/projected/c5e7d312-fd38-4586-bce7-1171ea611273-kube-api-access-zw6g7\") pod \"s3-init-tpdfm\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.366260 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.366221 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6g7\" (UniqueName: \"kubernetes.io/projected/c5e7d312-fd38-4586-bce7-1171ea611273-kube-api-access-zw6g7\") pod \"s3-init-tpdfm\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.366414 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.366279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e7d312-fd38-4586-bce7-1171ea611273-model-cache\") pod \"s3-init-tpdfm\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.366653 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.366637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e7d312-fd38-4586-bce7-1171ea611273-model-cache\") pod \"s3-init-tpdfm\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.375580 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.375548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6g7\" (UniqueName: \"kubernetes.io/projected/c5e7d312-fd38-4586-bce7-1171ea611273-kube-api-access-zw6g7\") pod \"s3-init-tpdfm\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.459362 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.459247 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tpdfm" Jul 01 17:25:56.589986 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.589964 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-tpdfm"] Jul 01 17:25:56.592090 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:25:56.592063 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5e7d312_fd38_4586_bce7_1171ea611273.slice/crio-0d16e1298c93870d6228bfeaff5aacaa6a633759d7fcb6a132c52bf3a5d82b63 WatchSource:0}: Error finding container 0d16e1298c93870d6228bfeaff5aacaa6a633759d7fcb6a132c52bf3a5d82b63: Status 404 returned error can't find the container with id 0d16e1298c93870d6228bfeaff5aacaa6a633759d7fcb6a132c52bf3a5d82b63 Jul 01 17:25:56.593997 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:56.593980 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:25:57.077281 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:25:57.077242 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tpdfm" event={"ID":"c5e7d312-fd38-4586-bce7-1171ea611273","Type":"ContainerStarted","Data":"0d16e1298c93870d6228bfeaff5aacaa6a633759d7fcb6a132c52bf3a5d82b63"} Jul 01 17:26:01.097109 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:01.097068 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tpdfm" event={"ID":"c5e7d312-fd38-4586-bce7-1171ea611273","Type":"ContainerStarted","Data":"3cd6aebe60d19acab5d52740a3649183ab875850d1bc25a26d9ec7c81dfbc6c4"} Jul 01 17:26:03.108382 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:03.108350 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5e7d312-fd38-4586-bce7-1171ea611273" containerID="3cd6aebe60d19acab5d52740a3649183ab875850d1bc25a26d9ec7c81dfbc6c4" exitCode=0 Jul 01 17:26:03.108762 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:03.108423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tpdfm" event={"ID":"c5e7d312-fd38-4586-bce7-1171ea611273","Type":"ContainerDied","Data":"3cd6aebe60d19acab5d52740a3649183ab875850d1bc25a26d9ec7c81dfbc6c4"} Jul 01 17:26:05.063155 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:05.063120 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:26:05.127159 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:05.127126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:26:07.976223 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:07.976187 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:26:08.134209 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:08.134124 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tpdfm" event={"ID":"c5e7d312-fd38-4586-bce7-1171ea611273","Type":"ContainerStarted","Data":"775de18451647f9afd621ba0e5466aa3bd98e5853309620590800633ca24694e"} Jul 01 17:26:08.152766 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:08.152705 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-tpdfm" podStartSLOduration=1.939104368 podStartE2EDuration="12.15269037s" totalImagesPullingTime="8.534512597s" totalInitContainerRuntime="1.679073405s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:25:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:26:08.151078589 +0000 UTC m=+653.881400799" watchObservedRunningTime="2026-07-01 17:26:08.15269037 +0000 UTC m=+653.883012578" Jul 01 17:26:21.347661 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:21.347626 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:26:26.193212 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:26.193176 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:26:26.258599 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:26:26.258565 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:09.719515 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:09.719438 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:13.408882 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:13.408851 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5e7d312-fd38-4586-bce7-1171ea611273" containerID="775de18451647f9afd621ba0e5466aa3bd98e5853309620590800633ca24694e" exitCode=0 Jul 01 17:27:13.408882 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:13.408887 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tpdfm" event={"ID":"c5e7d312-fd38-4586-bce7-1171ea611273","Type":"ContainerDied","Data":"775de18451647f9afd621ba0e5466aa3bd98e5853309620590800633ca24694e"} Jul 01 17:27:14.545542 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:14.545516 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tpdfm" Jul 01 17:27:14.669592 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:14.669501 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw6g7\" (UniqueName: \"kubernetes.io/projected/c5e7d312-fd38-4586-bce7-1171ea611273-kube-api-access-zw6g7\") pod \"c5e7d312-fd38-4586-bce7-1171ea611273\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " Jul 01 17:27:14.669592 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:14.669574 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e7d312-fd38-4586-bce7-1171ea611273-model-cache\") pod \"c5e7d312-fd38-4586-bce7-1171ea611273\" (UID: \"c5e7d312-fd38-4586-bce7-1171ea611273\") " Jul 01 17:27:14.671610 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:14.671582 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e7d312-fd38-4586-bce7-1171ea611273-kube-api-access-zw6g7" (OuterVolumeSpecName: "kube-api-access-zw6g7") pod "c5e7d312-fd38-4586-bce7-1171ea611273" (UID: "c5e7d312-fd38-4586-bce7-1171ea611273"). InnerVolumeSpecName "kube-api-access-zw6g7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:27:14.688072 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:14.688043 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5e7d312-fd38-4586-bce7-1171ea611273-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5e7d312-fd38-4586-bce7-1171ea611273" (UID: "c5e7d312-fd38-4586-bce7-1171ea611273"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:27:14.771315 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:14.771276 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw6g7\" (UniqueName: \"kubernetes.io/projected/c5e7d312-fd38-4586-bce7-1171ea611273-kube-api-access-zw6g7\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:27:14.771315 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:14.771310 2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e7d312-fd38-4586-bce7-1171ea611273-model-cache\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:27:15.418312 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:15.418284 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-tpdfm" Jul 01 17:27:15.418312 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:15.418298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-tpdfm" event={"ID":"c5e7d312-fd38-4586-bce7-1171ea611273","Type":"ContainerDied","Data":"0d16e1298c93870d6228bfeaff5aacaa6a633759d7fcb6a132c52bf3a5d82b63"} Jul 01 17:27:15.418516 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:15.418335 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d16e1298c93870d6228bfeaff5aacaa6a633759d7fcb6a132c52bf3a5d82b63" Jul 01 17:27:15.770512 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:15.770424 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:15.872681 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:15.872648 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:26.844456 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.844417 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:26.902780 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.902746 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8"] Jul 01 17:27:26.903089 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.903076 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e7d312-fd38-4586-bce7-1171ea611273" containerName="download-hf-model" Jul 01 17:27:26.903136 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.903090 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e7d312-fd38-4586-bce7-1171ea611273" containerName="download-hf-model" Jul 01 17:27:26.903136 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.903099 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e7d312-fd38-4586-bce7-1171ea611273" containerName="s3-init" Jul 01 17:27:26.903136 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.903105 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e7d312-fd38-4586-bce7-1171ea611273" containerName="s3-init" Jul 01 17:27:26.903224 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.903162 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5e7d312-fd38-4586-bce7-1171ea611273" containerName="s3-init" Jul 01 17:27:26.906370 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.906355 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:26.909277 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.909256 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-zg2kz\"" Jul 01 17:27:26.909542 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.909518 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 01 17:27:26.909650 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.909592 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 01 17:27:26.909650 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.909620 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 01 17:27:26.910754 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.910731 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 01 17:27:26.910864 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.910753 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 17:27:26.910864 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.910780 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 01 17:27:26.917120 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.917100 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8"] Jul 01 17:27:26.998724 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:26.998694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:27.066111 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.066080 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:27.088371 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.088347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msdqm\" (UniqueName: \"kubernetes.io/projected/654e3775-925a-4880-9245-877bc17515d5-kube-api-access-msdqm\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.088502 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.088379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.088502 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.088415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/654e3775-925a-4880-9245-877bc17515d5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.088598 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.088517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/654e3775-925a-4880-9245-877bc17515d5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.088598 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.088551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.153677 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.153592 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:27.185054 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.185003 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh"] Jul 01 17:27:27.188586 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.188558 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.189075 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msdqm\" (UniqueName: \"kubernetes.io/projected/654e3775-925a-4880-9245-877bc17515d5-kube-api-access-msdqm\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.189203 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.189203 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/654e3775-925a-4880-9245-877bc17515d5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.189203 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/654e3775-925a-4880-9245-877bc17515d5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.189356 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.189660 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/654e3775-925a-4880-9245-877bc17515d5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.189867 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.189934 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.189860 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.191538 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.191521 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 01 17:27:27.191642 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.191573 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 01 17:27:27.191699 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.191643 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/654e3775-925a-4880-9245-877bc17515d5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.202543 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.202520 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh"] Jul 01 17:27:27.203849 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.203811 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msdqm\" (UniqueName: \"kubernetes.io/projected/654e3775-925a-4880-9245-877bc17515d5-kube-api-access-msdqm\") pod \"isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.217043 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.217004 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:27.272375 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.272343 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:27.290607 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.290580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.290821 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.290623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6pjd\" (UniqueName: \"kubernetes.io/projected/bee89f35-320b-464f-a008-6e266da12577-kube-api-access-x6pjd\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.290821 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.290689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bee89f35-320b-464f-a008-6e266da12577-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.290821 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.290733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.290821 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.290786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bee89f35-320b-464f-a008-6e266da12577-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.350087 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.350059 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8"] Jul 01 17:27:27.351822 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:27:27.351787 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654e3775_925a_4880_9245_877bc17515d5.slice/crio-8143013c7aa96e183c7946d3fe6bddc3ab9ef39d449cbed75a47c836ba1995d2 WatchSource:0}: Error finding container 8143013c7aa96e183c7946d3fe6bddc3ab9ef39d449cbed75a47c836ba1995d2: Status 404 returned error can't find the container with id 8143013c7aa96e183c7946d3fe6bddc3ab9ef39d449cbed75a47c836ba1995d2 Jul 01 17:27:27.352972 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.352949 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:27.397570 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.397534 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.397672 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.397594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6pjd\" (UniqueName: \"kubernetes.io/projected/bee89f35-320b-464f-a008-6e266da12577-kube-api-access-x6pjd\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.397672 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.397644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bee89f35-320b-464f-a008-6e266da12577-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.397793 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.397681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.397793 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.397772 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bee89f35-320b-464f-a008-6e266da12577-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.398533 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.398487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bee89f35-320b-464f-a008-6e266da12577-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.398773 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.398750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.398851 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.398824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.400357 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.400336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bee89f35-320b-464f-a008-6e266da12577-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.407613 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.407590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6pjd\" (UniqueName: \"kubernetes.io/projected/bee89f35-320b-464f-a008-6e266da12577-kube-api-access-x6pjd\") pod \"isvc-xgboost-graph-predictor-555fc69d56-hxghh\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.422066 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.422045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:27.467278 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.467249 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerStarted","Data":"98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0"} Jul 01 17:27:27.467415 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.467328 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerStarted","Data":"8143013c7aa96e183c7946d3fe6bddc3ab9ef39d449cbed75a47c836ba1995d2"} Jul 01 17:27:27.505900 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.505871 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:27.520974 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.520945 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:27.635750 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:27.635723 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh"] Jul 01 17:27:27.637617 ip-10-0-129-36 kubenswrapper[2566]: W0701 17:27:27.637594 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee89f35_320b_464f_a008_6e266da12577.slice/crio-d4172c53f630badcdfbab0ba9b174a9058170c82e6b013d1b18cdf0c644b9e9a WatchSource:0}: Error finding container d4172c53f630badcdfbab0ba9b174a9058170c82e6b013d1b18cdf0c644b9e9a: Status 404 returned error can't find the container with id d4172c53f630badcdfbab0ba9b174a9058170c82e6b013d1b18cdf0c644b9e9a Jul 01 17:27:28.290087 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:28.290053 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:28.473210 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:28.473176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerStarted","Data":"1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748"} Jul 01 17:27:28.473361 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:28.473243 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerStarted","Data":"d4172c53f630badcdfbab0ba9b174a9058170c82e6b013d1b18cdf0c644b9e9a"} Jul 01 17:27:31.487388 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:31.487355 2566 generic.go:356] "Generic (PLEG): container finished" podID="654e3775-925a-4880-9245-877bc17515d5" containerID="98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0" exitCode=0 Jul 01 17:27:31.487725 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:31.487426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerDied","Data":"98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0"} Jul 01 17:27:31.488948 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:31.488926 2566 generic.go:356] "Generic (PLEG): container finished" podID="bee89f35-320b-464f-a008-6e266da12577" containerID="1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748" exitCode=0 Jul 01 17:27:31.489075 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:31.489009 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerDied","Data":"1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748"} Jul 01 17:27:36.386725 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:36.386650 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:27:54.625243 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:54.625206 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerStarted","Data":"8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2"} Jul 01 17:27:55.636583 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:55.636543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerStarted","Data":"929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d"} Jul 01 17:27:57.648665 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:57.648629 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerStarted","Data":"719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba"} Jul 01 17:27:57.649184 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:57.648788 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:57.651083 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:57.651056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerStarted","Data":"5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b"} Jul 01 17:27:57.651210 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:57.651107 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:57.669919 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:57.669856 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podStartSLOduration=2.6019214440000002 podStartE2EDuration="31.669835756s" totalImagesPullingTime="25.457318143s" totalInitContainerRuntime="3.610596169s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:27:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:27:57.668748574 +0000 UTC m=+763.399070783" watchObservedRunningTime="2026-07-01 17:27:57.669835756 +0000 UTC m=+763.400157965" Jul 01 17:27:57.688471 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:57.688422 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podStartSLOduration=1.514940029 podStartE2EDuration="30.688403967s" totalImagesPullingTime="25.475558607s" totalInitContainerRuntime="3.697905331s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:27:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:27:57.687424904 +0000 UTC m=+763.417747113" watchObservedRunningTime="2026-07-01 17:27:57.688403967 +0000 UTC m=+763.418726175" Jul 01 17:27:58.656401 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:58.656370 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:27:58.656891 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:58.656436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:27:58.657532 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:58.657503 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:27:58.657682 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:58.657572 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 01 17:27:59.660994 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:59.660942 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 01 17:27:59.661457 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:27:59.661082 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:28:04.665382 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:04.665350 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:28:04.665832 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:04.665533 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:28:04.665832 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:04.665704 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:28:04.666156 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:04.666133 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 01 17:28:14.666511 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:14.666475 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:28:14.666879 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:14.666469 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 01 17:28:24.666385 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:24.666348 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:28:24.666764 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:24.666346 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 01 17:28:34.666575 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:34.666538 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:28:34.667094 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:34.666537 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 01 17:28:44.665929 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:44.665838 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:28:44.666365 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:44.666087 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 01 17:28:46.928130 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:46.928098 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:28:47.211373 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:47.211282 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:28:54.666062 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:54.666008 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:28:54.666741 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:28:54.666724 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:29:01.050959 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:01.050929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:01.171532 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:01.171501 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:01.253575 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:01.253539 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:01.347691 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:01.347594 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:01.428182 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:01.428147 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:01.529424 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:01.529382 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:04.665914 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:04.665873 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 01 17:29:14.666542 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:14.666507 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:29:36.869897 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:36.869864 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:37.039707 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:37.039667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:46.973814 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:46.973771 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:47.101049 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.101010 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:47.118326 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.118293 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8"] Jul 01 17:29:47.118564 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.118538 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" containerID="cri-o://8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2" gracePeriod=30 Jul 01 17:29:47.118639 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.118568 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kube-rbac-proxy" containerID="cri-o://719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba" gracePeriod=30 Jul 01 17:29:47.201920 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.201891 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:47.208465 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.208433 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh"] Jul 01 17:29:47.209024 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.208991 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" containerID="cri-o://929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d" gracePeriod=30 Jul 01 17:29:47.211096 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.209266 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kube-rbac-proxy" containerID="cri-o://5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b" gracePeriod=30 Jul 01 17:29:47.328745 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.328713 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:47.437551 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:47.437519 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:48.123645 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:48.123609 2566 generic.go:356] "Generic (PLEG): container finished" podID="654e3775-925a-4880-9245-877bc17515d5" containerID="719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba" exitCode=2 Jul 01 17:29:48.124047 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:48.123682 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerDied","Data":"719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba"} Jul 01 17:29:48.125572 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:48.125552 2566 generic.go:356] "Generic (PLEG): container finished" podID="bee89f35-320b-464f-a008-6e266da12577" containerID="5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b" exitCode=2 Jul 01 17:29:48.125664 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:48.125584 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerDied","Data":"5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b"} Jul 01 17:29:48.171961 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:48.171933 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:29:49.661725 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:49.661677 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" Jul 01 17:29:49.662144 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:49.661677 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused" Jul 01 17:29:50.951749 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.951724 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:29:50.964742 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.964707 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-kube-rbac-proxy-sar-config\") pod \"bee89f35-320b-464f-a008-6e266da12577\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " Jul 01 17:29:50.964888 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.964765 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-cabundle-cert\") pod \"bee89f35-320b-464f-a008-6e266da12577\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " Jul 01 17:29:50.964888 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.964791 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bee89f35-320b-464f-a008-6e266da12577-proxy-tls\") pod \"bee89f35-320b-464f-a008-6e266da12577\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " Jul 01 17:29:50.964888 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.964860 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bee89f35-320b-464f-a008-6e266da12577-kserve-provision-location\") pod \"bee89f35-320b-464f-a008-6e266da12577\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " Jul 01 17:29:50.965055 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.964895 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6pjd\" (UniqueName: \"kubernetes.io/projected/bee89f35-320b-464f-a008-6e266da12577-kube-api-access-x6pjd\") pod \"bee89f35-320b-464f-a008-6e266da12577\" (UID: \"bee89f35-320b-464f-a008-6e266da12577\") " Jul 01 17:29:50.965110 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.965086 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bee89f35-320b-464f-a008-6e266da12577" (UID: "bee89f35-320b-464f-a008-6e266da12577"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:29:50.965231 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.965201 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bee89f35-320b-464f-a008-6e266da12577-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "bee89f35-320b-464f-a008-6e266da12577" (UID: "bee89f35-320b-464f-a008-6e266da12577"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:29:50.965231 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.965201 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "bee89f35-320b-464f-a008-6e266da12577" (UID: "bee89f35-320b-464f-a008-6e266da12577"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:29:50.965387 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.965290 2566 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:50.966993 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.966970 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bee89f35-320b-464f-a008-6e266da12577-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bee89f35-320b-464f-a008-6e266da12577" (UID: "bee89f35-320b-464f-a008-6e266da12577"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:29:50.967076 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:50.967007 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bee89f35-320b-464f-a008-6e266da12577-kube-api-access-x6pjd" (OuterVolumeSpecName: "kube-api-access-x6pjd") pod "bee89f35-320b-464f-a008-6e266da12577" (UID: "bee89f35-320b-464f-a008-6e266da12577"). InnerVolumeSpecName "kube-api-access-x6pjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:29:51.066388 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.066358 2566 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bee89f35-320b-464f-a008-6e266da12577-cabundle-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:51.066388 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.066384 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bee89f35-320b-464f-a008-6e266da12577-proxy-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:51.066388 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.066392 2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bee89f35-320b-464f-a008-6e266da12577-kserve-provision-location\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:51.066606 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.066401 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6pjd\" (UniqueName: \"kubernetes.io/projected/bee89f35-320b-464f-a008-6e266da12577-kube-api-access-x6pjd\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:51.139674 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.139642 2566 generic.go:356] "Generic (PLEG): container finished" podID="bee89f35-320b-464f-a008-6e266da12577" containerID="929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d" exitCode=0 Jul 01 17:29:51.139851 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.139701 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" Jul 01 17:29:51.139851 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.139718 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerDied","Data":"929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d"} Jul 01 17:29:51.139851 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.139788 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh" event={"ID":"bee89f35-320b-464f-a008-6e266da12577","Type":"ContainerDied","Data":"d4172c53f630badcdfbab0ba9b174a9058170c82e6b013d1b18cdf0c644b9e9a"} Jul 01 17:29:51.139851 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.139825 2566 scope.go:117] "RemoveContainer" containerID="5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b" Jul 01 17:29:51.148940 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.148924 2566 scope.go:117] "RemoveContainer" containerID="929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d" Jul 01 17:29:51.156357 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.156335 2566 scope.go:117] "RemoveContainer" containerID="1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748" Jul 01 17:29:51.161743 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.161717 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh"] Jul 01 17:29:51.164018 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.163996 2566 scope.go:117] "RemoveContainer" containerID="5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b" Jul 01 17:29:51.164318 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:29:51.164299 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b\": container with ID starting with 5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b not found: ID does not exist" containerID="5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b" Jul 01 17:29:51.164387 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.164327 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b"} err="failed to get container status \"5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b\": rpc error: code = NotFound desc = could not find container \"5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b\": container with ID starting with 5017436ba40da42997b44f5e29cf4199356bdd9ea57022d30c47166b04ed7f6b not found: ID does not exist" Jul 01 17:29:51.164387 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.164343 2566 scope.go:117] "RemoveContainer" containerID="929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d" Jul 01 17:29:51.164583 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:29:51.164566 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d\": container with ID starting with 929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d not found: ID does not exist" containerID="929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d" Jul 01 17:29:51.164649 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.164593 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d"} err="failed to get container status \"929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d\": rpc error: code = NotFound desc = could not find container \"929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d\": container with ID starting with 929a8e5aad36bab51972747a07608515ba579390b7bda3775b707c7b6fa6385d not found: ID does not exist" Jul 01 17:29:51.164649 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.164615 2566 scope.go:117] "RemoveContainer" containerID="1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748" Jul 01 17:29:51.164840 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:29:51.164820 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748\": container with ID starting with 1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748 not found: ID does not exist" containerID="1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748" Jul 01 17:29:51.164879 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.164847 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748"} err="failed to get container status \"1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748\": rpc error: code = NotFound desc = could not find container \"1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748\": container with ID starting with 1438091eec8a7daa3fb960594d3fd65ad665aa2d52683771af42e35c83b12748 not found: ID does not exist" Jul 01 17:29:51.165511 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:51.165495 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-hxghh"] Jul 01 17:29:52.060520 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.060497 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:29:52.146426 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.146342 2566 generic.go:356] "Generic (PLEG): container finished" podID="654e3775-925a-4880-9245-877bc17515d5" containerID="8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2" exitCode=0 Jul 01 17:29:52.146426 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.146397 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" Jul 01 17:29:52.146661 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.146431 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerDied","Data":"8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2"} Jul 01 17:29:52.146661 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.146504 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8" event={"ID":"654e3775-925a-4880-9245-877bc17515d5","Type":"ContainerDied","Data":"8143013c7aa96e183c7946d3fe6bddc3ab9ef39d449cbed75a47c836ba1995d2"} Jul 01 17:29:52.146661 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.146542 2566 scope.go:117] "RemoveContainer" containerID="719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba" Jul 01 17:29:52.154402 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.154385 2566 scope.go:117] "RemoveContainer" containerID="8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2" Jul 01 17:29:52.161433 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.161411 2566 scope.go:117] "RemoveContainer" containerID="98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0" Jul 01 17:29:52.168461 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.168446 2566 scope.go:117] "RemoveContainer" containerID="719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba" Jul 01 17:29:52.168686 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:29:52.168663 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba\": container with ID starting with 719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba not found: ID does not exist" containerID="719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba" Jul 01 17:29:52.168735 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.168693 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba"} err="failed to get container status \"719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba\": rpc error: code = NotFound desc = could not find container \"719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba\": container with ID starting with 719f50ea63d22387343ac4b1023bb515d152ec750b9c457c84c5a42fb460faba not found: ID does not exist" Jul 01 17:29:52.168735 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.168710 2566 scope.go:117] "RemoveContainer" containerID="8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2" Jul 01 17:29:52.168937 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:29:52.168919 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2\": container with ID starting with 8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2 not found: ID does not exist" containerID="8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2" Jul 01 17:29:52.169007 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.168947 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2"} err="failed to get container status \"8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2\": rpc error: code = NotFound desc = could not find container \"8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2\": container with ID starting with 8a4b97fe684093d50fc1f15b42e2fa1366713b0418ef6111f7b358d1e5e58bd2 not found: ID does not exist" Jul 01 17:29:52.169007 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.168970 2566 scope.go:117] "RemoveContainer" containerID="98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0" Jul 01 17:29:52.169235 ip-10-0-129-36 kubenswrapper[2566]: E0701 17:29:52.169217 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0\": container with ID starting with 98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0 not found: ID does not exist" containerID="98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0" Jul 01 17:29:52.169277 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.169242 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0"} err="failed to get container status \"98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0\": rpc error: code = NotFound desc = could not find container \"98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0\": container with ID starting with 98e1f786783287ce140b0f1634ab86a7d59a1774ddf321ed0a8801ff10f7e3e0 not found: ID does not exist" Jul 01 17:29:52.176065 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176048 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-kube-rbac-proxy-sar-config\") pod \"654e3775-925a-4880-9245-877bc17515d5\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " Jul 01 17:29:52.176148 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176110 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-cabundle-cert\") pod \"654e3775-925a-4880-9245-877bc17515d5\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " Jul 01 17:29:52.176202 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176154 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/654e3775-925a-4880-9245-877bc17515d5-proxy-tls\") pod \"654e3775-925a-4880-9245-877bc17515d5\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " Jul 01 17:29:52.176202 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176171 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msdqm\" (UniqueName: \"kubernetes.io/projected/654e3775-925a-4880-9245-877bc17515d5-kube-api-access-msdqm\") pod \"654e3775-925a-4880-9245-877bc17515d5\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " Jul 01 17:29:52.176202 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176192 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/654e3775-925a-4880-9245-877bc17515d5-kserve-provision-location\") pod \"654e3775-925a-4880-9245-877bc17515d5\" (UID: \"654e3775-925a-4880-9245-877bc17515d5\") " Jul 01 17:29:52.176451 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176430 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "654e3775-925a-4880-9245-877bc17515d5" (UID: "654e3775-925a-4880-9245-877bc17515d5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:29:52.176518 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176487 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "654e3775-925a-4880-9245-877bc17515d5" (UID: "654e3775-925a-4880-9245-877bc17515d5"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:29:52.176558 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.176529 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/654e3775-925a-4880-9245-877bc17515d5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "654e3775-925a-4880-9245-877bc17515d5" (UID: "654e3775-925a-4880-9245-877bc17515d5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:29:52.178135 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.178109 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/654e3775-925a-4880-9245-877bc17515d5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "654e3775-925a-4880-9245-877bc17515d5" (UID: "654e3775-925a-4880-9245-877bc17515d5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:29:52.178218 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.178156 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654e3775-925a-4880-9245-877bc17515d5-kube-api-access-msdqm" (OuterVolumeSpecName: "kube-api-access-msdqm") pod "654e3775-925a-4880-9245-877bc17515d5" (UID: "654e3775-925a-4880-9245-877bc17515d5"). InnerVolumeSpecName "kube-api-access-msdqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:29:52.277097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.277019 2566 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/654e3775-925a-4880-9245-877bc17515d5-kserve-provision-location\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:52.277097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.277092 2566 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:52.277097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.277105 2566 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/654e3775-925a-4880-9245-877bc17515d5-cabundle-cert\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:52.277319 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.277119 2566 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/654e3775-925a-4880-9245-877bc17515d5-proxy-tls\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:52.277319 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.277129 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msdqm\" (UniqueName: \"kubernetes.io/projected/654e3775-925a-4880-9245-877bc17515d5-kube-api-access-msdqm\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 17:29:52.470595 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.470559 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8"] Jul 01 17:29:52.474199 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.474172 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6474cd55c7-g4tp8"] Jul 01 17:29:52.715461 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.712019 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="654e3775-925a-4880-9245-877bc17515d5" path="/var/lib/kubelet/pods/654e3775-925a-4880-9245-877bc17515d5/volumes" Jul 01 17:29:52.715461 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:52.712764 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bee89f35-320b-464f-a008-6e266da12577" path="/var/lib/kubelet/pods/bee89f35-320b-464f-a008-6e266da12577/volumes" Jul 01 17:29:59.195151 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:29:59.195111 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:30:01.428635 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:30:01.428604 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:30:01.699570 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:30:01.699466 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:30:14.710297 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:30:14.710214 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:30:14.712330 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:30:14.712304 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:30:47.273880 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:30:47.273845 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:30:48.794814 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:30:48.794774 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:31:41.434763 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:31:41.434683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:35:14.738529 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:35:14.738500 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:35:14.743192 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:35:14.743169 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:35:43.761334 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:35:43.761298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:38:16.151496 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:38:16.151460 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:38:17.445256 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:38:17.445210 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:38:55.214707 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:38:55.214658 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:01.835920 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:01.835881 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:01.939298 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:01.939262 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:02.050640 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:02.050607 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:02.123816 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:02.123745 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:02.236077 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:02.236050 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:02.335439 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:02.335408 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:16.262763 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:16.262678 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:16.794593 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:16.794563 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:17.054656 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:17.054625 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:28.211793 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:28.211755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:28.265557 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:28.265523 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:39:33.142544 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:39:33.142508 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:02.012097 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:02.012057 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:02.119464 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:02.119429 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:12.079119 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:12.079085 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:12.187329 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:12.187295 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:12.283915 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:12.283887 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:12.360482 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:12.360404 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:12.545782 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:12.545750 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:12.646225 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:12.646155 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:14.763214 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:14.763180 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:40:14.768723 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:14.768702 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:40:26.538892 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:26.538843 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:40:26.769735 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:40:26.769705 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:41:22.260399 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:41:22.260363 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:41:22.546689 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:41:22.546605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:44:28.994671 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:44:28.994600 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:45:14.788631 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:45:14.788600 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:45:14.796324 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:45:14.796298 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:46:38.373253 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:46:38.373177 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:46:38.432631 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:46:38.432605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:48:41.280510 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:48:41.280480 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:48:41.391971 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:48:41.391943 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:48:41.482613 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:48:41.482580 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:48:41.557776 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:48:41.557742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:48:41.658216 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:48:41.658170 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:48:41.758812 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:48:41.758786 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:48:45.300014 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:48:45.299978 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:36.994376 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:36.994273 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:39.543244 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:39.543213 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:41.474243 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:41.474196 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:41.648215 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:41.648179 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:43.809773 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:43.809740 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:51.560228 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:51.560180 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:51.666479 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:51.666451 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:51.751706 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:51.751679 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:51.824414 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:51.824343 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:51.925102 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:51.925066 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:49:52.026150 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:49:52.026120 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:50:14.815273 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:50:14.815247 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:50:14.824013 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:50:14.823993 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:50:37.230381 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:50:37.230346 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:50:38.249541 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:50:38.249506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:50:51.759570 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:50:51.759540 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:50:53.314342 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:50:53.314300 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:52:08.328136 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:52:08.328099 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:53:05.521010 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:53:05.520916 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:55:14.845016 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:55:14.844984 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:55:14.854320 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:55:14.854289 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 17:59:06.284764 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:59:06.284675 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:59:08.678223 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:59:08.678188 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 17:59:09.104776 ip-10-0-129-36 kubenswrapper[2566]: I0701 17:59:09.104740 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:00:14.875525 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:00:14.875420 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 18:00:14.884626 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:00:14.884608 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 18:04:15.593115 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:04:15.593079 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:14.901259 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:05:14.901144 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 18:05:14.911623 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:05:14.911600 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 18:06:56.526661 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:56.526628 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:06:56.623799 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:56.623761 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:06:56.691867 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:56.691834 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:06:57.505267 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505234 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fh422/must-gather-6nz2z"] Jul 01 18:06:57.505644 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505628 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="storage-initializer" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505646 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="storage-initializer" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505660 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kube-rbac-proxy" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505669 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kube-rbac-proxy" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505686 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505695 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505716 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="storage-initializer" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505723 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="storage-initializer" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505732 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kube-rbac-proxy" Jul 01 18:06:57.505742 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505739 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kube-rbac-proxy" Jul 01 18:06:57.506408 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505762 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" Jul 01 18:06:57.506408 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505771 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" Jul 01 18:06:57.506408 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505850 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kserve-container" Jul 01 18:06:57.506408 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505860 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="654e3775-925a-4880-9245-877bc17515d5" containerName="kube-rbac-proxy" Jul 01 18:06:57.506408 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505876 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kserve-container" Jul 01 18:06:57.506408 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.505886 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bee89f35-320b-464f-a008-6e266da12577" containerName="kube-rbac-proxy" Jul 01 18:06:57.509203 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.509181 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.512499 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.512479 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fh422\"/\"openshift-service-ca.crt\"" Jul 01 18:06:57.514019 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.513988 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fh422\"/\"default-dockercfg-j9225\"" Jul 01 18:06:57.514166 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.513987 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fh422\"/\"kube-root-ca.crt\"" Jul 01 18:06:57.516872 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.516708 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fh422/must-gather-6nz2z"] Jul 01 18:06:57.516996 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.516967 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:06:57.578353 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.578316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6c0edccb-a68e-44d5-88c4-961d28445be4-must-gather-output\") pod \"must-gather-6nz2z\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.578713 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.578360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjs5\" (UniqueName: \"kubernetes.io/projected/6c0edccb-a68e-44d5-88c4-961d28445be4-kube-api-access-xdjs5\") pod \"must-gather-6nz2z\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.616083 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.616021 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:06:57.679108 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.679075 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6c0edccb-a68e-44d5-88c4-961d28445be4-must-gather-output\") pod \"must-gather-6nz2z\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.679249 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.679120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjs5\" (UniqueName: \"kubernetes.io/projected/6c0edccb-a68e-44d5-88c4-961d28445be4-kube-api-access-xdjs5\") pod \"must-gather-6nz2z\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.679415 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.679397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6c0edccb-a68e-44d5-88c4-961d28445be4-must-gather-output\") pod \"must-gather-6nz2z\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.688075 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.688025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjs5\" (UniqueName: \"kubernetes.io/projected/6c0edccb-a68e-44d5-88c4-961d28445be4-kube-api-access-xdjs5\") pod \"must-gather-6nz2z\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.829967 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.829932 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:06:57.953374 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.953350 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fh422/must-gather-6nz2z"] Jul 01 18:06:57.955403 ip-10-0-129-36 kubenswrapper[2566]: W0701 18:06:57.955373 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c0edccb_a68e_44d5_88c4_961d28445be4.slice/crio-d938fa221b2a08106128cd143c96b5431252e64306582ccb5a0bf55cd730a54c WatchSource:0}: Error finding container d938fa221b2a08106128cd143c96b5431252e64306582ccb5a0bf55cd730a54c: Status 404 returned error can't find the container with id d938fa221b2a08106128cd143c96b5431252e64306582ccb5a0bf55cd730a54c Jul 01 18:06:57.957152 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:57.957137 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:06:58.135051 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:06:58.134954 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fh422/must-gather-6nz2z" event={"ID":"6c0edccb-a68e-44d5-88c4-961d28445be4","Type":"ContainerStarted","Data":"d938fa221b2a08106128cd143c96b5431252e64306582ccb5a0bf55cd730a54c"} Jul 01 18:07:05.172450 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:05.172413 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fh422/must-gather-6nz2z" event={"ID":"6c0edccb-a68e-44d5-88c4-961d28445be4","Type":"ContainerStarted","Data":"a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984"} Jul 01 18:07:05.172926 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:05.172459 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fh422/must-gather-6nz2z" event={"ID":"6c0edccb-a68e-44d5-88c4-961d28445be4","Type":"ContainerStarted","Data":"aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a"} Jul 01 18:07:05.189920 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:05.189868 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fh422/must-gather-6nz2z" podStartSLOduration=1.89829217 podStartE2EDuration="8.189854056s" totalImagesPullingTime="6.291561886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:07:05.189712307 +0000 UTC m=+3110.920034517" watchObservedRunningTime="2026-07-01 18:07:05.189854056 +0000 UTC m=+3110.920176259" Jul 01 18:07:28.282547 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:28.282509 2566 generic.go:356] "Generic (PLEG): container finished" podID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerID="aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a" exitCode=0 Jul 01 18:07:28.282953 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:28.282567 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fh422/must-gather-6nz2z" event={"ID":"6c0edccb-a68e-44d5-88c4-961d28445be4","Type":"ContainerDied","Data":"aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a"} Jul 01 18:07:28.282953 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:28.282871 2566 scope.go:117] "RemoveContainer" containerID="aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a" Jul 01 18:07:28.324015 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:28.323978 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fh422_must-gather-6nz2z_6c0edccb-a68e-44d5-88c4-961d28445be4/gather/0.log" Jul 01 18:07:28.806319 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:28.806271 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:07:28.960567 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:28.960536 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:07:29.060131 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:29.060024 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:07:31.837005 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:31.836975 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7bxz7_00db3ae7-3f11-4ad8-8e2a-4a484f552b97/global-pull-secret-syncer/0.log" Jul 01 18:07:31.954292 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:31.954269 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" Jul 01 18:07:32.031552 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:32.031523 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-36.ec2.internal_89149ae4cf017bd46857159b6a684787/haproxy/0.log" Jul 01 18:07:33.785156 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:33.785106 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-fh422/must-gather-6nz2z"] Jul 01 18:07:33.785857 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:33.785346 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-fh422/must-gather-6nz2z" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerName="copy" containerID="cri-o://a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984" gracePeriod=2 Jul 01 18:07:33.787755 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:33.787729 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-fh422/must-gather-6nz2z"] Jul 01 18:07:33.788120 ip-10-0-129-36 kubenswrapper[2566]: E0701 18:07:33.788091 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6nz2z\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fh422\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:07:34.014732 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.014709 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fh422_must-gather-6nz2z_6c0edccb-a68e-44d5-88c4-961d28445be4/copy/0.log" Jul 01 18:07:34.017339 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.017321 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:07:34.019796 ip-10-0-129-36 kubenswrapper[2566]: E0701 18:07:34.019773 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6nz2z\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fh422\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:07:34.106467 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.106435 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdjs5\" (UniqueName: \"kubernetes.io/projected/6c0edccb-a68e-44d5-88c4-961d28445be4-kube-api-access-xdjs5\") pod \"6c0edccb-a68e-44d5-88c4-961d28445be4\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " Jul 01 18:07:34.106646 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.106511 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6c0edccb-a68e-44d5-88c4-961d28445be4-must-gather-output\") pod \"6c0edccb-a68e-44d5-88c4-961d28445be4\" (UID: \"6c0edccb-a68e-44d5-88c4-961d28445be4\") " Jul 01 18:07:34.108131 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.108106 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c0edccb-a68e-44d5-88c4-961d28445be4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "6c0edccb-a68e-44d5-88c4-961d28445be4" (UID: "6c0edccb-a68e-44d5-88c4-961d28445be4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:07:34.108651 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.108623 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0edccb-a68e-44d5-88c4-961d28445be4-kube-api-access-xdjs5" (OuterVolumeSpecName: "kube-api-access-xdjs5") pod "6c0edccb-a68e-44d5-88c4-961d28445be4" (UID: "6c0edccb-a68e-44d5-88c4-961d28445be4"). InnerVolumeSpecName "kube-api-access-xdjs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:07:34.207971 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.207935 2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6c0edccb-a68e-44d5-88c4-961d28445be4-must-gather-output\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 18:07:34.207971 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.207962 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdjs5\" (UniqueName: \"kubernetes.io/projected/6c0edccb-a68e-44d5-88c4-961d28445be4-kube-api-access-xdjs5\") on node \"ip-10-0-129-36.ec2.internal\" DevicePath \"\"" Jul 01 18:07:34.267456 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.267424 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:07:34.308772 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.308749 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fh422_must-gather-6nz2z_6c0edccb-a68e-44d5-88c4-961d28445be4/copy/0.log" Jul 01 18:07:34.309145 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.309122 2566 generic.go:356] "Generic (PLEG): container finished" podID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerID="a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984" exitCode=143 Jul 01 18:07:34.309222 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.309165 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:07:34.309284 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.309224 2566 scope.go:117] "RemoveContainer" containerID="a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984" Jul 01 18:07:34.311743 ip-10-0-129-36 kubenswrapper[2566]: E0701 18:07:34.311716 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6nz2z\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fh422\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:07:34.317329 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.317310 2566 scope.go:117] "RemoveContainer" containerID="aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a" Jul 01 18:07:34.319613 ip-10-0-129-36 kubenswrapper[2566]: E0701 18:07:34.319588 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6nz2z\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fh422\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:07:34.329701 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.329676 2566 scope.go:117] "RemoveContainer" containerID="a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984" Jul 01 18:07:34.329967 ip-10-0-129-36 kubenswrapper[2566]: E0701 18:07:34.329948 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984\": container with ID starting with a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984 not found: ID does not exist" containerID="a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984" Jul 01 18:07:34.330054 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.329980 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984"} err="failed to get container status \"a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984\": rpc error: code = NotFound desc = could not find container \"a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984\": container with ID starting with a01bf2396b98c5332ae60be3c1bb4fe946f3c2d6df917e1d339b56fce4221984 not found: ID does not exist" Jul 01 18:07:34.330054 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.330005 2566 scope.go:117] "RemoveContainer" containerID="aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a" Jul 01 18:07:34.330311 ip-10-0-129-36 kubenswrapper[2566]: E0701 18:07:34.330295 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a\": container with ID starting with aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a not found: ID does not exist" containerID="aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a" Jul 01 18:07:34.330374 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.330320 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a"} err="failed to get container status \"aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a\": rpc error: code = NotFound desc = could not find container \"aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a\": container with ID starting with aef1c0d3337f5be06a9adc8858e977cd033112f04b15994cd9bf544076f3670a not found: ID does not exist" Jul 01 18:07:34.330963 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.330941 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j7vj_557a6a46-5859-48eb-80c7-37341eaa71d1/konnectivity-agent/0.log" limit=1024 Jul 01 18:07:34.709736 ip-10-0-129-36 kubenswrapper[2566]: E0701 18:07:34.709702 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6nz2z\" is forbidden: User \"system:node:ip-10-0-129-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fh422\": no relationship found between node 'ip-10-0-129-36.ec2.internal' and this object" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" pod="openshift-must-gather-fh422/must-gather-6nz2z" Jul 01 18:07:34.710242 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:34.710223 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" path="/var/lib/kubelet/pods/6c0edccb-a68e-44d5-88c4-961d28445be4/volumes" Jul 01 18:07:36.602475 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:36.602443 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-4cgss_176efdf6-5997-42d2-b992-82ac3d3ca59e/cluster-monitoring-operator/0.log" Jul 01 18:07:36.703844 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:36.703817 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f9c6fc89d-kz457_a5e94218-3433-41b3-b6da-517face3f560/metrics-server/0.log" Jul 01 18:07:36.732933 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:36.732903 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-bq7sz_b02aabb7-2f30-4be6-9605-5230826df23e/monitoring-plugin/0.log" Jul 01 18:07:36.843862 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:36.843837 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6gcxx_53e73249-b211-4214-9f21-2675308c0853/node-exporter/0.log" Jul 01 18:07:36.867810 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:36.867749 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6gcxx_53e73249-b211-4214-9f21-2675308c0853/kube-rbac-proxy/0.log" Jul 01 18:07:36.892069 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:36.892026 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6gcxx_53e73249-b211-4214-9f21-2675308c0853/init-textfile/0.log" Jul 01 18:07:37.007562 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.007483 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rmnfm_3007f534-0d67-4fec-95b5-3a8f1d549358/kube-rbac-proxy-main/0.log" Jul 01 18:07:37.028284 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.028260 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rmnfm_3007f534-0d67-4fec-95b5-3a8f1d549358/kube-rbac-proxy-self/0.log" Jul 01 18:07:37.047074 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.047053 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rmnfm_3007f534-0d67-4fec-95b5-3a8f1d549358/openshift-state-metrics/0.log" Jul 01 18:07:37.080527 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.080503 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_559cd3ed-4f4a-431a-83b9-b3d5a90113d5/prometheus/0.log" Jul 01 18:07:37.099246 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.099223 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_559cd3ed-4f4a-431a-83b9-b3d5a90113d5/config-reloader/0.log" Jul 01 18:07:37.119065 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.118994 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_559cd3ed-4f4a-431a-83b9-b3d5a90113d5/thanos-sidecar/0.log" Jul 01 18:07:37.140761 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.140742 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_559cd3ed-4f4a-431a-83b9-b3d5a90113d5/kube-rbac-proxy-web/0.log" Jul 01 18:07:37.159487 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.159464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_559cd3ed-4f4a-431a-83b9-b3d5a90113d5/kube-rbac-proxy/0.log" Jul 01 18:07:37.178959 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.178937 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_559cd3ed-4f4a-431a-83b9-b3d5a90113d5/kube-rbac-proxy-thanos/0.log" Jul 01 18:07:37.203609 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.203584 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_559cd3ed-4f4a-431a-83b9-b3d5a90113d5/init-config-reloader/0.log" Jul 01 18:07:37.284368 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.284327 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-4fxhl_866ffd74-cec9-4ace-9e81-4b16286665d9/prometheus-operator-admission-webhook/0.log" Jul 01 18:07:37.312346 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.312320 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b7958654c-n7gks_cbf7dd61-4989-43e3-a4bf-69fbad5b91d4/telemeter-client/0.log" Jul 01 18:07:37.331679 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.331653 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b7958654c-n7gks_cbf7dd61-4989-43e3-a4bf-69fbad5b91d4/reload/0.log" Jul 01 18:07:37.353925 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.353899 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b7958654c-n7gks_cbf7dd61-4989-43e3-a4bf-69fbad5b91d4/kube-rbac-proxy/0.log" Jul 01 18:07:37.387674 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.387609 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/thanos-query/0.log" Jul 01 18:07:37.406278 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.406242 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy-web/0.log" Jul 01 18:07:37.424757 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.424740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy/0.log" Jul 01 18:07:37.443730 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.443707 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/prom-label-proxy/0.log" Jul 01 18:07:37.463741 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.463719 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy-rules/0.log" Jul 01 18:07:37.481586 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:37.481566 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc5fc86c-zln8l_d02f51f1-f0e7-44c5-a7de-3084747ffc2f/kube-rbac-proxy-metrics/0.log" Jul 01 18:07:40.335971 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.335934 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9"] Jul 01 18:07:40.336428 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.336298 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerName="copy" Jul 01 18:07:40.336428 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.336310 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerName="copy" Jul 01 18:07:40.336428 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.336330 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerName="gather" Jul 01 18:07:40.336428 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.336336 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerName="gather" Jul 01 18:07:40.336428 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.336388 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerName="gather" Jul 01 18:07:40.336428 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.336401 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0edccb-a68e-44d5-88c4-961d28445be4" containerName="copy" Jul 01 18:07:40.341779 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.341759 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.344683 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.344664 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wz8\"/\"openshift-service-ca.crt\"" Jul 01 18:07:40.344799 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.344734 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wz8\"/\"kube-root-ca.crt\"" Jul 01 18:07:40.346212 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.346192 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-49wz8\"/\"default-dockercfg-9fgpq\"" Jul 01 18:07:40.348189 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.348168 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9"] Jul 01 18:07:40.358942 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.358920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lsxh\" (UniqueName: \"kubernetes.io/projected/3ffd9b78-7f00-4243-bb91-bb9ae487448e-kube-api-access-2lsxh\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.359079 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.358953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-lib-modules\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.359079 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.358977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-proc\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.359202 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.359094 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-sys\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.359202 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.359122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-podres\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460268 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lsxh\" (UniqueName: \"kubernetes.io/projected/3ffd9b78-7f00-4243-bb91-bb9ae487448e-kube-api-access-2lsxh\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460268 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460269 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-lib-modules\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460505 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-proc\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460505 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460422 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-proc\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460505 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-sys\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460505 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460392 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-lib-modules\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460505 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460472 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-podres\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460505 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460481 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-sys\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.460706 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.460549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ffd9b78-7f00-4243-bb91-bb9ae487448e-podres\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.468479 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.468457 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lsxh\" (UniqueName: \"kubernetes.io/projected/3ffd9b78-7f00-4243-bb91-bb9ae487448e-kube-api-access-2lsxh\") pod \"perf-node-gather-daemonset-xgtg9\" (UID: \"3ffd9b78-7f00-4243-bb91-bb9ae487448e\") " pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.652519 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.652430 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:40.778654 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:40.778628 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9"] Jul 01 18:07:40.780546 ip-10-0-129-36 kubenswrapper[2566]: W0701 18:07:40.780519 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ffd9b78_7f00_4243_bb91_bb9ae487448e.slice/crio-f1e3006f7ac93c040b76b6fe2388e80bbce0401d8637fa3fa6d64f3633d01977 WatchSource:0}: Error finding container f1e3006f7ac93c040b76b6fe2388e80bbce0401d8637fa3fa6d64f3633d01977: Status 404 returned error can't find the container with id f1e3006f7ac93c040b76b6fe2388e80bbce0401d8637fa3fa6d64f3633d01977 Jul 01 18:07:41.054357 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.054332 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdmx6_a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e/dns/0.log" Jul 01 18:07:41.072003 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.071979 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdmx6_a3a1bef4-8963-4ae7-94cc-d15fd4d7bc4e/kube-rbac-proxy/0.log" Jul 01 18:07:41.092078 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.092054 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2777j_e3ca5874-cebc-4b61-af4e-1e60f7537a45/dns-node-resolver/0.log" Jul 01 18:07:41.342089 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.341980 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" event={"ID":"3ffd9b78-7f00-4243-bb91-bb9ae487448e","Type":"ContainerStarted","Data":"1a6861dbf454418430098738435a40740268f662e5b9ff848eb0e4edde6ae1d3"} Jul 01 18:07:41.342089 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.342043 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" event={"ID":"3ffd9b78-7f00-4243-bb91-bb9ae487448e","Type":"ContainerStarted","Data":"f1e3006f7ac93c040b76b6fe2388e80bbce0401d8637fa3fa6d64f3633d01977"} Jul 01 18:07:41.342509 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.342168 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:41.359390 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.359345 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" podStartSLOduration=1.359331714 podStartE2EDuration="1.359331714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:07:41.358353384 +0000 UTC m=+3147.088675593" watchObservedRunningTime="2026-07-01 18:07:41.359331714 +0000 UTC m=+3147.089653921" Jul 01 18:07:41.603308 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:41.603229 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bh6mg_135aec59-03b2-4348-9134-5fd5c62cc137/node-ca/0.log" Jul 01 18:07:42.752196 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:42.752170 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5g4lc_f0e11878-5c46-44db-be7b-98cf985e634d/serve-healthcheck-canary/0.log" Jul 01 18:07:43.161988 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:43.161955 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-zxml7_c01bd920-04dd-4dca-84b5-e6c8880e3091/insights-operator/0.log" Jul 01 18:07:43.163447 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:43.163410 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-zxml7_c01bd920-04dd-4dca-84b5-e6c8880e3091/insights-operator/1.log" Jul 01 18:07:43.188016 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:43.187987 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ljck_df8c7f6e-b2e4-46b6-beba-c9facdbc8e90/kube-rbac-proxy/0.log" Jul 01 18:07:43.207617 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:43.207598 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ljck_df8c7f6e-b2e4-46b6-beba-c9facdbc8e90/exporter/0.log" Jul 01 18:07:43.226255 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:43.226230 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ljck_df8c7f6e-b2e4-46b6-beba-c9facdbc8e90/extractor/0.log" Jul 01 18:07:45.377400 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:45.377363 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-g8kzs_8af7cc7e-02f4-49eb-ad52-fd64a8cc94c5/manager/0.log" Jul 01 18:07:45.536222 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:45.536194 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-tpdfm_c5e7d312-fd38-4586-bce7-1171ea611273/s3-init/0.log" Jul 01 18:07:45.549308 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:45.549283 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-tpdfm_c5e7d312-fd38-4586-bce7-1171ea611273/download-hf-model/0.log" Jul 01 18:07:47.355659 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:47.355634 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-49wz8/perf-node-gather-daemonset-xgtg9" Jul 01 18:07:49.264775 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:49.264740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-bsvrv_dd6867e4-c818-4c6f-a88d-faf57990cc23/migrator/0.log" Jul 01 18:07:49.289701 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:49.289676 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-bsvrv_dd6867e4-c818-4c6f-a88d-faf57990cc23/graceful-termination/0.log" Jul 01 18:07:50.733550 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:50.733522 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8nks_65beb9bf-9a21-42b9-8a07-78a2056f2a69/kube-multus-additional-cni-plugins/0.log" Jul 01 18:07:50.752819 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:50.752789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8nks_65beb9bf-9a21-42b9-8a07-78a2056f2a69/egress-router-binary-copy/0.log" Jul 01 18:07:50.770226 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:50.770203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8nks_65beb9bf-9a21-42b9-8a07-78a2056f2a69/cni-plugins/0.log" Jul 01 18:07:50.788781 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:50.788759 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8nks_65beb9bf-9a21-42b9-8a07-78a2056f2a69/bond-cni-plugin/0.log" Jul 01 18:07:50.805639 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:50.805617 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8nks_65beb9bf-9a21-42b9-8a07-78a2056f2a69/routeoverride-cni/0.log" Jul 01 18:07:50.822781 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:50.822762 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8nks_65beb9bf-9a21-42b9-8a07-78a2056f2a69/whereabouts-cni-bincopy/0.log" Jul 01 18:07:50.840762 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:50.840736 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8nks_65beb9bf-9a21-42b9-8a07-78a2056f2a69/whereabouts-cni/0.log" Jul 01 18:07:51.032096 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.031947 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nzb4x_a675bfef-5893-42a0-a512-57a99525fad2/kube-multus/0.log" Jul 01 18:07:51.136498 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.136470 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sjvp6_111da01d-53a9-42e6-abe2-34fbffd31333/network-metrics-daemon/0.log" Jul 01 18:07:51.154350 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.154320 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sjvp6_111da01d-53a9-42e6-abe2-34fbffd31333/kube-rbac-proxy/0.log" Jul 01 18:07:51.893077 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.893021 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-controller/0.log" Jul 01 18:07:51.909334 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.909308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/1.log" Jul 01 18:07:51.909497 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.909371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovn-acl-logging/0.log" Jul 01 18:07:51.933146 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.933122 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/kube-rbac-proxy-node/0.log" Jul 01 18:07:51.950680 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.950659 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 18:07:51.967307 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.967282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/northd/0.log" Jul 01 18:07:51.984414 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:51.984353 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/nbdb/0.log" Jul 01 18:07:52.000428 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:52.000406 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/sbdb/0.log" Jul 01 18:07:52.035153 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:52.035128 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bltzn_13b24819-945c-45e3-96d9-f1ed546fb00d/ovnkube-controller/0.log" Jul 01 18:07:53.409513 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:53.409484 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tnj7f_1781a910-62f2-436b-8b03-637048b12be6/network-check-target-container/0.log" Jul 01 18:07:54.282753 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:54.282727 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wsg8p_99540372-1d60-4570-9a6d-0651d17c939e/iptables-alerter/0.log" Jul 01 18:07:54.874366 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:54.874335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9f9hj_def04042-a611-4c77-8aa2-d531743ab9f4/tuned/0.log" Jul 01 18:07:56.601298 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:56.601268 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9ddc5ff76-nmsxx_6918627f-867c-45b0-8e5d-051559046a85/cluster-samples-operator/0.log" Jul 01 18:07:56.615693 ip-10-0-129-36 kubenswrapper[2566]: I0701 18:07:56.615666 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9ddc5ff76-nmsxx_6918627f-867c-45b0-8e5d-051559046a85/cluster-samples-operator-watch/0.log"