Jul 28 17:59:39.454998 ip-10-0-140-220 systemd[1]: Starting Kubernetes Kubelet... Jul 28 17:59:39.907511 ip-10-0-140-220 kubenswrapper[2531]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:59:39.907511 ip-10-0-140-220 kubenswrapper[2531]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 17:59:39.907511 ip-10-0-140-220 kubenswrapper[2531]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:59:39.907511 ip-10-0-140-220 kubenswrapper[2531]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 17:59:39.907511 ip-10-0-140-220 kubenswrapper[2531]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:59:39.909703 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.909536 2531 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 17:59:39.913475 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913458 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:39.913475 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913475 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913480 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913483 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913486 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913489 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913492 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913494 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913497 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913500 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913502 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913505 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913508 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913511 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913514 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913517 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913521 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913523 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913526 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913528 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913531 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:39.913541 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913534 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913537 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913540 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913543 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913545 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913549 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913551 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913554 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913557 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913561 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913565 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913568 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913571 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913574 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913577 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913580 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913584 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913588 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913590 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:39.914025 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913593 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913596 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913598 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913600 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913603 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913605 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913608 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913610 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913612 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913616 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913619 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913622 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913625 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913628 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913631 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913634 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913637 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913639 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913642 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:39.914487 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913645 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913647 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913650 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913652 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913656 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913658 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913661 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913663 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913666 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913668 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913686 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913691 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913695 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913699 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913703 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913707 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913710 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913713 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913715 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913718 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:39.914969 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913720 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913723 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913727 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913729 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913732 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913734 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913737 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913740 2531 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913742 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913744 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913747 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913750 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913752 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913755 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913757 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913759 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913762 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913764 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913766 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:39.915451 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.913769 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914489 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914495 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914498 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914500 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914503 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914506 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914509 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914513 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914515 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914518 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914520 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914523 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914526 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914529 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914532 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914534 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914537 2531 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914540 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:39.915967 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914543 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914546 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914548 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914551 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914553 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914556 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914558 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914561 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914563 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914566 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914568 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914571 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914573 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914576 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914578 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914580 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914583 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914587 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914591 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:39.916434 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914594 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914597 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914599 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914602 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914604 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914607 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914609 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914612 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914614 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914617 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914620 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914623 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914626 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914629 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914632 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914634 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914637 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914639 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914642 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914645 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:39.916924 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914647 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914649 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914652 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914654 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914658 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914661 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914664 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914666 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914669 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914688 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914691 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914694 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914696 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914698 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914701 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914704 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914707 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914709 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914712 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914714 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:39.917421 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914716 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914722 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914724 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914727 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914730 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914733 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914735 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914738 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914740 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914743 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914745 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914748 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914751 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914753 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914755 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914758 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914762 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914765 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914768 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:39.917919 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914771 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914773 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.914776 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915190 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915194 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915197 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915199 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915202 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915205 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915207 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915210 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915213 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915215 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915218 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915221 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915223 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915226 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915229 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915231 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915234 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:39.918370 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915236 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915239 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915241 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915244 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915246 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915249 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915251 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915253 2531 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915256 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915258 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915261 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915263 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915265 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915268 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915270 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915273 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915275 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915278 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915280 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915283 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:39.918859 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915286 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915288 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915291 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915293 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915296 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915299 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915301 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915304 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915306 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915310 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915313 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915315 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915318 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915320 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915323 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915325 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915327 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915330 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915332 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915335 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:39.919345 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915338 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915340 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915343 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915345 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915347 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915350 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915352 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915355 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915357 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915359 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915362 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915364 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915366 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915369 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915372 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915374 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915377 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915380 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915382 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915385 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:39.919852 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915387 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915390 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915392 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915395 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915397 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915399 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915403 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915407 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915410 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915413 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915415 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915418 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915421 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915424 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915426 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915429 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915431 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915433 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:39.920352 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915437 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915440 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915443 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.915446 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915520 2531 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915527 2531 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915534 2531 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915539 2531 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915544 2531 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915548 2531 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915552 2531 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915557 2531 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915560 2531 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915563 2531 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915566 2531 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915570 2531 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915573 2531 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915576 2531 flags.go:64] FLAG: --cgroup-root="" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915579 2531 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915582 2531 flags.go:64] FLAG: --client-ca-file="" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915585 2531 flags.go:64] FLAG: --cloud-provider="external" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915588 2531 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915592 2531 flags.go:64] FLAG: --cluster-domain="" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915594 2531 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 17:59:39.920847 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915597 2531 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915601 2531 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915604 2531 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915608 2531 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915611 2531 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915614 2531 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915617 2531 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915620 2531 flags.go:64] FLAG: --contention-profiling="false" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915623 2531 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915626 2531 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915629 2531 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915632 2531 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915637 2531 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915640 2531 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915642 2531 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915645 2531 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915651 2531 flags.go:64] FLAG: --enable-server="true" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915655 2531 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915660 2531 flags.go:64] FLAG: --event-burst="100" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915663 2531 flags.go:64] FLAG: --event-qps="50" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915666 2531 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915669 2531 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915685 2531 flags.go:64] FLAG: --eviction-hard="" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915691 2531 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 17:59:39.921421 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915695 2531 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915698 2531 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915701 2531 flags.go:64] FLAG: --eviction-soft="" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915704 2531 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915706 2531 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915709 2531 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915712 2531 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915715 2531 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915718 2531 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915721 2531 flags.go:64] FLAG: --feature-gates="" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915724 2531 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915727 2531 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915730 2531 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915733 2531 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915736 2531 flags.go:64] FLAG: --healthz-port="10248" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915739 2531 flags.go:64] FLAG: --help="false" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915742 2531 flags.go:64] FLAG: --hostname-override="ip-10-0-140-220.ec2.internal" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915745 2531 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915748 2531 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915750 2531 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915754 2531 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915757 2531 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915760 2531 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 17:59:39.922011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915762 2531 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915767 2531 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915770 2531 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915773 2531 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915776 2531 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915779 2531 flags.go:64] FLAG: --kube-reserved="" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915782 2531 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915785 2531 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915789 2531 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915792 2531 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915795 2531 flags.go:64] FLAG: --lock-file="" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915797 2531 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915800 2531 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915803 2531 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915808 2531 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915811 2531 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915814 2531 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915817 2531 flags.go:64] FLAG: --logging-format="text" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915820 2531 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915823 2531 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915826 2531 flags.go:64] FLAG: --manifest-url="" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915828 2531 flags.go:64] FLAG: --manifest-url-header="" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915833 2531 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915836 2531 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915840 2531 flags.go:64] FLAG: --max-pods="110" Jul 28 17:59:39.922590 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915843 2531 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915846 2531 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915849 2531 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915852 2531 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915855 2531 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915858 2531 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915877 2531 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915886 2531 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915891 2531 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915895 2531 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915898 2531 flags.go:64] FLAG: --pod-cidr="" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915902 2531 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915908 2531 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915911 2531 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915913 2531 flags.go:64] FLAG: --pods-per-core="0" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915917 2531 flags.go:64] FLAG: --port="10250" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915921 2531 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915923 2531 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-015f0b55fd8614f49" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915927 2531 flags.go:64] FLAG: --qos-reserved="" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915930 2531 flags.go:64] FLAG: --read-only-port="10255" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915932 2531 flags.go:64] FLAG: --register-node="true" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915935 2531 flags.go:64] FLAG: --register-with-taints="" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915939 2531 flags.go:64] FLAG: --registry-burst="10" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915942 2531 flags.go:64] FLAG: --registry-qps="5" Jul 28 17:59:39.923311 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915945 2531 flags.go:64] FLAG: --reserved-cpus="" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915947 2531 flags.go:64] FLAG: --reserved-memory="" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915951 2531 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915954 2531 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915957 2531 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915960 2531 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915963 2531 flags.go:64] FLAG: --runonce="false" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915965 2531 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915968 2531 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915971 2531 flags.go:64] FLAG: --seccomp-default="false" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915975 2531 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915977 2531 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915981 2531 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915984 2531 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915987 2531 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915989 2531 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915992 2531 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915996 2531 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.915998 2531 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916001 2531 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916005 2531 flags.go:64] FLAG: --system-cgroups="" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916007 2531 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916013 2531 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916017 2531 flags.go:64] FLAG: --tls-cert-file="" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916019 2531 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 17:59:39.923922 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916023 2531 flags.go:64] FLAG: --tls-min-version="" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916026 2531 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916029 2531 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916032 2531 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916035 2531 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916037 2531 flags.go:64] FLAG: --v="2" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916041 2531 flags.go:64] FLAG: --version="false" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916046 2531 flags.go:64] FLAG: --vmodule="" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916049 2531 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916052 2531 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916173 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916176 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916180 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916183 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916186 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916188 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916191 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916193 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916195 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916198 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916200 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916202 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:39.924579 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916205 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916207 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916210 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916213 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916215 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916218 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916221 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916224 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916229 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916231 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916236 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916239 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916242 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916245 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916249 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916253 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916256 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916258 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916261 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:39.925220 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916263 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916266 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916268 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916271 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916273 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916275 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916278 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916280 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916283 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916285 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916288 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916290 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916293 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916295 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916297 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916300 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916302 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916305 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916307 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916310 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:39.925705 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916313 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916317 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916319 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916322 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916324 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916327 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916329 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916333 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916336 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916339 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916342 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916345 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916347 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916350 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916353 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916355 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916358 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916360 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916363 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:39.926197 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916365 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916368 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916371 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916373 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916375 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916378 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916380 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916382 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916385 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916388 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916390 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916392 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916395 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916398 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916402 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916404 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916407 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916409 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916412 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916414 2531 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:39.926646 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916417 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916419 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916421 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916424 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916426 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916429 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916431 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916434 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.916437 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.916988 2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.924084 2531 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.924099 2531 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.924118 2531 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.924123 2531 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924198 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:39.927143 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924203 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924206 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924210 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924213 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924216 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924218 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924221 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924224 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924226 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924229 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924231 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924235 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924237 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924240 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924245 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924249 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924252 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924255 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924258 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924260 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:39.927509 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924275 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924279 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924282 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924285 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924289 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924293 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924296 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924300 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924305 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924310 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924315 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924319 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924322 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924325 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924328 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924331 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924334 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924337 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924339 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:39.928010 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924342 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924344 2531 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924347 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924350 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924353 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924356 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924360 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924362 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924365 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924368 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924370 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924372 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924375 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924378 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924381 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924383 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924386 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924388 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924391 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924394 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:39.928464 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924396 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924399 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924401 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924404 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924407 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924409 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924412 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924414 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924417 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924419 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924421 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924423 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924426 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924428 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924431 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924433 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924435 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924438 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924441 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924443 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:39.929048 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924446 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924450 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924453 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924455 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924458 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924461 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924463 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924466 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924468 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924471 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924474 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924476 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924479 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924481 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924483 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924486 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924489 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924491 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:39.929527 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924494 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.924498 2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924614 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924618 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924621 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924623 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924626 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924629 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924631 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924633 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924636 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924638 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924641 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924644 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:39.930001 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924646 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924651 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924655 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924657 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924660 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924663 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924666 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924669 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924689 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924693 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924697 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924712 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924715 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924717 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924720 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924723 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924725 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924728 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924730 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924733 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:39.930347 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924735 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924738 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924740 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924743 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924745 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924748 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924750 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924752 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924755 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924757 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924760 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924762 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924767 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924770 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924772 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924774 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924777 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924779 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924782 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924785 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:39.930870 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924787 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924790 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924792 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924794 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924797 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924800 2531 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924802 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924804 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924807 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924809 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924812 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924814 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924816 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924819 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924821 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924824 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924826 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924829 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924831 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924834 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:39.931346 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924836 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924839 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924841 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924843 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924846 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924848 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924851 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924854 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924857 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924860 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924864 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924867 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924870 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924873 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924875 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924878 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924881 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924884 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924887 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924890 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:39.931856 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924892 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924895 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924897 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924899 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924902 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924905 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:39.924907 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.924912 2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.925036 2531 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.926984 2531 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.928338 2531 server.go:1019] "Starting client certificate rotation" Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.928446 2531 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.928482 2531 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:59:39.932322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.930918 2531 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:59:39.935332 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.935303 2531 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:59:39.945707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.945688 2531 log.go:25] "Validated CRI v1 runtime API" Jul 28 17:59:39.948897 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.948877 2531 log.go:25] "Validated CRI v1 image API" Jul 28 17:59:39.949862 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.949846 2531 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 17:59:39.954002 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.953979 2531 fs.go:135] Filesystem UUIDs: map[0f95dc22-1e20-4134-9a6d-877145a3b158:/dev/nvme0n1p4 631e2dda-d65a-4726-b420-ff8a06f1c66b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 28 17:59:39.954076 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.954001 2531 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 17:59:39.959319 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.959188 2531 manager.go:216] Machine: {Timestamp:2026-07-28 17:59:39.957783545 +0000 UTC m=+0.365801392 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098562 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2661a2016acf6d4d0dab72d2879416 SystemUUID:ec2661a2-016a-cf6d-4d0d-ab72d2879416 BootID:3fd3a9c4-ba1a-443e-a29e-c2e80e3092e1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7d:b8:f2:35:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7d:b8:f2:35:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:95:5c:61:7a:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 17:59:39.959319 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.959307 2531 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 17:59:39.959478 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.959428 2531 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 17:59:39.962422 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.962394 2531 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 17:59:39.962572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.962424 2531 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 17:59:39.962738 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.962720 2531 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:59:39.963315 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.963305 2531 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 17:59:39.963352 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.963318 2531 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 17:59:39.963352 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.963326 2531 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:59:39.963352 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.963341 2531 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:59:39.964619 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.964607 2531 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 17:59:39.967157 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967145 2531 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:59:39.967269 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967260 2531 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 17:59:39.967310 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967289 2531 kubelet.go:486] "Attempting to sync node with API server" Jul 28 17:59:39.967310 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967300 2531 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 17:59:39.967389 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967314 2531 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 17:59:39.967389 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967323 2531 kubelet.go:398] "Adding apiserver pod source" Jul 28 17:59:39.967389 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967332 2531 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 17:59:39.967655 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967643 2531 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:59:39.967712 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.967688 2531 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:59:39.969961 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.969934 2531 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 17:59:39.971400 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.971385 2531 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 17:59:39.971463 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.971416 2531 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 17:59:39.972489 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972478 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 17:59:39.972523 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972493 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 17:59:39.972523 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972500 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 17:59:39.972523 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972505 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 17:59:39.972523 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972513 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 17:59:39.972523 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972518 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972526 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972531 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972537 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972542 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972550 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972556 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972586 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 17:59:39.972707 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.972593 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 17:59:39.976212 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.976189 2531 server.go:1268] "Started kubelet" Jul 28 17:59:39.976434 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.976402 2531 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 17:59:39.976987 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.976924 2531 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 17:59:39.977152 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.977123 2531 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 17:59:39.977790 ip-10-0-140-220 systemd[1]: Started Kubernetes Kubelet. Jul 28 17:59:39.978943 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.978908 2531 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 17:59:39.981857 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.981836 2531 server.go:310] "Adding debug handlers to kubelet server" Jul 28 17:59:39.982159 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:39.982127 2531 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 17:59:39.982283 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.982267 2531 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 17:59:39.982361 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:39.982320 2531 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 17:59:39.982789 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:39.982767 2531 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 17:59:39.985872 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:39.984341 2531 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-220.ec2.internal.18c685f2c1a18720 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-220.ec2.internal,UID:ip-10-0-140-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-220.ec2.internal,},FirstTimestamp:2026-07-28 17:59:39.976148768 +0000 UTC m=+0.384166616,LastTimestamp:2026-07-28 17:59:39.976148768 +0000 UTC m=+0.384166616,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-220.ec2.internal,}" Jul 28 17:59:39.987535 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.987515 2531 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 17:59:39.987535 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.987532 2531 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 17:59:39.987770 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:39.987745 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:39.988118 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.988103 2531 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 17:59:39.988201 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.988112 2531 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 17:59:39.988288 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.988279 2531 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 17:59:39.988454 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.988438 2531 reconstruct.go:97] "Volume reconstruction finished" Jul 28 17:59:39.988454 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.988454 2531 reconciler.go:29] "Reconciler: start to sync state" Jul 28 17:59:39.990165 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990145 2531 factory.go:55] Registering systemd factory Jul 28 17:59:39.990165 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990166 2531 factory.go:223] Registration of the systemd container factory successfully Jul 28 17:59:39.990378 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990365 2531 factory.go:153] Registering CRI-O factory Jul 28 17:59:39.990438 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990381 2531 factory.go:223] Registration of the crio container factory successfully Jul 28 17:59:39.990438 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990431 2531 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 17:59:39.990520 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990457 2531 factory.go:103] Registering Raw factory Jul 28 17:59:39.990520 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990468 2531 manager.go:1196] Started watching for new ooms in manager Jul 28 17:59:39.990923 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:39.990906 2531 manager.go:349] Starting recovery of all containers Jul 28 17:59:40.000341 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.000309 2531 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 17:59:40.000786 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.000758 2531 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 17:59:40.002701 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.002668 2531 manager.go:354] Recovery completed Jul 28 17:59:40.007887 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.007867 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:40.009750 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.009728 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:40.009840 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.009761 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:40.009840 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.009775 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:40.010356 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.010341 2531 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 17:59:40.010356 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.010354 2531 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 17:59:40.010356 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.010356 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:40.010506 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.010369 2531 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:59:40.011010 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.010994 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:40.011075 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.011024 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:40.011075 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.011034 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:40.012088 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.012076 2531 policy_none.go:49] "None policy: Start" Jul 28 17:59:40.012088 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.012091 2531 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 17:59:40.012189 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.012102 2531 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 17:59:40.013009 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.012999 2531 policy_none.go:47] "Start" Jul 28 17:59:40.020370 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.020346 2531 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b5slt" Jul 28 17:59:40.021814 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.021739 2531 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-220.ec2.internal.18c685f2c3a2320b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-220.ec2.internal,UID:ip-10-0-140-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-220.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-220.ec2.internal,},FirstTimestamp:2026-07-28 17:59:40.009746955 +0000 UTC m=+0.417764804,LastTimestamp:2026-07-28 17:59:40.009746955 +0000 UTC m=+0.417764804,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-220.ec2.internal,}" Jul 28 17:59:40.029853 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.029832 2531 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b5slt" Jul 28 17:59:40.030516 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.030440 2531 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-220.ec2.internal.18c685f2c3a280c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-220.ec2.internal,UID:ip-10-0-140-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-220.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-220.ec2.internal,},FirstTimestamp:2026-07-28 17:59:40.009767109 +0000 UTC m=+0.417784960,LastTimestamp:2026-07-28 17:59:40.009767109 +0000 UTC m=+0.417784960,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-220.ec2.internal,}" Jul 28 17:59:40.047526 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.047312 2531 manager.go:337] "Starting Device Plugin manager" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.047561 2531 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.047577 2531 server.go:87] "Starting device plugin registration server" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.047868 2531 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.047879 2531 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.047972 2531 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.048052 2531 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.048060 2531 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.048711 2531 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.048758 2531 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.057544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.057360 2531 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 17:59:40.058605 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.058589 2531 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 17:59:40.058701 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.058632 2531 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 17:59:40.058701 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.058656 2531 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 17:59:40.058799 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.058713 2531 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 17:59:40.061011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.060992 2531 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:59:40.148259 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.148225 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:40.150028 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.150012 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:40.150104 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.150044 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:40.150104 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.150055 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:40.150104 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.150079 2531 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.159175 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.159118 2531 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal"] Jul 28 17:59:40.159237 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.159179 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:40.160156 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.160141 2531 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.160198 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.160165 2531 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-220.ec2.internal\": node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.160765 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.160749 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:40.160852 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.160782 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:40.160852 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.160796 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:40.161974 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.161959 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:40.162084 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162069 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.162132 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162111 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:40.162738 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162724 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:40.162738 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162730 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:40.162834 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162749 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:40.162834 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162750 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:40.162834 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162769 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:40.162834 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.162759 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:40.164059 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.164041 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.164151 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.164066 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:40.164953 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.164803 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:40.164953 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.164835 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:40.164953 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.164848 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:40.188657 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.188623 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/923ffe0ad7855c90d360d5355866467b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-220.ec2.internal\" (UID: \"923ffe0ad7855c90d360d5355866467b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.188791 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.188660 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9eebf97683721fc5d0fbbff1032d28d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"9eebf97683721fc5d0fbbff1032d28d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.188791 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.188697 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eebf97683721fc5d0fbbff1032d28d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"9eebf97683721fc5d0fbbff1032d28d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.190441 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.190423 2531 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-220.ec2.internal\" not found" node="ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.191549 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.191529 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.194787 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.194770 2531 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-220.ec2.internal\" not found" node="ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.289060 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.289022 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9eebf97683721fc5d0fbbff1032d28d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"9eebf97683721fc5d0fbbff1032d28d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.289060 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.289054 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eebf97683721fc5d0fbbff1032d28d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"9eebf97683721fc5d0fbbff1032d28d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.289060 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.289073 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/923ffe0ad7855c90d360d5355866467b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-220.ec2.internal\" (UID: \"923ffe0ad7855c90d360d5355866467b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.289322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.289106 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9eebf97683721fc5d0fbbff1032d28d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"9eebf97683721fc5d0fbbff1032d28d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.289322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.289125 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eebf97683721fc5d0fbbff1032d28d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"9eebf97683721fc5d0fbbff1032d28d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.289322 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.289128 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/923ffe0ad7855c90d360d5355866467b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-220.ec2.internal\" (UID: \"923ffe0ad7855c90d360d5355866467b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.292296 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.292276 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.393326 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.393296 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.494070 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.493977 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.494070 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.494010 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.498636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.498459 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 28 17:59:40.594632 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.594587 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.695139 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.695106 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.795808 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.795716 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.896333 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:40.896297 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 28 17:59:40.928512 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.928473 2531 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 17:59:40.928980 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.928697 2531 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:59:40.993826 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.993799 2531 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:59:40.998009 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:40.997982 2531 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:59:41.032243 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.032191 2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:54:41 +0000 UTC" deadline="2028-03-03 14:17:12.034178475 +0000 UTC" Jul 28 17:59:41.032243 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.032239 2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14012h17m31.001943013s" Jul 28 17:59:41.088011 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.087933 2531 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 28 17:59:41.090407 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.090386 2531 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:59:41.103225 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.103204 2531 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:59:41.104272 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.104257 2531 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 28 17:59:41.114294 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.114271 2531 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:59:41.125982 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:41.125948 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eebf97683721fc5d0fbbff1032d28d2.slice/crio-d20a9a6bc47b24a05f199e1b0722af75e96ebb7ea7404e8640801d522a2bbd9b WatchSource:0}: Error finding container d20a9a6bc47b24a05f199e1b0722af75e96ebb7ea7404e8640801d522a2bbd9b: Status 404 returned error can't find the container with id d20a9a6bc47b24a05f199e1b0722af75e96ebb7ea7404e8640801d522a2bbd9b Jul 28 17:59:41.126724 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:41.126698 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923ffe0ad7855c90d360d5355866467b.slice/crio-9bffbf5cd5ecc6719d33c03e8ca81f5a39f6f42539a48b043cc5cf78f659b744 WatchSource:0}: Error finding container 9bffbf5cd5ecc6719d33c03e8ca81f5a39f6f42539a48b043cc5cf78f659b744: Status 404 returned error can't find the container with id 9bffbf5cd5ecc6719d33c03e8ca81f5a39f6f42539a48b043cc5cf78f659b744 Jul 28 17:59:41.132423 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:41.132403 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:59:43.281301 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.281257 2531 apiserver.go:52] "Watching apiserver" Jul 28 17:59:43.288326 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.288294 2531 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 17:59:43.290037 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.289997 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5bnqd","kube-system/konnectivity-agent-ftfxg","openshift-cluster-node-tuning-operator/tuned-ncgz5","openshift-multus/multus-6hwlb","openshift-multus/multus-additional-cni-plugins-7vkbr","openshift-network-operator/iptables-alerter-kdkhc","kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq","openshift-dns/node-resolver-nsg46","openshift-image-registry/node-ca-d6bnc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal","openshift-multus/network-metrics-daemon-zns9q","openshift-network-diagnostics/network-check-target-n6wbn","openshift-ovn-kubernetes/ovnkube-node-fpmjp"] Jul 28 17:59:43.291583 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.291564 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.292910 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.292892 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:43.293005 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.292963 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:43.293904 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.293883 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.295710 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.295037 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.295710 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.295478 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vmjss\"" Jul 28 17:59:43.296313 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.296293 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 17:59:43.296406 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.296376 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 17:59:43.296464 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.296414 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:59:43.296518 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.296482 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2nl9\"" Jul 28 17:59:43.296518 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.296298 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 17:59:43.296685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.296667 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 17:59:43.296774 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.296756 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.297725 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.297420 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 17:59:43.297725 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.297706 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.298752 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.298733 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.299456 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.299441 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 17:59:43.299631 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.299618 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bkvd2\"" Jul 28 17:59:43.299852 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.299838 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 17:59:43.299940 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.299927 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 17:59:43.300164 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.300143 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.311860 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.311837 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:59:43.312030 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.312012 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.312154 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.312142 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 17:59:43.312620 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.312601 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.312674 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.312622 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 17:59:43.312812 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.312796 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rntlr\"" Jul 28 17:59:43.312844 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.312817 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 17:59:43.313000 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.312981 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zdxv6\"" Jul 28 17:59:43.313136 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313011 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gklpj\"" Jul 28 17:59:43.313136 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313100 2531 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 17:59:43.313273 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.313179 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:43.313273 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313221 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 17:59:43.313391 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313280 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 17:59:43.313528 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313508 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 17:59:43.313701 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313680 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 17:59:43.313770 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313712 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 17:59:43.313770 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313756 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 17:59:43.313902 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313780 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 17:59:43.313902 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.313814 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 17:59:43.314034 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.314008 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 17:59:43.314183 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.314158 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2m7gf\"" Jul 28 17:59:43.316777 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.316345 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.317468 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.317447 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:43.317569 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.317519 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:43.322656 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.322638 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 17:59:43.322884 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.322854 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 17:59:43.323001 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.322979 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8jb5s\"" Jul 28 17:59:43.323079 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.323055 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 17:59:43.323210 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.323197 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w9rzt\"" Jul 28 17:59:43.323263 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.323249 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 17:59:43.323376 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.323360 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 17:59:43.341819 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.341791 2531 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:59:43.365562 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.365536 2531 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jkrxz" Jul 28 17:59:43.373991 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.373966 2531 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jkrxz" Jul 28 17:59:43.376553 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.376503 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" event={"ID":"9eebf97683721fc5d0fbbff1032d28d2","Type":"ContainerStarted","Data":"d20a9a6bc47b24a05f199e1b0722af75e96ebb7ea7404e8640801d522a2bbd9b"} Jul 28 17:59:43.377911 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.377885 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" event={"ID":"923ffe0ad7855c90d360d5355866467b","Type":"ContainerStarted","Data":"9bffbf5cd5ecc6719d33c03e8ca81f5a39f6f42539a48b043cc5cf78f659b744"} Jul 28 17:59:43.388270 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.388247 2531 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:59:43.402027 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.402000 2531 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 17:59:43.413255 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413226 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwqc\" (UniqueName: \"kubernetes.io/projected/2458f770-0edc-4280-b272-0c40814eb529-kube-api-access-nxwqc\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.413255 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413258 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-modprobe-d\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.413479 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413276 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a793fc5-fe86-4b82-99a5-884363908d9d-hosts-file\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.413479 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413296 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-kubelet\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.413479 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413320 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-var-lib-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.413479 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413393 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87f8ac69-acda-4005-adc4-da8508ba47f1-agent-certs\") pod \"konnectivity-agent-ftfxg\" (UID: \"87f8ac69-acda-4005-adc4-da8508ba47f1\") " pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.413479 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413451 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-cni-binary-copy\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413489 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-multus-certs\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413544 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysconfig\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413570 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a793fc5-fe86-4b82-99a5-884363908d9d-tmp-dir\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413592 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-slash\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413607 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413630 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-netns\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413647 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-cni-bin\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.413697 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413684 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-etc-kubernetes\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413728 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frgzz\" (UniqueName: \"kubernetes.io/projected/8df8fe6c-863b-4bd7-affe-2e245b15e934-kube-api-access-frgzz\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413759 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413798 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-cnibin\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413822 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413845 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413891 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-k8s-cni-cncf-io\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413933 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n652g\" (UniqueName: \"kubernetes.io/projected/93ade919-a86c-4821-ae45-19b98cef7921-kube-api-access-n652g\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413957 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-run\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.413979 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8fk\" (UniqueName: \"kubernetes.io/projected/308cfb1e-956e-4859-b1ee-5b565bb9b617-kube-api-access-lm8fk\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.414094 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414011 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414099 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414134 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-run-netns\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414159 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30b23486-0f02-42f2-a971-2416b8670ac7-ovn-node-metrics-cert\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414184 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-conf-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414208 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2bcg\" (UniqueName: \"kubernetes.io/projected/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-kube-api-access-z2bcg\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414230 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccf43db2-ddfa-48a8-aef0-cf406aca7359-dbus\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414254 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-os-release\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414295 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-ovn\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414348 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-cni-bin\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414372 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-device-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414407 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93ade919-a86c-4821-ae45-19b98cef7921-host\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414428 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-kubernetes\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414470 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysctl-d\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414518 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vph62\" (UniqueName: \"kubernetes.io/projected/2a793fc5-fe86-4b82-99a5-884363908d9d-kube-api-access-vph62\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414541 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-node-log\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.414572 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414563 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-log-socket\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414584 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-cni-netd\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414608 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-ovnkube-script-lib\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414637 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87f8ac69-acda-4005-adc4-da8508ba47f1-konnectivity-ca\") pod \"konnectivity-agent-ftfxg\" (UID: \"87f8ac69-acda-4005-adc4-da8508ba47f1\") " pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414676 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccf43db2-ddfa-48a8-aef0-cf406aca7359-kubelet-config\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414700 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414726 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-system-cni-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414749 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-sys-fs\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414782 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-env-overrides\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414826 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-socket-dir-parent\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414851 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-hostroot\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414887 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysctl-conf\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414928 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-systemd\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414968 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-host\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.414992 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415031 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptqck\" (UniqueName: \"kubernetes.io/projected/3faf12a1-9706-49f3-8981-d1f8ea7517ec-kube-api-access-ptqck\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:43.415177 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415063 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-os-release\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415087 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df8fe6c-863b-4bd7-affe-2e245b15e934-host-slash\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415119 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415148 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-system-cni-dir\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415170 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-systemd-units\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415199 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-etc-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415222 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-run-ovn-kubernetes\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415247 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415272 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93ade919-a86c-4821-ae45-19b98cef7921-serviceca\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415294 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-tuned\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415315 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/308cfb1e-956e-4859-b1ee-5b565bb9b617-tmp\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415354 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9zz7\" (UniqueName: \"kubernetes.io/projected/30b23486-0f02-42f2-a971-2416b8670ac7-kube-api-access-f9zz7\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415377 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415399 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-lib-modules\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415423 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzlhh\" (UniqueName: \"kubernetes.io/projected/e10d3429-0fea-48f5-9ed5-1efc3a675453-kube-api-access-fzlhh\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415448 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-daemon-config\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.415685 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415473 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-ovnkube-config\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415497 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-kubelet\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415521 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-cni-multus\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415545 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8df8fe6c-863b-4bd7-affe-2e245b15e934-iptables-alerter-script\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415568 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-socket-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415591 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-sys\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415656 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-var-lib-kubelet\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415681 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-systemd\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415704 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-cni-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415725 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-cnibin\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.416328 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.415748 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-registration-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.516967 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.516863 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-ovn\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.516967 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.516919 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-cni-bin\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.516974 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-cni-bin\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.516988 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-ovn\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517029 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-device-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517060 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93ade919-a86c-4821-ae45-19b98cef7921-host\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517076 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-kubernetes\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517090 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysctl-d\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517100 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-device-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517116 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93ade919-a86c-4821-ae45-19b98cef7921-host\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517116 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vph62\" (UniqueName: \"kubernetes.io/projected/2a793fc5-fe86-4b82-99a5-884363908d9d-kube-api-access-vph62\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517152 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-node-log\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517161 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-kubernetes\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517177 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-log-socket\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517197 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-cni-netd\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517206 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-node-log\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517213 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-ovnkube-script-lib\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517232 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87f8ac69-acda-4005-adc4-da8508ba47f1-konnectivity-ca\") pod \"konnectivity-agent-ftfxg\" (UID: \"87f8ac69-acda-4005-adc4-da8508ba47f1\") " pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517235 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysctl-d\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.517227 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517240 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-log-socket\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517250 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccf43db2-ddfa-48a8-aef0-cf406aca7359-kubelet-config\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517272 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517293 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-system-cni-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517277 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-cni-netd\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517337 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-sys-fs\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517358 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-env-overrides\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517359 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccf43db2-ddfa-48a8-aef0-cf406aca7359-kubelet-config\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517391 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-socket-dir-parent\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517414 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-hostroot\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517436 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysctl-conf\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517437 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-sys-fs\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517450 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-systemd\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517471 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-host\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517487 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517489 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-hostroot\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517511 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqck\" (UniqueName: \"kubernetes.io/projected/3faf12a1-9706-49f3-8981-d1f8ea7517ec-kube-api-access-ptqck\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:43.518077 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517528 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-os-release\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517543 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df8fe6c-863b-4bd7-affe-2e245b15e934-host-slash\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517560 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517575 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-system-cni-dir\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517604 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-systemd-units\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517627 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-etc-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517649 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-run-ovn-kubernetes\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517672 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517695 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93ade919-a86c-4821-ae45-19b98cef7921-serviceca\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517718 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-tuned\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517742 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/308cfb1e-956e-4859-b1ee-5b565bb9b617-tmp\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517764 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9zz7\" (UniqueName: \"kubernetes.io/projected/30b23486-0f02-42f2-a971-2416b8670ac7-kube-api-access-f9zz7\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517793 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517822 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-lib-modules\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517854 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzlhh\" (UniqueName: \"kubernetes.io/projected/e10d3429-0fea-48f5-9ed5-1efc3a675453-kube-api-access-fzlhh\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517892 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87f8ac69-acda-4005-adc4-da8508ba47f1-konnectivity-ca\") pod \"konnectivity-agent-ftfxg\" (UID: \"87f8ac69-acda-4005-adc4-da8508ba47f1\") " pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517900 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-daemon-config\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.518833 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517928 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-ovnkube-config\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517946 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-ovnkube-script-lib\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517415 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-system-cni-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518001 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-kubelet\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.517950 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-kubelet\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518007 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518013 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-socket-dir-parent\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518034 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-cni-multus\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518033 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-env-overrides\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518059 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-cni-multus\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518062 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8df8fe6c-863b-4bd7-affe-2e245b15e934-iptables-alerter-script\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518088 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-etc-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518092 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-systemd\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518100 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysctl-conf\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518109 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-socket-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518136 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-sys\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518153 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-var-lib-kubelet\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.519636 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518162 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-run-ovn-kubernetes\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518169 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-systemd\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.518177 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518184 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-cni-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518200 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-cnibin\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518218 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-registration-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.518247 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 17:59:44.018226872 +0000 UTC m=+3.113052908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518254 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-registration-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518272 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwqc\" (UniqueName: \"kubernetes.io/projected/2458f770-0edc-4280-b272-0c40814eb529-kube-api-access-nxwqc\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518305 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-modprobe-d\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.518316 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518326 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-socket-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518330 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a793fc5-fe86-4b82-99a5-884363908d9d-hosts-file\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518355 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-sys\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518356 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-kubelet\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.518364 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret podName:ccf43db2-ddfa-48a8-aef0-cf406aca7359 nodeName:}" failed. No retries permitted until 2026-07-28 17:59:44.01835171 +0000 UTC m=+3.113177758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret") pod "global-pull-secret-syncer-5bnqd" (UID: "ccf43db2-ddfa-48a8-aef0-cf406aca7359") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518389 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-var-lib-kubelet\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.520574 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518394 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-kubelet\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518152 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-host\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518414 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-systemd\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518440 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8df8fe6c-863b-4bd7-affe-2e245b15e934-iptables-alerter-script\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518447 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518477 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-cnibin\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518475 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-lib-modules\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518608 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-var-lib-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518653 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-var-lib-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518761 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-os-release\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518738 2531 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518793 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87f8ac69-acda-4005-adc4-da8508ba47f1-agent-certs\") pod \"konnectivity-agent-ftfxg\" (UID: \"87f8ac69-acda-4005-adc4-da8508ba47f1\") " pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518827 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-cni-binary-copy\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518855 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-multus-certs\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518856 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df8fe6c-863b-4bd7-affe-2e245b15e934-host-slash\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518900 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysconfig\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518906 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-cni-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518929 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a793fc5-fe86-4b82-99a5-884363908d9d-tmp-dir\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.521380 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518953 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-slash\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.518979 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519011 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-netns\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519018 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30b23486-0f02-42f2-a971-2416b8670ac7-ovnkube-config\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519038 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-cni-bin\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519056 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-daemon-config\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519064 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-etc-kubernetes\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519086 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-system-cni-dir\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519112 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-etc-kubernetes\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519120 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-multus-certs\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519156 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-slash\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519199 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519232 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-netns\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519011 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-modprobe-d\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519243 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-sysconfig\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519280 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-var-lib-cni-bin\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519297 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-systemd-units\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519337 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a793fc5-fe86-4b82-99a5-884363908d9d-hosts-file\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.522251 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519388 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a793fc5-fe86-4b82-99a5-884363908d9d-tmp-dir\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519399 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93ade919-a86c-4821-ae45-19b98cef7921-serviceca\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519463 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frgzz\" (UniqueName: \"kubernetes.io/projected/8df8fe6c-863b-4bd7-affe-2e245b15e934-kube-api-access-frgzz\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519492 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519569 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2458f770-0edc-4280-b272-0c40814eb529-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519584 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-cni-binary-copy\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519589 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-cnibin\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519627 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519631 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-cnibin\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519678 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519709 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-k8s-cni-cncf-io\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519730 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n652g\" (UniqueName: \"kubernetes.io/projected/93ade919-a86c-4821-ae45-19b98cef7921-kube-api-access-n652g\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519739 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-run-openvswitch\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519756 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-run\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519789 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8fk\" (UniqueName: \"kubernetes.io/projected/308cfb1e-956e-4859-b1ee-5b565bb9b617-kube-api-access-lm8fk\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519810 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519837 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.522927 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519862 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-run-netns\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519812 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/308cfb1e-956e-4859-b1ee-5b565bb9b617-run\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519907 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-host-run-k8s-cni-cncf-io\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.519908 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30b23486-0f02-42f2-a971-2416b8670ac7-ovn-node-metrics-cert\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520064 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520098 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-conf-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520107 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30b23486-0f02-42f2-a971-2416b8670ac7-host-run-netns\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520124 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2bcg\" (UniqueName: \"kubernetes.io/projected/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-kube-api-access-z2bcg\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520150 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccf43db2-ddfa-48a8-aef0-cf406aca7359-dbus\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520172 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520200 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-os-release\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520234 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-multus-conf-dir\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520282 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccf43db2-ddfa-48a8-aef0-cf406aca7359-dbus\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520290 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e10d3429-0fea-48f5-9ed5-1efc3a675453-os-release\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.520465 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e10d3429-0fea-48f5-9ed5-1efc3a675453-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.522453 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/308cfb1e-956e-4859-b1ee-5b565bb9b617-tmp\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.522507 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/308cfb1e-956e-4859-b1ee-5b565bb9b617-etc-tuned\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.523477 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.522728 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87f8ac69-acda-4005-adc4-da8508ba47f1-agent-certs\") pod \"konnectivity-agent-ftfxg\" (UID: \"87f8ac69-acda-4005-adc4-da8508ba47f1\") " pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.525239 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.525220 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30b23486-0f02-42f2-a971-2416b8670ac7-ovn-node-metrics-cert\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.528601 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.528583 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:59:43.528601 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.528608 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:59:43.528601 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.528622 2531 projected.go:196] Error preparing data for projected volume kube-api-access-4cv48 for pod openshift-network-diagnostics/network-check-target-n6wbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:43.528985 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:43.528702 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48 podName:ff39945a-e97a-4f19-92eb-9034d7ff984a nodeName:}" failed. No retries permitted until 2026-07-28 17:59:44.028684632 +0000 UTC m=+3.123510692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4cv48" (UniqueName: "kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48") pod "network-check-target-n6wbn" (UID: "ff39945a-e97a-4f19-92eb-9034d7ff984a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:43.531517 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.531422 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vph62\" (UniqueName: \"kubernetes.io/projected/2a793fc5-fe86-4b82-99a5-884363908d9d-kube-api-access-vph62\") pod \"node-resolver-nsg46\" (UID: \"2a793fc5-fe86-4b82-99a5-884363908d9d\") " pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.531782 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.531758 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptqck\" (UniqueName: \"kubernetes.io/projected/3faf12a1-9706-49f3-8981-d1f8ea7517ec-kube-api-access-ptqck\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:43.531910 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.531824 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzlhh\" (UniqueName: \"kubernetes.io/projected/e10d3429-0fea-48f5-9ed5-1efc3a675453-kube-api-access-fzlhh\") pod \"multus-additional-cni-plugins-7vkbr\" (UID: \"e10d3429-0fea-48f5-9ed5-1efc3a675453\") " pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.532521 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.532497 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9zz7\" (UniqueName: \"kubernetes.io/projected/30b23486-0f02-42f2-a971-2416b8670ac7-kube-api-access-f9zz7\") pod \"ovnkube-node-fpmjp\" (UID: \"30b23486-0f02-42f2-a971-2416b8670ac7\") " pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.534452 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.534433 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2bcg\" (UniqueName: \"kubernetes.io/projected/7c709b5c-12ba-4b70-8f53-e9e6b2a0af51-kube-api-access-z2bcg\") pod \"multus-6hwlb\" (UID: \"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51\") " pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.534546 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.534486 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwqc\" (UniqueName: \"kubernetes.io/projected/2458f770-0edc-4280-b272-0c40814eb529-kube-api-access-nxwqc\") pod \"aws-ebs-csi-driver-node-nbcrq\" (UID: \"2458f770-0edc-4280-b272-0c40814eb529\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:43.534724 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.534702 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8fk\" (UniqueName: \"kubernetes.io/projected/308cfb1e-956e-4859-b1ee-5b565bb9b617-kube-api-access-lm8fk\") pod \"tuned-ncgz5\" (UID: \"308cfb1e-956e-4859-b1ee-5b565bb9b617\") " pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.535150 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.535129 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n652g\" (UniqueName: \"kubernetes.io/projected/93ade919-a86c-4821-ae45-19b98cef7921-kube-api-access-n652g\") pod \"node-ca-d6bnc\" (UID: \"93ade919-a86c-4821-ae45-19b98cef7921\") " pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.536013 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.535989 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frgzz\" (UniqueName: \"kubernetes.io/projected/8df8fe6c-863b-4bd7-affe-2e245b15e934-kube-api-access-frgzz\") pod \"iptables-alerter-kdkhc\" (UID: \"8df8fe6c-863b-4bd7-affe-2e245b15e934\") " pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.615681 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.615644 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6bnc" Jul 28 17:59:43.624887 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.624848 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" Jul 28 17:59:43.633755 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.633725 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" Jul 28 17:59:43.639684 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.639662 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6hwlb" Jul 28 17:59:43.650249 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.650224 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kdkhc" Jul 28 17:59:43.658027 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.658002 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nsg46" Jul 28 17:59:43.663784 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.663762 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 17:59:43.670468 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.670444 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ftfxg" Jul 28 17:59:43.676236 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:43.676216 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" Jul 28 17:59:44.024639 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:44.024590 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:44.024815 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:44.024673 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:44.024815 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.024786 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:44.024815 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.024786 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:44.024985 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.024847 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret podName:ccf43db2-ddfa-48a8-aef0-cf406aca7359 nodeName:}" failed. No retries permitted until 2026-07-28 17:59:45.02483346 +0000 UTC m=+4.119659494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret") pod "global-pull-secret-syncer-5bnqd" (UID: "ccf43db2-ddfa-48a8-aef0-cf406aca7359") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:44.024985 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.024886 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 17:59:45.024859621 +0000 UTC m=+4.119685658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:44.125543 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:44.125513 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:44.125679 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.125648 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:59:44.125679 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.125663 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:59:44.125679 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.125672 2531 projected.go:196] Error preparing data for projected volume kube-api-access-4cv48 for pod openshift-network-diagnostics/network-check-target-n6wbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:44.125776 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.125722 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48 podName:ff39945a-e97a-4f19-92eb-9034d7ff984a nodeName:}" failed. No retries permitted until 2026-07-28 17:59:45.125708661 +0000 UTC m=+4.220534695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cv48" (UniqueName: "kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48") pod "network-check-target-n6wbn" (UID: "ff39945a-e97a-4f19-92eb-9034d7ff984a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:44.372558 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:44.372478 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:44.373178 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:44.372620 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:44.376547 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:44.376493 2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:54:43 +0000 UTC" deadline="2028-04-11 03:16:57.077326628 +0000 UTC" Jul 28 17:59:44.376547 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:44.376540 2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14937h17m12.700789734s" Jul 28 17:59:44.453560 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:44.453527 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10d3429_0fea_48f5_9ed5_1efc3a675453.slice/crio-9e2d1250def78ccc0874e6e78342a34d0161cf190a9a929740d03ffeeaac5830 WatchSource:0}: Error finding container 9e2d1250def78ccc0874e6e78342a34d0161cf190a9a929740d03ffeeaac5830: Status 404 returned error can't find the container with id 9e2d1250def78ccc0874e6e78342a34d0161cf190a9a929740d03ffeeaac5830 Jul 28 17:59:44.454811 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:44.454786 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c709b5c_12ba_4b70_8f53_e9e6b2a0af51.slice/crio-ae4dbee419a0fb4b53bad89a22c0d03c65452535177990d6dc88227624e56798 WatchSource:0}: Error finding container ae4dbee419a0fb4b53bad89a22c0d03c65452535177990d6dc88227624e56798: Status 404 returned error can't find the container with id ae4dbee419a0fb4b53bad89a22c0d03c65452535177990d6dc88227624e56798 Jul 28 17:59:44.458801 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:44.458779 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308cfb1e_956e_4859_b1ee_5b565bb9b617.slice/crio-afb49d82739c334a7bc36ac4797139042f9a99dac17569a05356c4e269c5cbec WatchSource:0}: Error finding container afb49d82739c334a7bc36ac4797139042f9a99dac17569a05356c4e269c5cbec: Status 404 returned error can't find the container with id afb49d82739c334a7bc36ac4797139042f9a99dac17569a05356c4e269c5cbec Jul 28 17:59:44.460508 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:44.460360 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b23486_0f02_42f2_a971_2416b8670ac7.slice/crio-8845d06a8073daa62ceafa8a7d0a40331059681f135f9d0672d01cd4414235e4 WatchSource:0}: Error finding container 8845d06a8073daa62ceafa8a7d0a40331059681f135f9d0672d01cd4414235e4: Status 404 returned error can't find the container with id 8845d06a8073daa62ceafa8a7d0a40331059681f135f9d0672d01cd4414235e4 Jul 28 17:59:44.461728 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:44.461270 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a793fc5_fe86_4b82_99a5_884363908d9d.slice/crio-0752e2cde9a29af64066aad4da4adf1e9ab6ee8480b666cde303ebb600425cca WatchSource:0}: Error finding container 0752e2cde9a29af64066aad4da4adf1e9ab6ee8480b666cde303ebb600425cca: Status 404 returned error can't find the container with id 0752e2cde9a29af64066aad4da4adf1e9ab6ee8480b666cde303ebb600425cca Jul 28 17:59:44.462163 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:44.462071 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df8fe6c_863b_4bd7_affe_2e245b15e934.slice/crio-6269f26e15f054b5e3c312ee91d24c11438abe4d18726f0159c370b51dfc2cff WatchSource:0}: Error finding container 6269f26e15f054b5e3c312ee91d24c11438abe4d18726f0159c370b51dfc2cff: Status 404 returned error can't find the container with id 6269f26e15f054b5e3c312ee91d24c11438abe4d18726f0159c370b51dfc2cff Jul 28 17:59:44.463534 ip-10-0-140-220 kubenswrapper[2531]: W0728 17:59:44.463441 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f8ac69_acda_4005_adc4_da8508ba47f1.slice/crio-5d27b49312b14fc1b8e9ea3a5a3a4a8b44ef18d9b6c6dcc35a9ef1659bc1cc42 WatchSource:0}: Error finding container 5d27b49312b14fc1b8e9ea3a5a3a4a8b44ef18d9b6c6dcc35a9ef1659bc1cc42: Status 404 returned error can't find the container with id 5d27b49312b14fc1b8e9ea3a5a3a4a8b44ef18d9b6c6dcc35a9ef1659bc1cc42 Jul 28 17:59:45.032779 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.032458 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:45.032982 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.032778 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:45.032982 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.032969 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:45.033099 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.033039 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret podName:ccf43db2-ddfa-48a8-aef0-cf406aca7359 nodeName:}" failed. No retries permitted until 2026-07-28 17:59:47.033016777 +0000 UTC m=+6.127842816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret") pod "global-pull-secret-syncer-5bnqd" (UID: "ccf43db2-ddfa-48a8-aef0-cf406aca7359") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:45.033477 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.033453 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:45.033559 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.033547 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 17:59:47.033529691 +0000 UTC m=+6.128355730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:45.133220 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.133180 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:45.133393 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.133372 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:59:45.133393 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.133391 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:59:45.133515 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.133403 2531 projected.go:196] Error preparing data for projected volume kube-api-access-4cv48 for pod openshift-network-diagnostics/network-check-target-n6wbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:45.133515 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.133467 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48 podName:ff39945a-e97a-4f19-92eb-9034d7ff984a nodeName:}" failed. No retries permitted until 2026-07-28 17:59:47.13344797 +0000 UTC m=+6.228274004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cv48" (UniqueName: "kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48") pod "network-check-target-n6wbn" (UID: "ff39945a-e97a-4f19-92eb-9034d7ff984a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:45.374783 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.374702 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:45.375347 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.374842 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:45.375347 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.375260 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:45.375464 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:45.375368 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:45.376821 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.376678 2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:54:43 +0000 UTC" deadline="2028-01-13 14:32:45.299964686 +0000 UTC" Jul 28 17:59:45.376821 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.376710 2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12812h32m59.923259283s" Jul 28 17:59:45.397095 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.396935 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" event={"ID":"2458f770-0edc-4280-b272-0c40814eb529","Type":"ContainerStarted","Data":"4d40b6db22cddad368ab6ba8bbff404e7cc7b96e2d53ac369608283f48c07c0f"} Jul 28 17:59:45.410715 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.410676 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ftfxg" event={"ID":"87f8ac69-acda-4005-adc4-da8508ba47f1","Type":"ContainerStarted","Data":"5d27b49312b14fc1b8e9ea3a5a3a4a8b44ef18d9b6c6dcc35a9ef1659bc1cc42"} Jul 28 17:59:45.429521 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.429486 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kdkhc" event={"ID":"8df8fe6c-863b-4bd7-affe-2e245b15e934","Type":"ContainerStarted","Data":"6269f26e15f054b5e3c312ee91d24c11438abe4d18726f0159c370b51dfc2cff"} Jul 28 17:59:45.442592 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.442549 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerStarted","Data":"9e2d1250def78ccc0874e6e78342a34d0161cf190a9a929740d03ffeeaac5830"} Jul 28 17:59:45.452276 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.452236 2531 generic.go:356] "Generic (PLEG): container finished" podID="9eebf97683721fc5d0fbbff1032d28d2" containerID="413061905d4ea71ecc2f4ad907376a554450c072789a5ba68cd5046d1c94be86" exitCode=0 Jul 28 17:59:45.452432 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.452334 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" event={"ID":"9eebf97683721fc5d0fbbff1032d28d2","Type":"ContainerDied","Data":"413061905d4ea71ecc2f4ad907376a554450c072789a5ba68cd5046d1c94be86"} Jul 28 17:59:45.477732 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.477655 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nsg46" event={"ID":"2a793fc5-fe86-4b82-99a5-884363908d9d","Type":"ContainerStarted","Data":"0752e2cde9a29af64066aad4da4adf1e9ab6ee8480b666cde303ebb600425cca"} Jul 28 17:59:45.495987 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.495686 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"8845d06a8073daa62ceafa8a7d0a40331059681f135f9d0672d01cd4414235e4"} Jul 28 17:59:45.503544 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.503508 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" event={"ID":"308cfb1e-956e-4859-b1ee-5b565bb9b617","Type":"ContainerStarted","Data":"afb49d82739c334a7bc36ac4797139042f9a99dac17569a05356c4e269c5cbec"} Jul 28 17:59:45.513082 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.513047 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6hwlb" event={"ID":"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51","Type":"ContainerStarted","Data":"ae4dbee419a0fb4b53bad89a22c0d03c65452535177990d6dc88227624e56798"} Jul 28 17:59:45.534900 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.534842 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6bnc" event={"ID":"93ade919-a86c-4821-ae45-19b98cef7921","Type":"ContainerStarted","Data":"e80623ea3e138d34814c79cd7b1331a8dbc8df771f16e1b4d6d884182230f5a6"} Jul 28 17:59:45.559995 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:45.559926 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" event={"ID":"923ffe0ad7855c90d360d5355866467b","Type":"ContainerStarted","Data":"fd990d8d27cc344b7665d4c26586f08518b90ae854d34332cf8139f3969e0231"} Jul 28 17:59:46.372422 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:46.372300 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:46.372422 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:46.372419 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:46.587431 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:46.587395 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" event={"ID":"9eebf97683721fc5d0fbbff1032d28d2","Type":"ContainerStarted","Data":"180e8155b907315da2492363e5b203315d630cd6e594ee5f0c598706af601f6d"} Jul 28 17:59:46.604278 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:46.604219 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" podStartSLOduration=4.604198213 podStartE2EDuration="4.604198213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:59:46.603759925 +0000 UTC m=+5.698585982" watchObservedRunningTime="2026-07-28 17:59:46.604198213 +0000 UTC m=+5.699024271" Jul 28 17:59:46.605216 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:46.605175 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" podStartSLOduration=4.605158612 podStartE2EDuration="4.605158612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:59:45.578658477 +0000 UTC m=+4.673484534" watchObservedRunningTime="2026-07-28 17:59:46.605158612 +0000 UTC m=+5.699984669" Jul 28 17:59:47.054430 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:47.054391 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:47.054686 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:47.054461 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:47.054686 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.054603 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:47.054686 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.054668 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret podName:ccf43db2-ddfa-48a8-aef0-cf406aca7359 nodeName:}" failed. No retries permitted until 2026-07-28 17:59:51.054648729 +0000 UTC m=+10.149474766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret") pod "global-pull-secret-syncer-5bnqd" (UID: "ccf43db2-ddfa-48a8-aef0-cf406aca7359") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:47.055112 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.055091 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:47.055244 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.055151 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 17:59:51.055134272 +0000 UTC m=+10.149960324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:47.155201 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:47.155162 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:47.155383 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.155341 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:59:47.155383 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.155364 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:59:47.155489 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.155441 2531 projected.go:196] Error preparing data for projected volume kube-api-access-4cv48 for pod openshift-network-diagnostics/network-check-target-n6wbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:47.155550 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.155504 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48 podName:ff39945a-e97a-4f19-92eb-9034d7ff984a nodeName:}" failed. No retries permitted until 2026-07-28 17:59:51.155484343 +0000 UTC m=+10.250310379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cv48" (UniqueName: "kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48") pod "network-check-target-n6wbn" (UID: "ff39945a-e97a-4f19-92eb-9034d7ff984a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:47.375126 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:47.375053 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:47.375278 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:47.375056 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:47.375278 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.375162 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:47.375383 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:47.375272 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:48.372954 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:48.372920 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:48.373456 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:48.373055 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:49.374888 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:49.374847 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:49.375371 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:49.374998 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:49.375433 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:49.375376 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:49.375494 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:49.375471 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:50.372810 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:50.372263 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:50.372810 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:50.372404 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:51.097940 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:51.090709 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:51.098364 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:51.098024 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:51.098364 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.098133 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:51.098364 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.098241 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 17:59:59.098217885 +0000 UTC m=+18.193043931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:51.098517 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.098499 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:51.098600 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.098589 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret podName:ccf43db2-ddfa-48a8-aef0-cf406aca7359 nodeName:}" failed. No retries permitted until 2026-07-28 17:59:59.098575036 +0000 UTC m=+18.193401073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret") pod "global-pull-secret-syncer-5bnqd" (UID: "ccf43db2-ddfa-48a8-aef0-cf406aca7359") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:51.198473 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:51.198428 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:51.198658 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.198633 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:59:51.198658 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.198650 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:59:51.198658 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.198660 2531 projected.go:196] Error preparing data for projected volume kube-api-access-4cv48 for pod openshift-network-diagnostics/network-check-target-n6wbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:51.198823 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.198713 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48 podName:ff39945a-e97a-4f19-92eb-9034d7ff984a nodeName:}" failed. No retries permitted until 2026-07-28 17:59:59.198698194 +0000 UTC m=+18.293524230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cv48" (UniqueName: "kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48") pod "network-check-target-n6wbn" (UID: "ff39945a-e97a-4f19-92eb-9034d7ff984a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:51.373897 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:51.373369 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:51.373897 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.373488 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:51.373897 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:51.373521 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:51.373897 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:51.373642 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:52.372785 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:52.372752 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:52.373238 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:52.372920 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:53.373468 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:53.372974 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:53.373468 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:53.373008 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:53.373468 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:53.373117 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:53.373468 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:53.373214 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:54.372435 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:54.372401 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:54.372580 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:54.372510 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:55.372800 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:55.372756 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:55.373256 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:55.372806 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:55.373256 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:55.372918 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:55.373256 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:55.373054 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:56.372501 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:56.372472 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:56.372702 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:56.372579 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:57.372762 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:57.372722 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:57.373235 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:57.372888 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:57.373235 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:57.372901 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:57.373235 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:57.373041 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 17:59:58.372878 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:58.372819 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:58.373324 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:58.372973 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 17:59:59.160792 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:59.160744 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:59.160986 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:59.160832 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:59.160986 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.160898 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:59.160986 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.160953 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:59.161131 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.161022 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 18:00:15.16100158 +0000 UTC m=+34.255827614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:59:59.161131 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.161041 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret podName:ccf43db2-ddfa-48a8-aef0-cf406aca7359 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:15.161031364 +0000 UTC m=+34.255857405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret") pod "global-pull-secret-syncer-5bnqd" (UID: "ccf43db2-ddfa-48a8-aef0-cf406aca7359") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:59:59.261533 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:59.261448 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 17:59:59.261711 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.261644 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:59:59.261711 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.261677 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:59:59.261711 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.261692 2531 projected.go:196] Error preparing data for projected volume kube-api-access-4cv48 for pod openshift-network-diagnostics/network-check-target-n6wbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:59.261921 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.261783 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48 podName:ff39945a-e97a-4f19-92eb-9034d7ff984a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:15.261761283 +0000 UTC m=+34.356587341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cv48" (UniqueName: "kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48") pod "network-check-target-n6wbn" (UID: "ff39945a-e97a-4f19-92eb-9034d7ff984a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:59:59.372457 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:59.372425 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 17:59:59.372610 ip-10-0-140-220 kubenswrapper[2531]: I0728 17:59:59.372425 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 17:59:59.372610 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.372560 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 17:59:59.372690 ip-10-0-140-220 kubenswrapper[2531]: E0728 17:59:59.372638 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:00.372331 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:00.372296 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:00.372801 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:00.372423 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:01.373775 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:01.373738 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:01.374275 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:01.373893 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:01.374275 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:01.373934 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:01.374275 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:01.374054 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:02.372326 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:02.372289 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:02.372507 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:02.372415 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:03.372989 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.372758 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:03.373837 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.372758 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:03.373837 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:03.373072 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:03.373837 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:03.373179 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:03.625242 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.624962 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" event={"ID":"2458f770-0edc-4280-b272-0c40814eb529","Type":"ContainerStarted","Data":"c15d38b515b1f6a5f3cfdce2770a9d04a109d61c1b137c87b1bb6b610c627310"} Jul 28 18:00:03.626538 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.626501 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ftfxg" event={"ID":"87f8ac69-acda-4005-adc4-da8508ba47f1","Type":"ContainerStarted","Data":"f60d0b85396b360bdb26fd2ce74ed91c47de365b5da57d80902e2dff7409c422"} Jul 28 18:00:03.628226 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.628198 2531 generic.go:356] "Generic (PLEG): container finished" podID="e10d3429-0fea-48f5-9ed5-1efc3a675453" containerID="b22160436043010c39bb16ffaeeeb4f8cb146107b7ca380d5c9cbd459fe233c2" exitCode=0 Jul 28 18:00:03.628363 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.628286 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerDied","Data":"b22160436043010c39bb16ffaeeeb4f8cb146107b7ca380d5c9cbd459fe233c2"} Jul 28 18:00:03.629761 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.629708 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nsg46" event={"ID":"2a793fc5-fe86-4b82-99a5-884363908d9d","Type":"ContainerStarted","Data":"2ba1b16eff60a2422a9ed9b014f82ae8900cc8f8054bfe14d876d675c4412939"} Jul 28 18:00:03.632576 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.632559 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/0.log" Jul 28 18:00:03.632861 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.632844 2531 generic.go:356] "Generic (PLEG): container finished" podID="30b23486-0f02-42f2-a971-2416b8670ac7" containerID="7947d13fb7db5be720ea6aab19de41b430def653db6fe9c53f6573cd0269c1f2" exitCode=1 Jul 28 18:00:03.632955 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.632897 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"cc5ce92559952207fee9953208d9cf68be2f3665410e54a956af6ebd2e11e9e1"} Jul 28 18:00:03.633007 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.632966 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"d4199496d71419defbaeaa012d257f9a1ad518baf8f0d1cfe2d8ab7e0200642e"} Jul 28 18:00:03.633044 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.633006 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"070cbd571b527ecbb9a735444f79492b4ec7adb89e2e3ea26d68415ffdccc943"} Jul 28 18:00:03.633044 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.633038 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"94ba3a221c23be84fc17dc0ab787f5516ae6cda8a814d1d95ae52ece2ac6dda6"} Jul 28 18:00:03.633110 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.633067 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerDied","Data":"7947d13fb7db5be720ea6aab19de41b430def653db6fe9c53f6573cd0269c1f2"} Jul 28 18:00:03.633110 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.633105 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"a2c476e1de8bdb13b2bddc53ae028ae3a8613aa6633ddf16c5ecd1407b7ac854"} Jul 28 18:00:03.634460 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.634426 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" event={"ID":"308cfb1e-956e-4859-b1ee-5b565bb9b617","Type":"ContainerStarted","Data":"c4ea81a470bd259c239a0f4b6ff30c93cc3cfe81f5b6254b45d60f3150a7132e"} Jul 28 18:00:03.635941 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.635922 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6hwlb" event={"ID":"7c709b5c-12ba-4b70-8f53-e9e6b2a0af51","Type":"ContainerStarted","Data":"6a39933cffd0e75456254b9362716f47789c105b76efa3591f9c220863c942ac"} Jul 28 18:00:03.637355 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.637335 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6bnc" event={"ID":"93ade919-a86c-4821-ae45-19b98cef7921","Type":"ContainerStarted","Data":"ea64d3b4e0dd01651d5e43856550940dd8efa6add9344e7f22520b3b065a9b08"} Jul 28 18:00:03.642259 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.642214 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ftfxg" podStartSLOduration=4.296596925 podStartE2EDuration="22.642197593s" totalImagesPullingTime="18.345600668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:03.64196686 +0000 UTC m=+22.736792914" watchObservedRunningTime="2026-07-28 18:00:03.642197593 +0000 UTC m=+22.737023649" Jul 28 18:00:03.659275 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.659226 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ncgz5" podStartSLOduration=4.274901337 podStartE2EDuration="22.659207953s" totalImagesPullingTime="18.384306616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:03.659118224 +0000 UTC m=+22.753944280" watchObservedRunningTime="2026-07-28 18:00:03.659207953 +0000 UTC m=+22.754033991" Jul 28 18:00:03.698787 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.698739 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nsg46" podStartSLOduration=4.2741071 podStartE2EDuration="22.698723451s" totalImagesPullingTime="18.424616351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:03.698506265 +0000 UTC m=+22.793332320" watchObservedRunningTime="2026-07-28 18:00:03.698723451 +0000 UTC m=+22.793549507" Jul 28 18:00:03.720169 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.720097 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6hwlb" podStartSLOduration=4.289584032 podStartE2EDuration="22.720080246s" totalImagesPullingTime="18.430496214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:03.719476303 +0000 UTC m=+22.814302359" watchObservedRunningTime="2026-07-28 18:00:03.720080246 +0000 UTC m=+22.814906302" Jul 28 18:00:03.734893 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:03.734813 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d6bnc" podStartSLOduration=4.341772857 podStartE2EDuration="22.734795661s" totalImagesPullingTime="18.393022804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:03.734251052 +0000 UTC m=+22.829077121" watchObservedRunningTime="2026-07-28 18:00:03.734795661 +0000 UTC m=+22.829621718" Jul 28 18:00:04.373435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:04.372941 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:04.373435 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:04.373074 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:04.641537 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:04.641498 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kdkhc" event={"ID":"8df8fe6c-863b-4bd7-affe-2e245b15e934","Type":"ContainerStarted","Data":"988a56ffae6a99b0628762ebd242d932d6889516c7518421b3439c88e9974b2d"} Jul 28 18:00:04.660471 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:04.660404 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kdkhc" podStartSLOduration=5.312549911 podStartE2EDuration="23.660381795s" totalImagesPullingTime="18.347831884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:04.659860819 +0000 UTC m=+23.754686878" watchObservedRunningTime="2026-07-28 18:00:04.660381795 +0000 UTC m=+23.755207853" Jul 28 18:00:04.922437 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:04.922403 2531 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 18:00:05.365570 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.365535 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ftfxg" Jul 28 18:00:05.366254 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.366233 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ftfxg" Jul 28 18:00:05.372961 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.372929 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:05.373080 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:05.373055 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:05.373143 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.373086 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:05.373196 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:05.373161 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:05.378129 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.378018 2531 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T18:00:04.92242806Z","UUID":"57e96785-8598-4896-9b1d-6668af8b0134","Handler":null,"Name":"","Endpoint":""} Jul 28 18:00:05.379759 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.379740 2531 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 18:00:05.379903 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.379782 2531 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 18:00:05.646933 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.646374 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" event={"ID":"2458f770-0edc-4280-b272-0c40814eb529","Type":"ContainerStarted","Data":"d52ed9ceb53f0c610cd2db2d82d1750c180a945ff63fad04c5e1140fffb8e048"} Jul 28 18:00:05.646933 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.646840 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ftfxg" Jul 28 18:00:05.647522 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:05.647495 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ftfxg" Jul 28 18:00:06.373069 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:06.373036 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:06.373254 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:06.373144 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:06.651727 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:06.651299 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" event={"ID":"2458f770-0edc-4280-b272-0c40814eb529","Type":"ContainerStarted","Data":"184a3ad1fbbcd0ef1e1605e56ce973e443aecbe568c02b1f0d38a567360f7b94"} Jul 28 18:00:06.655070 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:06.655038 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/0.log" Jul 28 18:00:06.655472 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:06.655448 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"5bf2d36477edcdb3fb893ee0358020efb05b4f164eccd55045f9d549a3dac3f9"} Jul 28 18:00:06.670948 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:06.670892 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbcrq" podStartSLOduration=4.540488933 podStartE2EDuration="25.670858626s" totalImagesPullingTime="21.130369693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:06.670142607 +0000 UTC m=+25.764968663" watchObservedRunningTime="2026-07-28 18:00:06.670858626 +0000 UTC m=+25.765684681" Jul 28 18:00:07.372162 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:07.372133 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:07.372162 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:07.372150 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:07.372478 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:07.372269 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:07.372478 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:07.372414 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:08.372937 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.372830 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:08.373595 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:08.372958 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:08.662687 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.662430 2531 generic.go:356] "Generic (PLEG): container finished" podID="e10d3429-0fea-48f5-9ed5-1efc3a675453" containerID="dab3d44dff9aea4d2cd1cc9b94db0036b46397058f322362e2495f596a565f37" exitCode=0 Jul 28 18:00:08.662687 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.662521 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerDied","Data":"dab3d44dff9aea4d2cd1cc9b94db0036b46397058f322362e2495f596a565f37"} Jul 28 18:00:08.666463 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.666445 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/0.log" Jul 28 18:00:08.666813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.666786 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"8485d1ecacb7b46f814f686616da8576590f580ddc6245d36a45d5cda678ebc9"} Jul 28 18:00:08.667160 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.667135 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 18:00:08.667225 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.667213 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 18:00:08.667357 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.667341 2531 scope.go:117] "RemoveContainer" containerID="7947d13fb7db5be720ea6aab19de41b430def653db6fe9c53f6573cd0269c1f2" Jul 28 18:00:08.684439 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:08.684414 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 18:00:09.372709 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.372671 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:09.372915 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.372682 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:09.372915 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:09.372786 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:09.372915 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:09.372857 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:09.673448 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.673378 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/0.log" Jul 28 18:00:09.673812 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.673788 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" event={"ID":"30b23486-0f02-42f2-a971-2416b8670ac7","Type":"ContainerStarted","Data":"121b857ca10be83a9b99f3711873000323d1acd4bfb69700d1a2167cb41e8b69"} Jul 28 18:00:09.674150 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.674118 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 18:00:09.690166 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.690145 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 18:00:09.707424 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.707366 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" podStartSLOduration=10.227635554 podStartE2EDuration="28.707345759s" totalImagesPullingTime="18.479710205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:09.7069753 +0000 UTC m=+28.801801374" watchObservedRunningTime="2026-07-28 18:00:09.707345759 +0000 UTC m=+28.802171815" Jul 28 18:00:09.988502 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.988469 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zns9q"] Jul 28 18:00:09.988691 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.988621 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:09.988776 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:09.988723 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:09.995194 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.995148 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n6wbn"] Jul 28 18:00:09.995366 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.995216 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5bnqd"] Jul 28 18:00:09.995366 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.995305 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:09.995469 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:09.995407 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:09.995539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:09.995484 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:09.995589 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:09.995560 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:10.677596 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:10.677565 2531 generic.go:356] "Generic (PLEG): container finished" podID="e10d3429-0fea-48f5-9ed5-1efc3a675453" containerID="e12389e84d2df1dfea07b62b74d24c307ae4f12264681f1e9fd6b785c71dbbff" exitCode=0 Jul 28 18:00:10.678169 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:10.677646 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerDied","Data":"e12389e84d2df1dfea07b62b74d24c307ae4f12264681f1e9fd6b785c71dbbff"} Jul 28 18:00:11.373125 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:11.373099 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:11.373282 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:11.373177 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:11.373282 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:11.373249 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:11.373443 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:11.373352 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:11.373443 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:11.373370 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:11.373443 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:11.373425 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:12.687468 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:12.687216 2531 generic.go:356] "Generic (PLEG): container finished" podID="e10d3429-0fea-48f5-9ed5-1efc3a675453" containerID="a317949f71fe4620cfbbdc116f5ff05497ed0cd9fc00c4dd6c6f27306891ec6f" exitCode=0 Jul 28 18:00:12.687468 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:12.687291 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerDied","Data":"a317949f71fe4620cfbbdc116f5ff05497ed0cd9fc00c4dd6c6f27306891ec6f"} Jul 28 18:00:13.373095 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:13.373064 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:13.373265 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:13.373070 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:13.373265 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:13.373175 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:13.373265 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:13.373248 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:13.373265 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:13.373070 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:13.373495 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:13.373317 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:15.174626 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:15.174591 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:15.175155 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:15.174651 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:15.175155 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.174760 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:15.175155 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.174765 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:15.175155 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.174824 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret podName:ccf43db2-ddfa-48a8-aef0-cf406aca7359 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:47.174807279 +0000 UTC m=+66.269633334 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret") pod "global-pull-secret-syncer-5bnqd" (UID: "ccf43db2-ddfa-48a8-aef0-cf406aca7359") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:15.175155 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.174839 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 18:00:47.174833049 +0000 UTC m=+66.269659083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:15.275299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:15.275222 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:15.275500 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.275406 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:15.275500 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.275426 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:15.275500 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.275436 2531 projected.go:196] Error preparing data for projected volume kube-api-access-4cv48 for pod openshift-network-diagnostics/network-check-target-n6wbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:15.275500 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.275492 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48 podName:ff39945a-e97a-4f19-92eb-9034d7ff984a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:47.275478056 +0000 UTC m=+66.370304109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cv48" (UniqueName: "kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48") pod "network-check-target-n6wbn" (UID: "ff39945a-e97a-4f19-92eb-9034d7ff984a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:15.372148 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:15.372105 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:15.372340 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:15.372105 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:15.372340 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.372310 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bnqd" podUID="ccf43db2-ddfa-48a8-aef0-cf406aca7359" Jul 28 18:00:15.372466 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.372389 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6wbn" podUID="ff39945a-e97a-4f19-92eb-9034d7ff984a" Jul 28 18:00:15.372466 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:15.372461 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:15.372564 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:15.372545 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zns9q" podUID="3faf12a1-9706-49f3-8981-d1f8ea7517ec" Jul 28 18:00:16.662506 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.662477 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeReady" Jul 28 18:00:16.663064 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.662642 2531 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 18:00:16.701557 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.701528 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7895f44d4f-d6bd2"] Jul 28 18:00:16.722057 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.722024 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p47xq"] Jul 28 18:00:16.722250 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.722152 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.724476 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.724446 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 18:00:16.724719 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.724702 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4hfls\"" Jul 28 18:00:16.724839 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.724701 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 18:00:16.724918 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.724892 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 18:00:16.729531 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.729500 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 18:00:16.737899 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.737853 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w4bh8"] Jul 28 18:00:16.738026 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.737969 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.740166 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.740144 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 18:00:16.740166 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.740160 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 18:00:16.740351 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.740191 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cpvqd\"" Jul 28 18:00:16.756177 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.756139 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7895f44d4f-d6bd2"] Jul 28 18:00:16.756330 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.756188 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p47xq"] Jul 28 18:00:16.756330 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.756209 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4bh8"] Jul 28 18:00:16.756330 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.756272 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:16.758778 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.758748 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 18:00:16.758925 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.758788 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 18:00:16.758925 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.758911 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wwt5j\"" Jul 28 18:00:16.759345 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.759327 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 18:00:16.885238 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.885156 2531 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftfxg_87f8ac69-acda-4005-adc4-da8508ba47f1/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:16.888116 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888086 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.888237 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888135 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-image-registry-private-configuration\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888237 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888163 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-trusted-ca\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888237 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888184 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-installation-pull-secrets\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888237 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888208 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31e431d-fcac-423c-89d0-1905bd47a348-tmp-dir\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888247 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-certificates\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888270 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cgcb\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-kube-api-access-9cgcb\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888292 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f31e431d-fcac-423c-89d0-1905bd47a348-config-volume\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888308 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819ef033-8b96-46dd-a1c4-c767b7c094d0-ca-trust-extracted\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888336 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-bound-sa-token\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888362 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-598t8\" (UniqueName: \"kubernetes.io/projected/f31e431d-fcac-423c-89d0-1905bd47a348-kube-api-access-598t8\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888378 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2sfp\" (UniqueName: \"kubernetes.io/projected/4b5c0a08-17fb-43c7-bc66-29f054141d40-kube-api-access-q2sfp\") pod \"ingress-canary-w4bh8\" (UID: \"4b5c0a08-17fb-43c7-bc66-29f054141d40\") " pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:16.888429 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888397 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.888720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.888437 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b5c0a08-17fb-43c7-bc66-29f054141d40-cert\") pod \"ingress-canary-w4bh8\" (UID: \"4b5c0a08-17fb-43c7-bc66-29f054141d40\") " pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:16.980601 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.980555 2531 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftfxg_87f8ac69-acda-4005-adc4-da8508ba47f1/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:16.989394 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989352 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b5c0a08-17fb-43c7-bc66-29f054141d40-cert\") pod \"ingress-canary-w4bh8\" (UID: \"4b5c0a08-17fb-43c7-bc66-29f054141d40\") " pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:16.989574 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989452 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.989574 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989495 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-image-registry-private-configuration\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.989574 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989517 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-trusted-ca\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.989574 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989545 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-installation-pull-secrets\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.989574 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989565 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31e431d-fcac-423c-89d0-1905bd47a348-tmp-dir\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989587 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-certificates\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989614 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cgcb\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-kube-api-access-9cgcb\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989644 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f31e431d-fcac-423c-89d0-1905bd47a348-config-volume\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989666 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819ef033-8b96-46dd-a1c4-c767b7c094d0-ca-trust-extracted\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989688 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-bound-sa-token\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989723 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-598t8\" (UniqueName: \"kubernetes.io/projected/f31e431d-fcac-423c-89d0-1905bd47a348-kube-api-access-598t8\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989744 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2sfp\" (UniqueName: \"kubernetes.io/projected/4b5c0a08-17fb-43c7-bc66-29f054141d40-kube-api-access-q2sfp\") pod \"ingress-canary-w4bh8\" (UID: \"4b5c0a08-17fb-43c7-bc66-29f054141d40\") " pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:16.989813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.989763 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.990185 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:16.989909 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:16.990185 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:16.989925 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7895f44d4f-d6bd2: secret "image-registry-tls" not found Jul 28 18:00:16.990185 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:16.990002 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls podName:819ef033-8b96-46dd-a1c4-c767b7c094d0 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:17.489981395 +0000 UTC m=+36.584807433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls") pod "image-registry-7895f44d4f-d6bd2" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0") : secret "image-registry-tls" not found Jul 28 18:00:16.990530 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:16.990508 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:16.990658 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:16.990587 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls podName:f31e431d-fcac-423c-89d0-1905bd47a348 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:17.490567919 +0000 UTC m=+36.585393957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls") pod "dns-default-p47xq" (UID: "f31e431d-fcac-423c-89d0-1905bd47a348") : secret "dns-default-metrics-tls" not found Jul 28 18:00:16.990850 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.990823 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f31e431d-fcac-423c-89d0-1905bd47a348-config-volume\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.991198 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.991160 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819ef033-8b96-46dd-a1c4-c767b7c094d0-ca-trust-extracted\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.992329 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.992021 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f31e431d-fcac-423c-89d0-1905bd47a348-tmp-dir\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:16.992451 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.992433 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-certificates\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.992504 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.992447 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-trusted-ca\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.995121 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.995103 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-installation-pull-secrets\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.995204 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.995123 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-image-registry-private-configuration\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:16.995204 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:16.995152 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b5c0a08-17fb-43c7-bc66-29f054141d40-cert\") pod \"ingress-canary-w4bh8\" (UID: \"4b5c0a08-17fb-43c7-bc66-29f054141d40\") " pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:17.001273 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.001235 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cgcb\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-kube-api-access-9cgcb\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:17.001389 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.001353 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-bound-sa-token\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:17.002046 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.002024 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2sfp\" (UniqueName: \"kubernetes.io/projected/4b5c0a08-17fb-43c7-bc66-29f054141d40-kube-api-access-q2sfp\") pod \"ingress-canary-w4bh8\" (UID: \"4b5c0a08-17fb-43c7-bc66-29f054141d40\") " pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:17.002166 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.002143 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-598t8\" (UniqueName: \"kubernetes.io/projected/f31e431d-fcac-423c-89d0-1905bd47a348-kube-api-access-598t8\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:17.066474 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.066427 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4bh8" Jul 28 18:00:17.373109 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.373074 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:17.373298 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.373074 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:17.373298 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.373238 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:17.375748 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.375722 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hrc4\"" Jul 28 18:00:17.375894 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.375820 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 18:00:17.375894 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.375846 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 18:00:17.376015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.375850 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 18:00:17.376015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.376000 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvkg8\"" Jul 28 18:00:17.376140 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.376126 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 18:00:17.494270 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.494230 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:17.494496 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.494304 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:17.494496 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:17.494417 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:17.494496 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:17.494493 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls podName:f31e431d-fcac-423c-89d0-1905bd47a348 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:18.4944756 +0000 UTC m=+37.589301634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls") pod "dns-default-p47xq" (UID: "f31e431d-fcac-423c-89d0-1905bd47a348") : secret "dns-default-metrics-tls" not found Jul 28 18:00:17.494652 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:17.494421 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:17.494652 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:17.494518 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7895f44d4f-d6bd2: secret "image-registry-tls" not found Jul 28 18:00:17.494652 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:17.494575 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls podName:819ef033-8b96-46dd-a1c4-c767b7c094d0 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:18.494558272 +0000 UTC m=+37.589384323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls") pod "image-registry-7895f44d4f-d6bd2" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0") : secret "image-registry-tls" not found Jul 28 18:00:17.722832 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:17.722651 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4bh8"] Jul 28 18:00:17.726683 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:00:17.726656 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5c0a08_17fb_43c7_bc66_29f054141d40.slice/crio-7ba28388492f08ef514bddfa4fc104c6d4aecfb3468b25e04aac3446add3b573 WatchSource:0}: Error finding container 7ba28388492f08ef514bddfa4fc104c6d4aecfb3468b25e04aac3446add3b573: Status 404 returned error can't find the container with id 7ba28388492f08ef514bddfa4fc104c6d4aecfb3468b25e04aac3446add3b573 Jul 28 18:00:18.503530 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:18.503493 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:18.503726 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:18.503563 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:18.503726 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:18.503660 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:18.503726 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:18.503663 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:18.503726 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:18.503685 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7895f44d4f-d6bd2: secret "image-registry-tls" not found Jul 28 18:00:18.503726 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:18.503712 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls podName:f31e431d-fcac-423c-89d0-1905bd47a348 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:20.503698802 +0000 UTC m=+39.598524836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls") pod "dns-default-p47xq" (UID: "f31e431d-fcac-423c-89d0-1905bd47a348") : secret "dns-default-metrics-tls" not found Jul 28 18:00:18.503941 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:18.503751 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls podName:819ef033-8b96-46dd-a1c4-c767b7c094d0 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:20.50372051 +0000 UTC m=+39.598546561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls") pod "image-registry-7895f44d4f-d6bd2" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0") : secret "image-registry-tls" not found Jul 28 18:00:18.706036 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:18.706000 2531 generic.go:356] "Generic (PLEG): container finished" podID="e10d3429-0fea-48f5-9ed5-1efc3a675453" containerID="654ad1908cc43a7b49f249f499701170814c9319ee07591213ae8eb9c23746df" exitCode=0 Jul 28 18:00:18.706218 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:18.706085 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerDied","Data":"654ad1908cc43a7b49f249f499701170814c9319ee07591213ae8eb9c23746df"} Jul 28 18:00:18.707632 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:18.707597 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4bh8" event={"ID":"4b5c0a08-17fb-43c7-bc66-29f054141d40","Type":"ContainerStarted","Data":"7ba28388492f08ef514bddfa4fc104c6d4aecfb3468b25e04aac3446add3b573"} Jul 28 18:00:19.713980 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:19.713943 2531 generic.go:356] "Generic (PLEG): container finished" podID="e10d3429-0fea-48f5-9ed5-1efc3a675453" containerID="9755e4935292a388d609ac77b66b10a08fa3022663c551ecfda62c41a757078e" exitCode=0 Jul 28 18:00:19.714353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:19.713988 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerDied","Data":"9755e4935292a388d609ac77b66b10a08fa3022663c551ecfda62c41a757078e"} Jul 28 18:00:20.524769 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:20.524744 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:20.524907 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:20.524815 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:20.524985 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:20.524927 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:20.524985 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:20.524944 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:20.524985 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:20.524947 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7895f44d4f-d6bd2: secret "image-registry-tls" not found Jul 28 18:00:20.525099 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:20.525001 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls podName:f31e431d-fcac-423c-89d0-1905bd47a348 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:24.52498684 +0000 UTC m=+43.619812898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls") pod "dns-default-p47xq" (UID: "f31e431d-fcac-423c-89d0-1905bd47a348") : secret "dns-default-metrics-tls" not found Jul 28 18:00:20.525099 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:20.525015 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls podName:819ef033-8b96-46dd-a1c4-c767b7c094d0 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:24.525009925 +0000 UTC m=+43.619835959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls") pod "image-registry-7895f44d4f-d6bd2" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0") : secret "image-registry-tls" not found Jul 28 18:00:20.719643 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:20.719613 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" event={"ID":"e10d3429-0fea-48f5-9ed5-1efc3a675453","Type":"ContainerStarted","Data":"4738eb31728d8c7a7f3e766bd5104d562ddba190684e5f577c4f444d402e43d3"} Jul 28 18:00:20.744713 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:20.744657 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7vkbr" podStartSLOduration=9.031260335 podStartE2EDuration="39.744637314s" totalImagesPullingTime="30.713376979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:20.743759393 +0000 UTC m=+39.838585470" watchObservedRunningTime="2026-07-28 18:00:20.744637314 +0000 UTC m=+39.839463371" Jul 28 18:00:20.871622 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:20.871440 2531 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftfxg_87f8ac69-acda-4005-adc4-da8508ba47f1/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:20.971069 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:20.970968 2531 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftfxg_87f8ac69-acda-4005-adc4-da8508ba47f1/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:21.180179 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:21.180143 2531 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftfxg_87f8ac69-acda-4005-adc4-da8508ba47f1/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:21.245153 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:21.245064 2531 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftfxg_87f8ac69-acda-4005-adc4-da8508ba47f1/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:21.723614 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:21.723579 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4bh8" event={"ID":"4b5c0a08-17fb-43c7-bc66-29f054141d40","Type":"ContainerStarted","Data":"5d831dfbacd8a76e53adf81b134213c2e317fac03e4829d61dfce769d94db6fd"} Jul 28 18:00:21.739612 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:21.739556 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w4bh8" podStartSLOduration=2.793861477 podStartE2EDuration="5.739536633s" totalImagesPullingTime="2.945675156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:21.739424859 +0000 UTC m=+40.834250925" watchObservedRunningTime="2026-07-28 18:00:21.739536633 +0000 UTC m=+40.834362692" Jul 28 18:00:24.556145 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:24.556102 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:24.556624 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:24.556164 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:24.556624 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:24.556282 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:24.556624 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:24.556285 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:24.556624 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:24.556293 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7895f44d4f-d6bd2: secret "image-registry-tls" not found Jul 28 18:00:24.556624 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:24.556360 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls podName:819ef033-8b96-46dd-a1c4-c767b7c094d0 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:32.556341908 +0000 UTC m=+51.651167963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls") pod "image-registry-7895f44d4f-d6bd2" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0") : secret "image-registry-tls" not found Jul 28 18:00:24.556624 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:24.556372 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls podName:f31e431d-fcac-423c-89d0-1905bd47a348 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:32.556366605 +0000 UTC m=+51.651192640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls") pod "dns-default-p47xq" (UID: "f31e431d-fcac-423c-89d0-1905bd47a348") : secret "dns-default-metrics-tls" not found Jul 28 18:00:32.612036 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:32.611991 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:32.612687 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:32.612089 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:32.612687 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:32.612202 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:32.612687 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:32.612225 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7895f44d4f-d6bd2: secret "image-registry-tls" not found Jul 28 18:00:32.612687 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:32.612245 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:32.612687 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:32.612331 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls podName:f31e431d-fcac-423c-89d0-1905bd47a348 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.61230892 +0000 UTC m=+67.707134973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls") pod "dns-default-p47xq" (UID: "f31e431d-fcac-423c-89d0-1905bd47a348") : secret "dns-default-metrics-tls" not found Jul 28 18:00:32.612687 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:32.612352 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls podName:819ef033-8b96-46dd-a1c4-c767b7c094d0 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.612342172 +0000 UTC m=+67.707168209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls") pod "image-registry-7895f44d4f-d6bd2" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0") : secret "image-registry-tls" not found Jul 28 18:00:40.975101 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.975068 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h"] Jul 28 18:00:40.977255 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.977234 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" Jul 28 18:00:40.980504 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.980480 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xmw4m\"" Jul 28 18:00:40.980719 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.980705 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dgmp5"] Jul 28 18:00:40.982161 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.982144 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm"] Jul 28 18:00:40.982276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.982260 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:40.983715 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.983700 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:40.984821 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.984528 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:40.985385 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.985367 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 18:00:40.985970 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.985954 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:40.986062 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.985954 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 18:00:40.986276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.986258 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:40.986276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.986272 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g8z7q\"" Jul 28 18:00:40.986402 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.986288 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:40.986544 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.986531 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 18:00:40.986817 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.986803 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pncfh\"" Jul 28 18:00:40.992601 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.992580 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 18:00:40.996746 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.996676 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h"] Jul 28 18:00:40.997408 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:40.997369 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dgmp5"] Jul 28 18:00:41.001668 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.001646 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm"] Jul 28 18:00:41.071949 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.071909 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d49ae05b-a674-49ff-a1bd-248c87459476-config\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.072148 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.072001 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d49ae05b-a674-49ff-a1bd-248c87459476-serving-cert\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.072148 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.072049 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds92h\" (UniqueName: \"kubernetes.io/projected/5d851bc1-870b-4e72-8b3e-4df7f9c19635-kube-api-access-ds92h\") pod \"network-check-source-7d88cb55d8-9nf6h\" (UID: \"5d851bc1-870b-4e72-8b3e-4df7f9c19635\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" Jul 28 18:00:41.072148 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.072071 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgc5\" (UniqueName: \"kubernetes.io/projected/d49ae05b-a674-49ff-a1bd-248c87459476-kube-api-access-mfgc5\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.072148 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.072123 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:41.072393 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.072153 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j4ht\" (UniqueName: \"kubernetes.io/projected/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-kube-api-access-2j4ht\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:41.072393 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.072189 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49ae05b-a674-49ff-a1bd-248c87459476-trusted-ca\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.081305 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.081272 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b46fb7df9-5d469"] Jul 28 18:00:41.083507 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.083491 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.085846 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.085823 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 18:00:41.085846 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.085836 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 18:00:41.086032 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.085927 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 18:00:41.086152 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.086137 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 18:00:41.086209 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.086162 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8jnzk\"" Jul 28 18:00:41.086260 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.086162 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 18:00:41.086260 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.086162 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 18:00:41.104077 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.104051 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b46fb7df9-5d469"] Jul 28 18:00:41.172970 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.172937 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.173163 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.172997 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-default-certificate\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.173163 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173086 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d49ae05b-a674-49ff-a1bd-248c87459476-config\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.173163 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173143 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d49ae05b-a674-49ff-a1bd-248c87459476-serving-cert\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.173163 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173164 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz6fw\" (UniqueName: \"kubernetes.io/projected/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-kube-api-access-dz6fw\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.173363 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173195 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds92h\" (UniqueName: \"kubernetes.io/projected/5d851bc1-870b-4e72-8b3e-4df7f9c19635-kube-api-access-ds92h\") pod \"network-check-source-7d88cb55d8-9nf6h\" (UID: \"5d851bc1-870b-4e72-8b3e-4df7f9c19635\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" Jul 28 18:00:41.173363 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173213 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgc5\" (UniqueName: \"kubernetes.io/projected/d49ae05b-a674-49ff-a1bd-248c87459476-kube-api-access-mfgc5\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.173363 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173229 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:41.173363 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173350 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j4ht\" (UniqueName: \"kubernetes.io/projected/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-kube-api-access-2j4ht\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:41.173553 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173388 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.173553 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173413 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-stats-auth\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.173553 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.173448 2531 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 18:00:41.173553 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173507 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49ae05b-a674-49ff-a1bd-248c87459476-trusted-ca\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.173553 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.173523 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls podName:02af24f6-ef2c-430b-bf48-4b9e4e0c4574 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:41.673502534 +0000 UTC m=+60.768328568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls") pod "cluster-samples-operator-6748489656-rpsvm" (UID: "02af24f6-ef2c-430b-bf48-4b9e4e0c4574") : secret "samples-operator-tls" not found Jul 28 18:00:41.174006 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.173984 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d49ae05b-a674-49ff-a1bd-248c87459476-config\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.174160 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.174144 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d49ae05b-a674-49ff-a1bd-248c87459476-trusted-ca\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.177500 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.177479 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d49ae05b-a674-49ff-a1bd-248c87459476-serving-cert\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.183255 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.183225 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgc5\" (UniqueName: \"kubernetes.io/projected/d49ae05b-a674-49ff-a1bd-248c87459476-kube-api-access-mfgc5\") pod \"console-operator-584dcb6b54-dgmp5\" (UID: \"d49ae05b-a674-49ff-a1bd-248c87459476\") " pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.183255 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.183238 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds92h\" (UniqueName: \"kubernetes.io/projected/5d851bc1-870b-4e72-8b3e-4df7f9c19635-kube-api-access-ds92h\") pod \"network-check-source-7d88cb55d8-9nf6h\" (UID: \"5d851bc1-870b-4e72-8b3e-4df7f9c19635\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" Jul 28 18:00:41.183779 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.183751 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j4ht\" (UniqueName: \"kubernetes.io/projected/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-kube-api-access-2j4ht\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:41.274463 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.274366 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz6fw\" (UniqueName: \"kubernetes.io/projected/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-kube-api-access-dz6fw\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.274463 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.274440 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.274694 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.274464 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-stats-auth\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.274694 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.274498 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.274694 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.274531 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-default-certificate\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.274694 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.274609 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:00:41.274694 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.274624 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:41.774603319 +0000 UTC m=+60.869429370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : configmap references non-existent config key: service-ca.crt Jul 28 18:00:41.274694 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.274677 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:41.774660206 +0000 UTC m=+60.869486240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : secret "router-metrics-certs-default" not found Jul 28 18:00:41.277181 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.277150 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-default-certificate\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.277288 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.277149 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-stats-auth\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.283851 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.283829 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 18:00:41.290686 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.290665 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xmw4m\"" Jul 28 18:00:41.294164 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.294142 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 18:00:41.299652 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.299627 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" Jul 28 18:00:41.300482 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.300465 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g8z7q\"" Jul 28 18:00:41.304906 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.304855 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz6fw\" (UniqueName: \"kubernetes.io/projected/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-kube-api-access-dz6fw\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.309488 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.309472 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:41.462502 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.462477 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h"] Jul 28 18:00:41.465123 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:00:41.465095 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d851bc1_870b_4e72_8b3e_4df7f9c19635.slice/crio-7d4a4dadff7c8bf2a35a3bb71cb317b9c4c59c91fed798a6c150e48707d4ac6d WatchSource:0}: Error finding container 7d4a4dadff7c8bf2a35a3bb71cb317b9c4c59c91fed798a6c150e48707d4ac6d: Status 404 returned error can't find the container with id 7d4a4dadff7c8bf2a35a3bb71cb317b9c4c59c91fed798a6c150e48707d4ac6d Jul 28 18:00:41.477827 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.477804 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-dgmp5"] Jul 28 18:00:41.481920 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:00:41.481887 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49ae05b_a674_49ff_a1bd_248c87459476.slice/crio-0bffdb28d221bfed3647f355728fe34ddbabc3b229f5cc70b77caa040b63ef6b WatchSource:0}: Error finding container 0bffdb28d221bfed3647f355728fe34ddbabc3b229f5cc70b77caa040b63ef6b: Status 404 returned error can't find the container with id 0bffdb28d221bfed3647f355728fe34ddbabc3b229f5cc70b77caa040b63ef6b Jul 28 18:00:41.678712 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.678614 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:41.678892 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.678766 2531 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 18:00:41.678892 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.678832 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls podName:02af24f6-ef2c-430b-bf48-4b9e4e0c4574 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:42.67881469 +0000 UTC m=+61.773640724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls") pod "cluster-samples-operator-6748489656-rpsvm" (UID: "02af24f6-ef2c-430b-bf48-4b9e4e0c4574") : secret "samples-operator-tls" not found Jul 28 18:00:41.693963 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.693932 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fpmjp" Jul 28 18:00:41.774518 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.774482 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" event={"ID":"d49ae05b-a674-49ff-a1bd-248c87459476","Type":"ContainerStarted","Data":"0bffdb28d221bfed3647f355728fe34ddbabc3b229f5cc70b77caa040b63ef6b"} Jul 28 18:00:41.775525 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.775500 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" event={"ID":"5d851bc1-870b-4e72-8b3e-4df7f9c19635","Type":"ContainerStarted","Data":"7d4a4dadff7c8bf2a35a3bb71cb317b9c4c59c91fed798a6c150e48707d4ac6d"} Jul 28 18:00:41.780165 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.780142 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.780291 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:41.780196 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:41.780291 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.780289 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:42.7802715 +0000 UTC m=+61.875097548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : configmap references non-existent config key: service-ca.crt Jul 28 18:00:41.780407 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.780333 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:00:41.780407 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:41.780394 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:42.780375901 +0000 UTC m=+61.875201934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : secret "router-metrics-certs-default" not found Jul 28 18:00:42.689112 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:42.689073 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:42.689594 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:42.689257 2531 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 18:00:42.689594 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:42.689344 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls podName:02af24f6-ef2c-430b-bf48-4b9e4e0c4574 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.689322834 +0000 UTC m=+63.784148888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls") pod "cluster-samples-operator-6748489656-rpsvm" (UID: "02af24f6-ef2c-430b-bf48-4b9e4e0c4574") : secret "samples-operator-tls" not found Jul 28 18:00:42.789533 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:42.789494 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:42.789734 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:42.789641 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:42.789734 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:42.789670 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:00:42.789850 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:42.789754 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.789733912 +0000 UTC m=+63.884559947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : secret "router-metrics-certs-default" not found Jul 28 18:00:42.789850 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:42.789777 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.789767112 +0000 UTC m=+63.884593147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : configmap references non-existent config key: service-ca.crt Jul 28 18:00:44.707565 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:44.707521 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:44.708043 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:44.707684 2531 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 18:00:44.708043 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:44.707766 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls podName:02af24f6-ef2c-430b-bf48-4b9e4e0c4574 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.707748862 +0000 UTC m=+67.802574896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls") pod "cluster-samples-operator-6748489656-rpsvm" (UID: "02af24f6-ef2c-430b-bf48-4b9e4e0c4574") : secret "samples-operator-tls" not found Jul 28 18:00:44.809285 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:44.809034 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:44.809285 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:44.809098 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:44.809285 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:44.809269 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:00:44.809564 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:44.809351 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.809331825 +0000 UTC m=+67.904157877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : secret "router-metrics-certs-default" not found Jul 28 18:00:44.809564 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:44.809380 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.809358801 +0000 UTC m=+67.904184835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : configmap references non-existent config key: service-ca.crt Jul 28 18:00:45.787422 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:45.787378 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" event={"ID":"5d851bc1-870b-4e72-8b3e-4df7f9c19635","Type":"ContainerStarted","Data":"f86a7354e4b2293bc9fe9a4bc4c3fcb25816a89db05a0557478842d11b481fe5"} Jul 28 18:00:45.789169 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:45.789144 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/0.log" Jul 28 18:00:45.789305 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:45.789186 2531 generic.go:356] "Generic (PLEG): container finished" podID="d49ae05b-a674-49ff-a1bd-248c87459476" containerID="65b76b809ee4fb333efdc1b102a3dbe0fa7fead9d101f3a85ce46c8d0a08edb5" exitCode=255 Jul 28 18:00:45.789305 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:45.789240 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" event={"ID":"d49ae05b-a674-49ff-a1bd-248c87459476","Type":"ContainerDied","Data":"65b76b809ee4fb333efdc1b102a3dbe0fa7fead9d101f3a85ce46c8d0a08edb5"} Jul 28 18:00:45.789482 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:45.789466 2531 scope.go:117] "RemoveContainer" containerID="65b76b809ee4fb333efdc1b102a3dbe0fa7fead9d101f3a85ce46c8d0a08edb5" Jul 28 18:00:45.807078 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:45.807028 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9nf6h" podStartSLOduration=2.445627776 podStartE2EDuration="5.807012546s" totalImagesPullingTime="3.36138477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:45.80583782 +0000 UTC m=+64.900663876" watchObservedRunningTime="2026-07-28 18:00:45.807012546 +0000 UTC m=+64.901838605" Jul 28 18:00:46.472925 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.472887 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5xvt2"] Jul 28 18:00:46.476592 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.476577 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.482738 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.482550 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 18:00:46.483221 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.483197 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cgwfk\"" Jul 28 18:00:46.483339 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.483327 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 18:00:46.483570 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.483554 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 18:00:46.483624 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.483587 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 18:00:46.495595 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.495564 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5xvt2"] Jul 28 18:00:46.524097 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.524064 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzvml\" (UniqueName: \"kubernetes.io/projected/85c654b1-eff6-45c8-8767-75528f9e6875-kube-api-access-gzvml\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.524261 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.524110 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85c654b1-eff6-45c8-8767-75528f9e6875-data-volume\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.524261 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.524150 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.524261 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.524229 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.524363 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.524282 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85c654b1-eff6-45c8-8767-75528f9e6875-crio-socket\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.625428 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.625385 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85c654b1-eff6-45c8-8767-75528f9e6875-data-volume\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.625590 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.625449 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.625590 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.625492 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.625590 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.625533 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85c654b1-eff6-45c8-8767-75528f9e6875-crio-socket\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.625590 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.625573 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzvml\" (UniqueName: \"kubernetes.io/projected/85c654b1-eff6-45c8-8767-75528f9e6875-kube-api-access-gzvml\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.625736 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:46.625599 2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:46.625736 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:46.625613 2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:46.625736 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:46.625662 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:47.12564605 +0000 UTC m=+66.220472083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : configmap "kube-rbac-proxy" not found Jul 28 18:00:46.625736 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:46.625689 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:47.125671224 +0000 UTC m=+66.220497277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:46.625736 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.625691 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85c654b1-eff6-45c8-8767-75528f9e6875-crio-socket\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.625924 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.625826 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85c654b1-eff6-45c8-8767-75528f9e6875-data-volume\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.635172 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.635141 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzvml\" (UniqueName: \"kubernetes.io/projected/85c654b1-eff6-45c8-8767-75528f9e6875-kube-api-access-gzvml\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:46.793154 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.793084 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/1.log" Jul 28 18:00:46.793520 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.793491 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/0.log" Jul 28 18:00:46.793563 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.793530 2531 generic.go:356] "Generic (PLEG): container finished" podID="d49ae05b-a674-49ff-a1bd-248c87459476" containerID="cf7d65a1fc2331792755f661c05f483583ac7c6a3cb555128a01eae0a0c0de77" exitCode=255 Jul 28 18:00:46.793626 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.793608 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" event={"ID":"d49ae05b-a674-49ff-a1bd-248c87459476","Type":"ContainerDied","Data":"cf7d65a1fc2331792755f661c05f483583ac7c6a3cb555128a01eae0a0c0de77"} Jul 28 18:00:46.794384 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.794370 2531 scope.go:117] "RemoveContainer" containerID="65b76b809ee4fb333efdc1b102a3dbe0fa7fead9d101f3a85ce46c8d0a08edb5" Jul 28 18:00:46.794477 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:46.794466 2531 scope.go:117] "RemoveContainer" containerID="cf7d65a1fc2331792755f661c05f483583ac7c6a3cb555128a01eae0a0c0de77" Jul 28 18:00:46.794627 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:46.794609 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgmp5_openshift-console-operator(d49ae05b-a674-49ff-a1bd-248c87459476)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" podUID="d49ae05b-a674-49ff-a1bd-248c87459476" Jul 28 18:00:47.130776 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.130676 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:47.130776 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.130746 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:47.131002 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:47.130806 2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:47.131002 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:47.130842 2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:47.131002 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:47.130857 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.130843075 +0000 UTC m=+67.225669108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : configmap "kube-rbac-proxy" not found Jul 28 18:00:47.131103 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:47.131060 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.131044163 +0000 UTC m=+67.225870197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:47.232108 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.232067 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:47.232295 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.232144 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:00:47.234261 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.234242 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 18:00:47.234358 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.234342 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 18:00:47.242706 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:47.242684 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 18:00:47.242813 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:47.242751 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs podName:3faf12a1-9706-49f3-8981-d1f8ea7517ec nodeName:}" failed. No retries permitted until 2026-07-28 18:01:51.242731329 +0000 UTC m=+130.337557380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs") pod "network-metrics-daemon-zns9q" (UID: "3faf12a1-9706-49f3-8981-d1f8ea7517ec") : secret "metrics-daemon-secret" not found Jul 28 18:00:47.244989 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.244969 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf43db2-ddfa-48a8-aef0-cf406aca7359-original-pull-secret\") pod \"global-pull-secret-syncer-5bnqd\" (UID: \"ccf43db2-ddfa-48a8-aef0-cf406aca7359\") " pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:47.332591 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.332549 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:47.335407 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.335378 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cv48\" (UniqueName: \"kubernetes.io/projected/ff39945a-e97a-4f19-92eb-9034d7ff984a-kube-api-access-4cv48\") pod \"network-check-target-n6wbn\" (UID: \"ff39945a-e97a-4f19-92eb-9034d7ff984a\") " pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:47.385382 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.385295 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bnqd" Jul 28 18:00:47.401210 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.401188 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hrc4\"" Jul 28 18:00:47.409374 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.409350 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:47.522413 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.522380 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5bnqd"] Jul 28 18:00:47.525634 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:00:47.525606 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf43db2_ddfa_48a8_aef0_cf406aca7359.slice/crio-3f13fcd467829cf21ed4fbbc8004219d0e825263f91b2ae68689c13b68eee95c WatchSource:0}: Error finding container 3f13fcd467829cf21ed4fbbc8004219d0e825263f91b2ae68689c13b68eee95c: Status 404 returned error can't find the container with id 3f13fcd467829cf21ed4fbbc8004219d0e825263f91b2ae68689c13b68eee95c Jul 28 18:00:47.552661 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.552637 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n6wbn"] Jul 28 18:00:47.555708 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:00:47.555674 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff39945a_e97a_4f19_92eb_9034d7ff984a.slice/crio-566854de8cbd9472970a72b2349fe314f1842c61103f5f4d5431c6ac8fbf48c2 WatchSource:0}: Error finding container 566854de8cbd9472970a72b2349fe314f1842c61103f5f4d5431c6ac8fbf48c2: Status 404 returned error can't find the container with id 566854de8cbd9472970a72b2349fe314f1842c61103f5f4d5431c6ac8fbf48c2 Jul 28 18:00:47.798254 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.798223 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/1.log" Jul 28 18:00:47.798672 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.798645 2531 scope.go:117] "RemoveContainer" containerID="cf7d65a1fc2331792755f661c05f483583ac7c6a3cb555128a01eae0a0c0de77" Jul 28 18:00:47.798830 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:47.798807 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgmp5_openshift-console-operator(d49ae05b-a674-49ff-a1bd-248c87459476)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" podUID="d49ae05b-a674-49ff-a1bd-248c87459476" Jul 28 18:00:47.799981 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.799958 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n6wbn" event={"ID":"ff39945a-e97a-4f19-92eb-9034d7ff984a","Type":"ContainerStarted","Data":"f42427c224c7c9598765f195dbf3eb4a0351040b26b0eb39b4a7933c8a192ad3"} Jul 28 18:00:47.800072 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.799997 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n6wbn" event={"ID":"ff39945a-e97a-4f19-92eb-9034d7ff984a","Type":"ContainerStarted","Data":"566854de8cbd9472970a72b2349fe314f1842c61103f5f4d5431c6ac8fbf48c2"} Jul 28 18:00:47.800072 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.800033 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:00:47.805011 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.804979 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5bnqd" event={"ID":"ccf43db2-ddfa-48a8-aef0-cf406aca7359","Type":"ContainerStarted","Data":"3f13fcd467829cf21ed4fbbc8004219d0e825263f91b2ae68689c13b68eee95c"} Jul 28 18:00:47.856615 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:47.856564 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n6wbn" podStartSLOduration=66.856546204 podStartE2EDuration="1m6.856546204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:47.855419582 +0000 UTC m=+66.950245637" watchObservedRunningTime="2026-07-28 18:00:47.856546204 +0000 UTC m=+66.951372260" Jul 28 18:00:48.134125 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.134049 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nsg46_2a793fc5-fe86-4b82-99a5-884363908d9d/dns-node-resolver/0.log" Jul 28 18:00:48.139512 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.139478 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:48.139659 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.139558 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:48.139659 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.139631 2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:48.139659 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.139633 2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:48.139756 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.139689 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:50.139670989 +0000 UTC m=+69.234497022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:48.139756 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.139709 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:50.139699985 +0000 UTC m=+69.234526023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : configmap "kube-rbac-proxy" not found Jul 28 18:00:48.642950 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.642905 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:00:48.643131 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.642989 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:00:48.643131 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.643092 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:48.643131 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.643115 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:48.643131 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.643115 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7895f44d4f-d6bd2: secret "image-registry-tls" not found Jul 28 18:00:48.643285 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.643178 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls podName:f31e431d-fcac-423c-89d0-1905bd47a348 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:20.643163716 +0000 UTC m=+99.737989774 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls") pod "dns-default-p47xq" (UID: "f31e431d-fcac-423c-89d0-1905bd47a348") : secret "dns-default-metrics-tls" not found Jul 28 18:00:48.643285 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.643193 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls podName:819ef033-8b96-46dd-a1c4-c767b7c094d0 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:20.643185942 +0000 UTC m=+99.738011976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls") pod "image-registry-7895f44d4f-d6bd2" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0") : secret "image-registry-tls" not found Jul 28 18:00:48.743480 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.743441 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:48.743644 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.743603 2531 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 18:00:48.743700 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.743686 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls podName:02af24f6-ef2c-430b-bf48-4b9e4e0c4574 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:56.743668696 +0000 UTC m=+75.838494734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls") pod "cluster-samples-operator-6748489656-rpsvm" (UID: "02af24f6-ef2c-430b-bf48-4b9e4e0c4574") : secret "samples-operator-tls" not found Jul 28 18:00:48.844191 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.844134 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:48.844651 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:48.844279 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:48.844651 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.844305 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:56.844287731 +0000 UTC m=+75.939113765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : configmap references non-existent config key: service-ca.crt Jul 28 18:00:48.844651 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.844379 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:00:48.844651 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:48.844436 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:56.844420023 +0000 UTC m=+75.939246072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : secret "router-metrics-certs-default" not found Jul 28 18:00:49.133910 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:49.133863 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6bnc_93ade919-a86c-4821-ae45-19b98cef7921/node-ca/0.log" Jul 28 18:00:49.934842 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:49.934803 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4bh8_4b5c0a08-17fb-43c7-bc66-29f054141d40/serve-healthcheck-canary/0.log" Jul 28 18:00:50.157980 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:50.157942 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:50.158176 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:50.158024 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:50.158176 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:50.158125 2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:50.158176 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:50.158138 2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:50.158327 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:50.158217 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:54.158194344 +0000 UTC m=+73.253020379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : configmap "kube-rbac-proxy" not found Jul 28 18:00:50.158327 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:50.158243 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:54.158233534 +0000 UTC m=+73.253059569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:51.309965 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:51.309928 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:51.310327 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:51.309984 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:00:51.310383 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:51.310330 2531 scope.go:117] "RemoveContainer" containerID="cf7d65a1fc2331792755f661c05f483583ac7c6a3cb555128a01eae0a0c0de77" Jul 28 18:00:51.310499 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:51.310478 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgmp5_openshift-console-operator(d49ae05b-a674-49ff-a1bd-248c87459476)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" podUID="d49ae05b-a674-49ff-a1bd-248c87459476" Jul 28 18:00:52.822610 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:52.822571 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5bnqd" event={"ID":"ccf43db2-ddfa-48a8-aef0-cf406aca7359","Type":"ContainerStarted","Data":"da15330fdd8dece3eb09b28ca088fe718d90f2210b64d37d5c4decf9ac477e9e"} Jul 28 18:00:52.843247 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:52.843194 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5bnqd" podStartSLOduration=67.690662156 podStartE2EDuration="1m11.843177573s" totalImagesPullingTime="4.152515417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:52.842445999 +0000 UTC m=+71.937272055" watchObservedRunningTime="2026-07-28 18:00:52.843177573 +0000 UTC m=+71.938003637" Jul 28 18:00:54.194563 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:54.194510 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:54.195052 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:54.194586 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:00:54.195052 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:54.194652 2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:54.195052 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:54.194684 2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:54.195052 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:54.194706 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:02.194692203 +0000 UTC m=+81.289518237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : configmap "kube-rbac-proxy" not found Jul 28 18:00:54.195052 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:54.194753 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:02.194734189 +0000 UTC m=+81.289560229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:56.814749 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:56.814706 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:56.817277 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:56.817254 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02af24f6-ef2c-430b-bf48-4b9e4e0c4574-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rpsvm\" (UID: \"02af24f6-ef2c-430b-bf48-4b9e4e0c4574\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:56.905630 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:56.905598 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pncfh\"" Jul 28 18:00:56.913396 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:56.913377 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" Jul 28 18:00:56.915657 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:56.915630 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:56.915765 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:56.915739 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:00:56.916267 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:56.915792 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:12.915772225 +0000 UTC m=+92.010598259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : configmap references non-existent config key: service-ca.crt Jul 28 18:00:56.916267 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:56.915833 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 18:00:56.916267 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:00:56.915908 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs podName:bab977b3-6bc1-4fbe-928e-7e3f8a89fb20 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:12.915894291 +0000 UTC m=+92.010720325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs") pod "router-default-5b46fb7df9-5d469" (UID: "bab977b3-6bc1-4fbe-928e-7e3f8a89fb20") : secret "router-metrics-certs-default" not found Jul 28 18:00:57.041317 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:57.041282 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm"] Jul 28 18:00:57.840687 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:57.840639 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" event={"ID":"02af24f6-ef2c-430b-bf48-4b9e4e0c4574","Type":"ContainerStarted","Data":"b0aeea5450df9dc7fd111c24ded38437501dd64188b8eb9df9ad475a4f28f9a1"} Jul 28 18:00:58.845354 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:58.845257 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" event={"ID":"02af24f6-ef2c-430b-bf48-4b9e4e0c4574","Type":"ContainerStarted","Data":"a6a94af6778d90b2cf4785f61ab53d949cf68a0323d814ff11d675afc8da2fcc"} Jul 28 18:00:58.845354 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:58.845315 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" event={"ID":"02af24f6-ef2c-430b-bf48-4b9e4e0c4574","Type":"ContainerStarted","Data":"63e6d9957c801e887da6c4b241a41ae0acc86b17fa8fb7ce9f58545835cb9e30"} Jul 28 18:00:58.863108 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:00:58.863054 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rpsvm" podStartSLOduration=17.417017725 podStartE2EDuration="18.863037497s" totalImagesPullingTime="1.446019772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:58.861409692 +0000 UTC m=+77.956235750" watchObservedRunningTime="2026-07-28 18:00:58.863037497 +0000 UTC m=+77.957863607" Jul 28 18:01:02.262115 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:02.262050 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:01:02.262518 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:02.262134 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:01:02.262518 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:02.262223 2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:01:02.262518 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:02.262293 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls podName:85c654b1-eff6-45c8-8767-75528f9e6875 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:18.262276855 +0000 UTC m=+97.357102890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5xvt2" (UID: "85c654b1-eff6-45c8-8767-75528f9e6875") : secret "insights-runtime-extractor-tls" not found Jul 28 18:01:02.262629 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:02.262604 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85c654b1-eff6-45c8-8767-75528f9e6875-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:01:05.373110 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:05.373074 2531 scope.go:117] "RemoveContainer" containerID="cf7d65a1fc2331792755f661c05f483583ac7c6a3cb555128a01eae0a0c0de77" Jul 28 18:01:05.868713 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:05.868685 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/2.log" Jul 28 18:01:05.869079 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:05.869063 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/1.log" Jul 28 18:01:05.869141 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:05.869097 2531 generic.go:356] "Generic (PLEG): container finished" podID="d49ae05b-a674-49ff-a1bd-248c87459476" containerID="69049d51070a0f8a816c9f61669795aab2545ed5cb3c9c93a620e7ca7060269b" exitCode=255 Jul 28 18:01:05.869141 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:05.869131 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" event={"ID":"d49ae05b-a674-49ff-a1bd-248c87459476","Type":"ContainerDied","Data":"69049d51070a0f8a816c9f61669795aab2545ed5cb3c9c93a620e7ca7060269b"} Jul 28 18:01:05.869205 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:05.869171 2531 scope.go:117] "RemoveContainer" containerID="cf7d65a1fc2331792755f661c05f483583ac7c6a3cb555128a01eae0a0c0de77" Jul 28 18:01:05.869568 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:05.869552 2531 scope.go:117] "RemoveContainer" containerID="69049d51070a0f8a816c9f61669795aab2545ed5cb3c9c93a620e7ca7060269b" Jul 28 18:01:05.870285 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:05.870249 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgmp5_openshift-console-operator(d49ae05b-a674-49ff-a1bd-248c87459476)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" podUID="d49ae05b-a674-49ff-a1bd-248c87459476" Jul 28 18:01:06.873825 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:06.873797 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/2.log" Jul 28 18:01:11.309903 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:11.309839 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:01:11.309903 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:11.309925 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:01:11.310374 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:11.310214 2531 scope.go:117] "RemoveContainer" containerID="69049d51070a0f8a816c9f61669795aab2545ed5cb3c9c93a620e7ca7060269b" Jul 28 18:01:11.310412 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:11.310368 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgmp5_openshift-console-operator(d49ae05b-a674-49ff-a1bd-248c87459476)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" podUID="d49ae05b-a674-49ff-a1bd-248c87459476" Jul 28 18:01:12.951750 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:12.951708 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:12.952156 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:12.951825 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:12.952359 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:12.952337 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-service-ca-bundle\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:12.954260 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:12.954230 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab977b3-6bc1-4fbe-928e-7e3f8a89fb20-metrics-certs\") pod \"router-default-5b46fb7df9-5d469\" (UID: \"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20\") " pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:13.195147 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:13.195117 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8jnzk\"" Jul 28 18:01:13.203280 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:13.203204 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:13.348650 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:13.348614 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b46fb7df9-5d469"] Jul 28 18:01:13.351641 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:13.351612 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab977b3_6bc1_4fbe_928e_7e3f8a89fb20.slice/crio-f398b4df01b04218e3d10a4c110827b86fab08e44f47ca3f06f643b1e07f58d0 WatchSource:0}: Error finding container f398b4df01b04218e3d10a4c110827b86fab08e44f47ca3f06f643b1e07f58d0: Status 404 returned error can't find the container with id f398b4df01b04218e3d10a4c110827b86fab08e44f47ca3f06f643b1e07f58d0 Jul 28 18:01:13.897316 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:13.897281 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b46fb7df9-5d469" event={"ID":"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20","Type":"ContainerStarted","Data":"2346216a80b75dafc1fd7e99256ebde92c06209d49f3f32bb49b030f6a98b011"} Jul 28 18:01:13.897551 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:13.897346 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b46fb7df9-5d469" event={"ID":"bab977b3-6bc1-4fbe-928e-7e3f8a89fb20","Type":"ContainerStarted","Data":"f398b4df01b04218e3d10a4c110827b86fab08e44f47ca3f06f643b1e07f58d0"} Jul 28 18:01:13.918369 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:13.918318 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b46fb7df9-5d469" podStartSLOduration=32.918300145 podStartE2EDuration="32.918300145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:13.917082577 +0000 UTC m=+93.011908633" watchObservedRunningTime="2026-07-28 18:01:13.918300145 +0000 UTC m=+93.013126200" Jul 28 18:01:14.203673 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:14.203646 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:14.206283 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:14.206260 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:14.900825 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:14.900790 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:14.902502 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:14.902482 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b46fb7df9-5d469" Jul 28 18:01:15.915763 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:15.915709 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4"] Jul 28 18:01:15.945518 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:15.945484 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4"] Jul 28 18:01:15.945678 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:15.945578 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" Jul 28 18:01:15.948028 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:15.948011 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 18:01:15.948192 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:15.948177 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4gg6m\"" Jul 28 18:01:16.075407 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:16.075377 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a94ef44-1f03-4ada-ba13-197a4c3eb177-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sqnr4\" (UID: \"2a94ef44-1f03-4ada-ba13-197a4c3eb177\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" Jul 28 18:01:16.176685 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:16.176583 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a94ef44-1f03-4ada-ba13-197a4c3eb177-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sqnr4\" (UID: \"2a94ef44-1f03-4ada-ba13-197a4c3eb177\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" Jul 28 18:01:16.179227 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:16.179204 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a94ef44-1f03-4ada-ba13-197a4c3eb177-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sqnr4\" (UID: \"2a94ef44-1f03-4ada-ba13-197a4c3eb177\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" Jul 28 18:01:16.254289 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:16.254251 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" Jul 28 18:01:16.401080 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:16.400961 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4"] Jul 28 18:01:16.403507 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:16.403474 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a94ef44_1f03_4ada_ba13_197a4c3eb177.slice/crio-e6076067a17028a55d4e90123986fd850ad6789d89321cade52b9695d43fa158 WatchSource:0}: Error finding container e6076067a17028a55d4e90123986fd850ad6789d89321cade52b9695d43fa158: Status 404 returned error can't find the container with id e6076067a17028a55d4e90123986fd850ad6789d89321cade52b9695d43fa158 Jul 28 18:01:16.907641 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:16.907606 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" event={"ID":"2a94ef44-1f03-4ada-ba13-197a4c3eb177","Type":"ContainerStarted","Data":"e6076067a17028a55d4e90123986fd850ad6789d89321cade52b9695d43fa158"} Jul 28 18:01:18.294339 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.294299 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:01:18.296973 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.296940 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85c654b1-eff6-45c8-8767-75528f9e6875-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xvt2\" (UID: \"85c654b1-eff6-45c8-8767-75528f9e6875\") " pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:01:18.585471 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.585436 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5xvt2" Jul 28 18:01:18.722122 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.721967 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5xvt2"] Jul 28 18:01:18.724665 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:18.724636 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c654b1_eff6_45c8_8767_75528f9e6875.slice/crio-ddfee37d55cb5246de1b10d753ab803aefec4b5fd3ccde3b08152d03e0ca344c WatchSource:0}: Error finding container ddfee37d55cb5246de1b10d753ab803aefec4b5fd3ccde3b08152d03e0ca344c: Status 404 returned error can't find the container with id ddfee37d55cb5246de1b10d753ab803aefec4b5fd3ccde3b08152d03e0ca344c Jul 28 18:01:18.810417 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.810329 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n6wbn" Jul 28 18:01:18.915511 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.915475 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" event={"ID":"2a94ef44-1f03-4ada-ba13-197a4c3eb177","Type":"ContainerStarted","Data":"1d3d56b6d5c52f54a1fffd53e0801b3ff3ab5bc0c04d9dc77a7a0ab4b2564dab"} Jul 28 18:01:18.915712 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.915698 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" Jul 28 18:01:18.916799 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.916762 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xvt2" event={"ID":"85c654b1-eff6-45c8-8767-75528f9e6875","Type":"ContainerStarted","Data":"ddfee37d55cb5246de1b10d753ab803aefec4b5fd3ccde3b08152d03e0ca344c"} Jul 28 18:01:18.920521 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.920502 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" Jul 28 18:01:18.934094 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:18.934053 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sqnr4" podStartSLOduration=1.8448603609999998 podStartE2EDuration="3.934035602s" totalImagesPullingTime="2.089175241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:18.93348982 +0000 UTC m=+98.028315876" watchObservedRunningTime="2026-07-28 18:01:18.934035602 +0000 UTC m=+98.028861658" Jul 28 18:01:19.990679 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.990072 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wp78d"] Jul 28 18:01:19.992330 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.992303 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:19.994755 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.994721 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 18:01:19.995771 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.995726 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 18:01:19.996238 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.996000 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vn8x4\"" Jul 28 18:01:19.996238 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.996099 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 18:01:19.996238 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.996120 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 18:01:19.996238 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:19.996178 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 18:01:20.002892 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.002845 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wp78d"] Jul 28 18:01:20.010750 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.010717 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.010922 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.010781 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.010922 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.010819 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tdjb\" (UniqueName: \"kubernetes.io/projected/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-kube-api-access-5tdjb\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.011019 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.010920 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.111449 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.111417 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.111650 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.111517 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.111650 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.111563 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.111650 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.111594 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tdjb\" (UniqueName: \"kubernetes.io/projected/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-kube-api-access-5tdjb\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.111804 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:20.111690 2531 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 18:01:20.111804 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:20.111765 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls podName:308fadd9-9a0a-4ec7-8a9c-2b423b09a277 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:20.61174271 +0000 UTC m=+99.706568744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-wp78d" (UID: "308fadd9-9a0a-4ec7-8a9c-2b423b09a277") : secret "prometheus-operator-tls" not found Jul 28 18:01:20.112238 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.112215 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.114292 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.114267 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.123447 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.123419 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tdjb\" (UniqueName: \"kubernetes.io/projected/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-kube-api-access-5tdjb\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.615887 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.615834 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:20.616081 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:20.616048 2531 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 18:01:20.616150 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:20.616133 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls podName:308fadd9-9a0a-4ec7-8a9c-2b423b09a277 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:21.616111943 +0000 UTC m=+100.710937989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-wp78d" (UID: "308fadd9-9a0a-4ec7-8a9c-2b423b09a277") : secret "prometheus-operator-tls" not found Jul 28 18:01:20.716398 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.716356 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:01:20.716595 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.716445 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:01:20.719483 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.719458 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f31e431d-fcac-423c-89d0-1905bd47a348-metrics-tls\") pod \"dns-default-p47xq\" (UID: \"f31e431d-fcac-423c-89d0-1905bd47a348\") " pod="openshift-dns/dns-default-p47xq" Jul 28 18:01:20.720657 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.720634 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"image-registry-7895f44d4f-d6bd2\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:01:20.937484 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.937403 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4hfls\"" Jul 28 18:01:20.945338 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.945299 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:01:20.950996 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.950974 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cpvqd\"" Jul 28 18:01:20.959106 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:20.959050 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p47xq" Jul 28 18:01:21.115034 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:21.114997 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7895f44d4f-d6bd2"] Jul 28 18:01:21.130902 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:21.130842 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p47xq"] Jul 28 18:01:21.625547 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:21.625506 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:21.628459 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:21.628430 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/308fadd9-9a0a-4ec7-8a9c-2b423b09a277-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wp78d\" (UID: \"308fadd9-9a0a-4ec7-8a9c-2b423b09a277\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:21.803952 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:21.803913 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" Jul 28 18:01:23.337328 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:23.337294 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819ef033_8b96_46dd_a1c4_c767b7c094d0.slice/crio-bad9ec3aaaea3449b3f32c776ace4ec93d876d394bedb0ce1dc51b141859186d WatchSource:0}: Error finding container bad9ec3aaaea3449b3f32c776ace4ec93d876d394bedb0ce1dc51b141859186d: Status 404 returned error can't find the container with id bad9ec3aaaea3449b3f32c776ace4ec93d876d394bedb0ce1dc51b141859186d Jul 28 18:01:23.337757 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:23.337639 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31e431d_fcac_423c_89d0_1905bd47a348.slice/crio-7a570df30049dd55c7c39dcfb7d041118ae3dd4c94a4a0e17126d72562adcb8e WatchSource:0}: Error finding container 7a570df30049dd55c7c39dcfb7d041118ae3dd4c94a4a0e17126d72562adcb8e: Status 404 returned error can't find the container with id 7a570df30049dd55c7c39dcfb7d041118ae3dd4c94a4a0e17126d72562adcb8e Jul 28 18:01:23.936087 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:23.936043 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p47xq" event={"ID":"f31e431d-fcac-423c-89d0-1905bd47a348","Type":"ContainerStarted","Data":"7a570df30049dd55c7c39dcfb7d041118ae3dd4c94a4a0e17126d72562adcb8e"} Jul 28 18:01:23.937492 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:23.937454 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" event={"ID":"819ef033-8b96-46dd-a1c4-c767b7c094d0","Type":"ContainerStarted","Data":"bad9ec3aaaea3449b3f32c776ace4ec93d876d394bedb0ce1dc51b141859186d"} Jul 28 18:01:24.341173 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:24.340751 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wp78d"] Jul 28 18:01:24.344085 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:24.344038 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308fadd9_9a0a_4ec7_8a9c_2b423b09a277.slice/crio-d783769b6c52c66c4efc6388d988bea519891a3043b0e9ed4cac9989255183e4 WatchSource:0}: Error finding container d783769b6c52c66c4efc6388d988bea519891a3043b0e9ed4cac9989255183e4: Status 404 returned error can't find the container with id d783769b6c52c66c4efc6388d988bea519891a3043b0e9ed4cac9989255183e4 Jul 28 18:01:24.942722 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:24.942683 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" event={"ID":"308fadd9-9a0a-4ec7-8a9c-2b423b09a277","Type":"ContainerStarted","Data":"d783769b6c52c66c4efc6388d988bea519891a3043b0e9ed4cac9989255183e4"} Jul 28 18:01:24.944525 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:24.944488 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xvt2" event={"ID":"85c654b1-eff6-45c8-8767-75528f9e6875","Type":"ContainerStarted","Data":"58e8de3f9b71f60e366049de2bce2b0352e5442b87ec91e1dad2997134d13c9d"} Jul 28 18:01:24.946209 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:24.946171 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" event={"ID":"819ef033-8b96-46dd-a1c4-c767b7c094d0","Type":"ContainerStarted","Data":"d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae"} Jul 28 18:01:24.946468 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:24.946434 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:01:24.970976 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:24.970921 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" podStartSLOduration=103.970902222 podStartE2EDuration="1m43.970902222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:24.968941804 +0000 UTC m=+104.063767875" watchObservedRunningTime="2026-07-28 18:01:24.970902222 +0000 UTC m=+104.065728279" Jul 28 18:01:25.373665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:25.373104 2531 scope.go:117] "RemoveContainer" containerID="69049d51070a0f8a816c9f61669795aab2545ed5cb3c9c93a620e7ca7060269b" Jul 28 18:01:25.373665 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:25.373294 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-dgmp5_openshift-console-operator(d49ae05b-a674-49ff-a1bd-248c87459476)\"" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" podUID="d49ae05b-a674-49ff-a1bd-248c87459476" Jul 28 18:01:25.954182 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:25.953976 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p47xq" event={"ID":"f31e431d-fcac-423c-89d0-1905bd47a348","Type":"ContainerStarted","Data":"cf62677ab84484f1f0e973f28eb2cada3ea667f65cde5c35673abcfcd567f9ce"} Jul 28 18:01:25.954182 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:25.954079 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p47xq" event={"ID":"f31e431d-fcac-423c-89d0-1905bd47a348","Type":"ContainerStarted","Data":"1e34ba515c9211ae74b2be1f32e79ded0556f8419d455f006c875535c5de1b96"} Jul 28 18:01:25.954182 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:25.954105 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p47xq" Jul 28 18:01:25.983779 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:25.983714 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p47xq" podStartSLOduration=68.257613702 podStartE2EDuration="1m9.983689106s" totalImagesPullingTime="1.726075404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:25.98267291 +0000 UTC m=+105.077498978" watchObservedRunningTime="2026-07-28 18:01:25.983689106 +0000 UTC m=+105.078515163" Jul 28 18:01:26.959805 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:26.959770 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" event={"ID":"308fadd9-9a0a-4ec7-8a9c-2b423b09a277","Type":"ContainerStarted","Data":"bca29198f4a6a6e54fa60dcc24c1269b97a6ab8de16210a5d009a8752906f5b6"} Jul 28 18:01:26.960317 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:26.959827 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" event={"ID":"308fadd9-9a0a-4ec7-8a9c-2b423b09a277","Type":"ContainerStarted","Data":"37669a8fdd7576eb4042a7e22d017bda7d4fdc12a790f16a168cd6c6c52099a0"} Jul 28 18:01:26.980838 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:26.980774 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-wp78d" podStartSLOduration=6.210888152 podStartE2EDuration="7.980751299s" totalImagesPullingTime="1.769863147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:26.979019204 +0000 UTC m=+106.073845260" watchObservedRunningTime="2026-07-28 18:01:26.980751299 +0000 UTC m=+106.075577356" Jul 28 18:01:28.969503 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:28.969471 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xvt2" event={"ID":"85c654b1-eff6-45c8-8767-75528f9e6875","Type":"ContainerStarted","Data":"8fd7d4ac052bd3bb3df380e78c21ce708937fb17022ab0da682df8148937e7b7"} Jul 28 18:01:29.460145 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.460108 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2hpdp"] Jul 28 18:01:29.463583 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.463566 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.465677 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.465657 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 18:01:29.465966 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.465947 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 18:01:29.466049 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.465971 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-552db\"" Jul 28 18:01:29.466106 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.466076 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 18:01:29.501208 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501176 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501208 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501213 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501409 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501232 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t525x\" (UniqueName: \"kubernetes.io/projected/86452666-3538-4571-83e4-4cf52038c8f7-kube-api-access-t525x\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501409 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501289 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-wtmp\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501409 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501329 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86452666-3538-4571-83e4-4cf52038c8f7-metrics-client-ca\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501409 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501362 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-tls\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501409 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501399 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-root\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501556 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501441 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-sys\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.501556 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.501462 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-textfile\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.505618 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.505585 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd"] Jul 28 18:01:29.507728 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.507706 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.510164 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.510135 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 18:01:29.510164 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.510142 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p64cz\"" Jul 28 18:01:29.510548 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.510222 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 18:01:29.510594 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.510560 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 18:01:29.522803 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.522775 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd"] Jul 28 18:01:29.602934 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.602892 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-sys\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603103 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.602941 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.603103 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.602985 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-textfile\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603103 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603006 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-sys\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603103 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603011 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.603103 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603090 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.603299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603123 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2791ac5-f727-45d2-834a-87062c0cc791-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.603299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603149 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603177 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603195 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t525x\" (UniqueName: \"kubernetes.io/projected/86452666-3538-4571-83e4-4cf52038c8f7-kube-api-access-t525x\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603220 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-wtmp\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603244 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e2791ac5-f727-45d2-834a-87062c0cc791-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603364 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-textfile\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603376 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86452666-3538-4571-83e4-4cf52038c8f7-metrics-client-ca\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603409 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-tls\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603430 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-wtmp\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603462 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-root\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603514 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmvgx\" (UniqueName: \"kubernetes.io/projected/e2791ac5-f727-45d2-834a-87062c0cc791-kube-api-access-jmvgx\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:29.603547 2531 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603586 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86452666-3538-4571-83e4-4cf52038c8f7-root\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603602 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:29.603610 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-tls podName:86452666-3538-4571-83e4-4cf52038c8f7 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:30.103589797 +0000 UTC m=+109.198415851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-tls") pod "node-exporter-2hpdp" (UID: "86452666-3538-4571-83e4-4cf52038c8f7") : secret "node-exporter-tls" not found Jul 28 18:01:29.603956 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603779 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.603956 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.603907 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86452666-3538-4571-83e4-4cf52038c8f7-metrics-client-ca\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.605699 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.605677 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.614612 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.614578 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t525x\" (UniqueName: \"kubernetes.io/projected/86452666-3538-4571-83e4-4cf52038c8f7-kube-api-access-t525x\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:29.704834 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.704798 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705022 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.704840 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705022 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.704891 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2791ac5-f727-45d2-834a-87062c0cc791-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705022 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.704925 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e2791ac5-f727-45d2-834a-87062c0cc791-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705022 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.705005 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmvgx\" (UniqueName: \"kubernetes.io/projected/e2791ac5-f727-45d2-834a-87062c0cc791-kube-api-access-jmvgx\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705232 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:29.705036 2531 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 18:01:29.705232 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:29.705107 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-tls podName:e2791ac5-f727-45d2-834a-87062c0cc791 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:30.205089663 +0000 UTC m=+109.299915697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-ngtzd" (UID: "e2791ac5-f727-45d2-834a-87062c0cc791") : secret "kube-state-metrics-tls" not found Jul 28 18:01:29.705232 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.705040 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705458 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.705377 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e2791ac5-f727-45d2-834a-87062c0cc791-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705611 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.705585 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.705723 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.705608 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2791ac5-f727-45d2-834a-87062c0cc791-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.707653 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.707629 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:29.719691 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:29.719618 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmvgx\" (UniqueName: \"kubernetes.io/projected/e2791ac5-f727-45d2-834a-87062c0cc791-kube-api-access-jmvgx\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:30.109374 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.109290 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-tls\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:30.112117 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.112086 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86452666-3538-4571-83e4-4cf52038c8f7-node-exporter-tls\") pod \"node-exporter-2hpdp\" (UID: \"86452666-3538-4571-83e4-4cf52038c8f7\") " pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:30.210389 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.210351 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:30.213243 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.213216 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2791ac5-f727-45d2-834a-87062c0cc791-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-ngtzd\" (UID: \"e2791ac5-f727-45d2-834a-87062c0cc791\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:30.372700 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.372619 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2hpdp" Jul 28 18:01:30.385708 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:30.385671 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86452666_3538_4571_83e4_4cf52038c8f7.slice/crio-42a795a057eb7bacff7d25532fab420bc147aa71d0fa021b945a5feeec80dfa8 WatchSource:0}: Error finding container 42a795a057eb7bacff7d25532fab420bc147aa71d0fa021b945a5feeec80dfa8: Status 404 returned error can't find the container with id 42a795a057eb7bacff7d25532fab420bc147aa71d0fa021b945a5feeec80dfa8 Jul 28 18:01:30.421468 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.421427 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" Jul 28 18:01:30.530924 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.530546 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:01:30.534834 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.534803 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.537498 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.537470 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.538278 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.538481 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.538833 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.539118 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.539321 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.539545 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.539745 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.539955 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-28cp4\"" Jul 28 18:01:30.540680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.540213 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 18:01:30.556423 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.556393 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:01:30.587684 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.587649 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd"] Jul 28 18:01:30.591257 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:30.591226 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2791ac5_f727_45d2_834a_87062c0cc791.slice/crio-56bcf71004b1ae210fb68fb045dcc500a841b1d274e21adc055428f57332ae84 WatchSource:0}: Error finding container 56bcf71004b1ae210fb68fb045dcc500a841b1d274e21adc055428f57332ae84: Status 404 returned error can't find the container with id 56bcf71004b1ae210fb68fb045dcc500a841b1d274e21adc055428f57332ae84 Jul 28 18:01:30.613835 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.613777 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614024 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.613890 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614024 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.613923 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614024 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.613963 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614024 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.613985 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614063 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-out\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614112 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-web-config\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614161 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-volume\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614197 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614224 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614276 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614263 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614570 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614300 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbq9\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-kube-api-access-9vbq9\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.614570 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.614369 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.714798 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.714754 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.714806 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.714846 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-out\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.714884 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-web-config\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.714912 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-volume\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.714948 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715015 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.714972 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715015 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:01:30.714999 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle podName:98e639c5-9cab-4ff7-9b2b-ad3066ad6604 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:31.21497415 +0000 UTC m=+110.309800203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604") : configmap references non-existent config key: ca-bundle.crt Jul 28 18:01:30.715435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.715058 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.715101 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbq9\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-kube-api-access-9vbq9\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.715163 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.715198 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.715235 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.715267 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.715435 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.715383 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.718019 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.717990 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-out\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.718730 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.718704 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.719005 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.718977 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.719927 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.719362 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.719927 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.719837 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.719927 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.719887 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.720656 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.720636 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.720744 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.720640 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-volume\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.721091 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.721071 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.721183 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.721164 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-web-config\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.731067 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.731037 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbq9\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-kube-api-access-9vbq9\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:30.979752 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.979657 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" event={"ID":"e2791ac5-f727-45d2-834a-87062c0cc791","Type":"ContainerStarted","Data":"56bcf71004b1ae210fb68fb045dcc500a841b1d274e21adc055428f57332ae84"} Jul 28 18:01:30.981189 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:30.981152 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hpdp" event={"ID":"86452666-3538-4571-83e4-4cf52038c8f7","Type":"ContainerStarted","Data":"42a795a057eb7bacff7d25532fab420bc147aa71d0fa021b945a5feeec80dfa8"} Jul 28 18:01:31.219008 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:31.218656 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:31.219952 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:31.219930 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:31.450289 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:31.450208 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:01:33.722325 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.722206 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:01:33.727065 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:33.726854 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e639c5_9cab_4ff7_9b2b_ad3066ad6604.slice/crio-1f572a394528ff086a337d838b5d72e23e86d77f4925d620d46ca998181166b0 WatchSource:0}: Error finding container 1f572a394528ff086a337d838b5d72e23e86d77f4925d620d46ca998181166b0: Status 404 returned error can't find the container with id 1f572a394528ff086a337d838b5d72e23e86d77f4925d620d46ca998181166b0 Jul 28 18:01:33.749937 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.749680 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-97686d8cc-54bzn"] Jul 28 18:01:33.754128 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.754106 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.758413 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.757500 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 18:01:33.758413 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.757903 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 18:01:33.758413 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.758014 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zg9rc\"" Jul 28 18:01:33.758413 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.758262 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 18:01:33.758413 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.758288 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 18:01:33.758729 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.758597 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9hcltp3hhgjm1\"" Jul 28 18:01:33.774842 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.774522 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-97686d8cc-54bzn"] Jul 28 18:01:33.843043 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.843017 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h69q7\" (UniqueName: \"kubernetes.io/projected/ac23e3a7-e34e-490b-95d0-f5d238b68785-kube-api-access-h69q7\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.843184 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.843052 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-secret-metrics-server-client-certs\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.843184 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.843112 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-secret-metrics-server-tls\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.843184 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.843127 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac23e3a7-e34e-490b-95d0-f5d238b68785-audit-log\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.843184 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.843153 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac23e3a7-e34e-490b-95d0-f5d238b68785-metrics-server-audit-profiles\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.843184 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.843178 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac23e3a7-e34e-490b-95d0-f5d238b68785-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.843373 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.843246 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-client-ca-bundle\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.943800 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.943762 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h69q7\" (UniqueName: \"kubernetes.io/projected/ac23e3a7-e34e-490b-95d0-f5d238b68785-kube-api-access-h69q7\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.943996 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.943804 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-secret-metrics-server-client-certs\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.943996 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.943920 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-secret-metrics-server-tls\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.943996 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.943945 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac23e3a7-e34e-490b-95d0-f5d238b68785-audit-log\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.944159 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.943996 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac23e3a7-e34e-490b-95d0-f5d238b68785-metrics-server-audit-profiles\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.944159 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.944041 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac23e3a7-e34e-490b-95d0-f5d238b68785-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.944159 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.944083 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-client-ca-bundle\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.944523 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.944470 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac23e3a7-e34e-490b-95d0-f5d238b68785-audit-log\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.944803 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.944772 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac23e3a7-e34e-490b-95d0-f5d238b68785-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.945280 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.945254 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac23e3a7-e34e-490b-95d0-f5d238b68785-metrics-server-audit-profiles\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.946567 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.946539 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-secret-metrics-server-tls\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.946680 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.946660 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-client-ca-bundle\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.946908 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.946891 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac23e3a7-e34e-490b-95d0-f5d238b68785-secret-metrics-server-client-certs\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.952535 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.952515 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h69q7\" (UniqueName: \"kubernetes.io/projected/ac23e3a7-e34e-490b-95d0-f5d238b68785-kube-api-access-h69q7\") pod \"metrics-server-97686d8cc-54bzn\" (UID: \"ac23e3a7-e34e-490b-95d0-f5d238b68785\") " pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:33.995807 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.995695 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" event={"ID":"e2791ac5-f727-45d2-834a-87062c0cc791","Type":"ContainerStarted","Data":"705ed35524eb7bd5865996f874368b328042ff4307bcec6bd653dad1100df738"} Jul 28 18:01:33.995807 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.995755 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" event={"ID":"e2791ac5-f727-45d2-834a-87062c0cc791","Type":"ContainerStarted","Data":"52853ab73a3e8d119777ad30e74a4297f5785bf3ac5bb6b2c8e7bbf132692354"} Jul 28 18:01:33.995807 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.995787 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" event={"ID":"e2791ac5-f727-45d2-834a-87062c0cc791","Type":"ContainerStarted","Data":"adb9cf5fc7751443dd6eba022063f054d93af721ec90d57a1e5bd6f13e27bf6c"} Jul 28 18:01:33.997441 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.997418 2531 generic.go:356] "Generic (PLEG): container finished" podID="86452666-3538-4571-83e4-4cf52038c8f7" containerID="aefddc7f640e381aed5ba9b7669380be8ce274f072590e457d3737e74cd4f051" exitCode=0 Jul 28 18:01:33.997556 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.997498 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hpdp" event={"ID":"86452666-3538-4571-83e4-4cf52038c8f7","Type":"ContainerDied","Data":"aefddc7f640e381aed5ba9b7669380be8ce274f072590e457d3737e74cd4f051"} Jul 28 18:01:33.998810 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:33.998787 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerStarted","Data":"1f572a394528ff086a337d838b5d72e23e86d77f4925d620d46ca998181166b0"} Jul 28 18:01:34.001007 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:34.000983 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xvt2" event={"ID":"85c654b1-eff6-45c8-8767-75528f9e6875","Type":"ContainerStarted","Data":"a9e28315432fc5185097141a197ee58f5d84779145d3e811d2bb1edf39b603e6"} Jul 28 18:01:34.015267 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:34.015219 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-ngtzd" podStartSLOduration=2.04796759 podStartE2EDuration="5.015201219s" totalImagesPullingTime="2.967233629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:34.014939106 +0000 UTC m=+113.109765163" watchObservedRunningTime="2026-07-28 18:01:34.015201219 +0000 UTC m=+113.110027276" Jul 28 18:01:34.035114 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:34.035058 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5xvt2" podStartSLOduration=33.354747634 podStartE2EDuration="48.035039878s" totalImagesPullingTime="14.680292244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:34.033700654 +0000 UTC m=+113.128526739" watchObservedRunningTime="2026-07-28 18:01:34.035039878 +0000 UTC m=+113.129865933" Jul 28 18:01:34.114913 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:34.114879 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:34.275624 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:34.275581 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-97686d8cc-54bzn"] Jul 28 18:01:34.279762 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:34.279728 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac23e3a7_e34e_490b_95d0_f5d238b68785.slice/crio-6f17a603593bcd5af760535c8a2e7ef877e2c260fc4073b811566714c9e562fb WatchSource:0}: Error finding container 6f17a603593bcd5af760535c8a2e7ef877e2c260fc4073b811566714c9e562fb: Status 404 returned error can't find the container with id 6f17a603593bcd5af760535c8a2e7ef877e2c260fc4073b811566714c9e562fb Jul 28 18:01:35.007674 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.007637 2531 generic.go:356] "Generic (PLEG): container finished" podID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerID="cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831" exitCode=0 Jul 28 18:01:35.008147 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.007729 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831"} Jul 28 18:01:35.010650 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.010616 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hpdp" event={"ID":"86452666-3538-4571-83e4-4cf52038c8f7","Type":"ContainerStarted","Data":"13fd82da3e2dd6864ead8c4c4c6eceea22eecd319ee5d6aab2bdc3197ecaff75"} Jul 28 18:01:35.010778 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.010670 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hpdp" event={"ID":"86452666-3538-4571-83e4-4cf52038c8f7","Type":"ContainerStarted","Data":"7a86bce33eadb2cdec3ae50eb0813e38d79da956cd30453cb7e92a7d7a0cc32c"} Jul 28 18:01:35.012148 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.012124 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" event={"ID":"ac23e3a7-e34e-490b-95d0-f5d238b68785","Type":"ContainerStarted","Data":"6f17a603593bcd5af760535c8a2e7ef877e2c260fc4073b811566714c9e562fb"} Jul 28 18:01:35.062291 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.062236 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2hpdp" podStartSLOduration=2.794619185 podStartE2EDuration="6.0622187s" totalImagesPullingTime="3.169608376s" totalInitContainerRuntime="97.991139ms" isStatefulPod=true podCreationTimestamp="2026-07-28 18:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:35.061135262 +0000 UTC m=+114.155961319" watchObservedRunningTime="2026-07-28 18:01:35.0622187 +0000 UTC m=+114.157044778" Jul 28 18:01:35.485765 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.485722 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7895f44d4f-d6bd2"] Jul 28 18:01:35.798839 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.798800 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:01:35.804020 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.803989 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.807092 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.807036 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 18:01:35.807325 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.807260 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 18:01:35.809277 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.809252 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wcxqv\"" Jul 28 18:01:35.809395 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.809311 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 18:01:35.809618 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.809597 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 18:01:35.809714 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.809696 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 18:01:35.809882 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.809829 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 18:01:35.809882 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.809834 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 18:01:35.810086 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.809960 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bh99l72mfvapm\"" Jul 28 18:01:35.810256 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.810199 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 18:01:35.810568 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.810550 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 18:01:35.810568 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.810563 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 18:01:35.810794 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.810780 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 18:01:35.815809 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.812081 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 18:01:35.815809 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.812694 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 18:01:35.818962 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.818910 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 18:01:35.832115 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.832076 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.862832 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mwm8\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-kube-api-access-9mwm8\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.862905 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863023 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863098 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863124 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863154 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863195 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863237 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863267 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863295 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863321 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863346 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863433 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863460 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863529 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.863564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863579 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.864560 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863621 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.864560 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863649 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.864560 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863671 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.864560 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.863692 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.962742 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.962522 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p47xq" Jul 28 18:01:35.964333 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964303 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964489 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964369 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964489 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964397 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964604 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964485 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964604 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964514 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964604 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964551 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964604 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964580 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964805 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964612 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964805 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964640 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964805 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964666 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964805 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964716 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964805 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964739 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.964805 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964788 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965216 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964820 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965216 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964848 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965216 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964925 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965216 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964962 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965216 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.964993 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965216 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.965033 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965490 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.965021 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mwm8\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-kube-api-access-9mwm8\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.965490 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.965359 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.966605 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.965778 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.966605 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.966125 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.966605 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.966244 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.968300 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.967617 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.968300 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.968145 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.969437 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.969255 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.971065 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.969658 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config-out\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.971065 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.970442 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.971550 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.971524 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.974235 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.973860 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-web-config\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.974235 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.973930 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.974235 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.974048 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.974235 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.974094 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.975309 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.975282 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.976843 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.976821 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.979141 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.978760 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.979141 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.978962 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mwm8\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-kube-api-access-9mwm8\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.979141 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.979105 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:35.984810 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:35.984377 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:36.022260 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:36.022111 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" event={"ID":"ac23e3a7-e34e-490b-95d0-f5d238b68785","Type":"ContainerStarted","Data":"2d9f0db741fc5805475c07dbb4aa7cdd5b9a68c7d35b730c8033f7aa27fe2f85"} Jul 28 18:01:36.046462 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:36.046399 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" podStartSLOduration=1.634340954 podStartE2EDuration="3.046379163s" totalImagesPullingTime="1.412038209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:36.043625299 +0000 UTC m=+115.138451356" watchObservedRunningTime="2026-07-28 18:01:36.046379163 +0000 UTC m=+115.141205221" Jul 28 18:01:36.120360 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:36.120321 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:36.292325 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:36.292107 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:01:37.028618 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:37.028581 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerStarted","Data":"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e"} Jul 28 18:01:37.030273 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:37.030249 2531 generic.go:356] "Generic (PLEG): container finished" podID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" exitCode=0 Jul 28 18:01:37.030372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:37.030335 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5"} Jul 28 18:01:37.030438 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:37.030421 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerStarted","Data":"8b51d66038a23705cd643a8f5b88a1f0ccf27a04d813af1470fbb9aa6399a4f1"} Jul 28 18:01:38.037715 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:38.037688 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerStarted","Data":"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb"} Jul 28 18:01:38.038134 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:38.037761 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerStarted","Data":"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63"} Jul 28 18:01:38.038134 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:38.037790 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerStarted","Data":"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8"} Jul 28 18:01:38.038134 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:38.037816 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerStarted","Data":"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c"} Jul 28 18:01:38.373291 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:38.373220 2531 scope.go:117] "RemoveContainer" containerID="69049d51070a0f8a816c9f61669795aab2545ed5cb3c9c93a620e7ca7060269b" Jul 28 18:01:39.046176 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:39.046153 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/2.log" Jul 28 18:01:39.046515 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:39.046235 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" event={"ID":"d49ae05b-a674-49ff-a1bd-248c87459476","Type":"ContainerStarted","Data":"22bfeeadc6ae6b32aa908958e90979d5214a141e62a01b90a9d96d48d1bd7d98"} Jul 28 18:01:39.046622 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:39.046587 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:01:39.052973 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:39.052951 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" Jul 28 18:01:39.067385 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:39.067224 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-dgmp5" podStartSLOduration=55.726642135 podStartE2EDuration="59.067203367s" totalImagesPullingTime="3.340561232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:39.06501637 +0000 UTC m=+118.159842446" watchObservedRunningTime="2026-07-28 18:01:39.067203367 +0000 UTC m=+118.162029424" Jul 28 18:01:40.054589 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:40.054548 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerStarted","Data":"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce"} Jul 28 18:01:40.087168 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:40.087101 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.401943737 podStartE2EDuration="10.087073941s" totalImagesPullingTime="4.664541929s" totalInitContainerRuntime="20.588275ms" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:40.084734148 +0000 UTC m=+119.179560195" watchObservedRunningTime="2026-07-28 18:01:40.087073941 +0000 UTC m=+119.181899997" Jul 28 18:01:42.065173 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:42.065138 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerStarted","Data":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} Jul 28 18:01:42.065546 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:42.065209 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerStarted","Data":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} Jul 28 18:01:45.080335 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:45.080299 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerStarted","Data":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} Jul 28 18:01:45.080694 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:45.080391 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerStarted","Data":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} Jul 28 18:01:45.080694 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:45.080419 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerStarted","Data":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} Jul 28 18:01:45.080694 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:45.080444 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerStarted","Data":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} Jul 28 18:01:45.113287 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:45.113218 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.990859042 podStartE2EDuration="10.113193169s" totalImagesPullingTime="7.092779286s" totalInitContainerRuntime="29.554841ms" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:45.110139905 +0000 UTC m=+124.204965961" watchObservedRunningTime="2026-07-28 18:01:45.113193169 +0000 UTC m=+124.208019242" Jul 28 18:01:45.491898 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:45.491846 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:01:46.120779 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:46.120741 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:01:51.312936 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:51.312894 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:01:51.315402 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:51.315376 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3faf12a1-9706-49f3-8981-d1f8ea7517ec-metrics-certs\") pod \"network-metrics-daemon-zns9q\" (UID: \"3faf12a1-9706-49f3-8981-d1f8ea7517ec\") " pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:01:51.594778 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:51.594681 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvkg8\"" Jul 28 18:01:51.602551 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:51.602527 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zns9q" Jul 28 18:01:51.740372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:51.740266 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zns9q"] Jul 28 18:01:51.743191 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:01:51.743162 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3faf12a1_9706_49f3_8981_d1f8ea7517ec.slice/crio-d83694c286747e11b9afc82b91333ec98437379f5ad51fc702fe598049abd501 WatchSource:0}: Error finding container d83694c286747e11b9afc82b91333ec98437379f5ad51fc702fe598049abd501: Status 404 returned error can't find the container with id d83694c286747e11b9afc82b91333ec98437379f5ad51fc702fe598049abd501 Jul 28 18:01:52.109893 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:52.109846 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zns9q" event={"ID":"3faf12a1-9706-49f3-8981-d1f8ea7517ec","Type":"ContainerStarted","Data":"d83694c286747e11b9afc82b91333ec98437379f5ad51fc702fe598049abd501"} Jul 28 18:01:53.122189 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:53.122146 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zns9q" event={"ID":"3faf12a1-9706-49f3-8981-d1f8ea7517ec","Type":"ContainerStarted","Data":"f6e262a0f83ab807b951b5712a0a1c5b6b4d64f7fa718c367c77f966b4b92b01"} Jul 28 18:01:53.122561 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:53.122244 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zns9q" event={"ID":"3faf12a1-9706-49f3-8981-d1f8ea7517ec","Type":"ContainerStarted","Data":"f166b28b4ad24c87864a48f836ff69da80303c74a1fda622ce2b038abe9d8f2e"} Jul 28 18:01:53.141336 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:53.141289 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zns9q" podStartSLOduration=131.212421058 podStartE2EDuration="2m12.141273283s" totalImagesPullingTime="928.852225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:53.140312491 +0000 UTC m=+132.235138547" watchObservedRunningTime="2026-07-28 18:01:53.141273283 +0000 UTC m=+132.236099393" Jul 28 18:01:54.115324 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:54.115287 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:01:54.115501 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:01:54.115388 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:02:00.511145 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.511081 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" podUID="819ef033-8b96-46dd-a1c4-c767b7c094d0" containerName="registry" containerID="cri-o://d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae" gracePeriod=30 Jul 28 18:02:00.791513 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.791439 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:02:00.889632 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889596 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819ef033-8b96-46dd-a1c4-c767b7c094d0-ca-trust-extracted\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.889632 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889639 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-image-registry-private-configuration\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.889849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889703 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-trusted-ca\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.889849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889728 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-certificates\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.889849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889771 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.889849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889810 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cgcb\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-kube-api-access-9cgcb\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.889849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889846 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-installation-pull-secrets\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.890120 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.889924 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-bound-sa-token\") pod \"819ef033-8b96-46dd-a1c4-c767b7c094d0\" (UID: \"819ef033-8b96-46dd-a1c4-c767b7c094d0\") " Jul 28 18:02:00.890226 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.890189 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:00.891258 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.890177 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:00.893300 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.892988 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:00.893607 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.893434 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:00.897394 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.895071 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:00.897742 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.897599 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-kube-api-access-9cgcb" (OuterVolumeSpecName: "kube-api-access-9cgcb") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "kube-api-access-9cgcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:00.898173 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.898145 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:00.904214 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.904185 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819ef033-8b96-46dd-a1c4-c767b7c094d0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "819ef033-8b96-46dd-a1c4-c767b7c094d0" (UID: "819ef033-8b96-46dd-a1c4-c767b7c094d0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:02:00.990862 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990819 2531 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-tls\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:00.990862 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990858 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cgcb\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-kube-api-access-9cgcb\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:00.991113 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990907 2531 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-installation-pull-secrets\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:00.991113 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990919 2531 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819ef033-8b96-46dd-a1c4-c767b7c094d0-bound-sa-token\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:00.991113 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990930 2531 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819ef033-8b96-46dd-a1c4-c767b7c094d0-ca-trust-extracted\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:00.991113 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990943 2531 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819ef033-8b96-46dd-a1c4-c767b7c094d0-image-registry-private-configuration\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:00.991113 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990954 2531 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-trusted-ca\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:00.991113 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:00.990966 2531 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819ef033-8b96-46dd-a1c4-c767b7c094d0-registry-certificates\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:01.156735 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.156646 2531 generic.go:356] "Generic (PLEG): container finished" podID="819ef033-8b96-46dd-a1c4-c767b7c094d0" containerID="d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae" exitCode=0 Jul 28 18:02:01.156735 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.156702 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" Jul 28 18:02:01.157003 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.156743 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" event={"ID":"819ef033-8b96-46dd-a1c4-c767b7c094d0","Type":"ContainerDied","Data":"d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae"} Jul 28 18:02:01.157003 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.156833 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7895f44d4f-d6bd2" event={"ID":"819ef033-8b96-46dd-a1c4-c767b7c094d0","Type":"ContainerDied","Data":"bad9ec3aaaea3449b3f32c776ace4ec93d876d394bedb0ce1dc51b141859186d"} Jul 28 18:02:01.157003 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.156894 2531 scope.go:117] "RemoveContainer" containerID="d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae" Jul 28 18:02:01.166399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.166378 2531 scope.go:117] "RemoveContainer" containerID="d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae" Jul 28 18:02:01.166677 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:01.166656 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae\": container with ID starting with d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae not found: ID does not exist" containerID="d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae" Jul 28 18:02:01.166749 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.166688 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae"} err="failed to get container status \"d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae\": rpc error: code = NotFound desc = could not find container \"d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae\": container with ID starting with d8acb1049af183b3d5fb92e03c3150dc1aa0007341ad21a19caf23597cde4fae not found: ID does not exist" Jul 28 18:02:01.181973 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.181918 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7895f44d4f-d6bd2"] Jul 28 18:02:01.187078 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.187047 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7895f44d4f-d6bd2"] Jul 28 18:02:01.377881 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:01.377828 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819ef033-8b96-46dd-a1c4-c767b7c094d0" path="/var/lib/kubelet/pods/819ef033-8b96-46dd-a1c4-c767b7c094d0/volumes" Jul 28 18:02:14.120446 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:14.120417 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:02:14.124379 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:14.124353 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-97686d8cc-54bzn" Jul 28 18:02:36.120757 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:36.120659 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:36.137510 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:36.137476 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:36.316174 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:36.316140 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:49.901082 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:49.901049 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:02:49.901676 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:49.901451 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="alertmanager" containerID="cri-o://f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e" gracePeriod=120 Jul 28 18:02:49.901676 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:49.901525 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-metric" containerID="cri-o://a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb" gracePeriod=120 Jul 28 18:02:49.901676 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:49.901542 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="prom-label-proxy" containerID="cri-o://baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce" gracePeriod=120 Jul 28 18:02:49.901676 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:49.901591 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="config-reloader" containerID="cri-o://5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c" gracePeriod=120 Jul 28 18:02:49.901676 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:49.901596 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy" containerID="cri-o://c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63" gracePeriod=120 Jul 28 18:02:49.901892 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:49.901566 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-web" containerID="cri-o://26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8" gracePeriod=120 Jul 28 18:02:50.357139 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357108 2531 generic.go:356] "Generic (PLEG): container finished" podID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerID="baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce" exitCode=0 Jul 28 18:02:50.357139 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357133 2531 generic.go:356] "Generic (PLEG): container finished" podID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerID="c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63" exitCode=0 Jul 28 18:02:50.357139 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357141 2531 generic.go:356] "Generic (PLEG): container finished" podID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerID="5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c" exitCode=0 Jul 28 18:02:50.357139 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357147 2531 generic.go:356] "Generic (PLEG): container finished" podID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerID="f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e" exitCode=0 Jul 28 18:02:50.357402 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357187 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce"} Jul 28 18:02:50.357402 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357258 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63"} Jul 28 18:02:50.357402 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357286 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c"} Jul 28 18:02:50.357402 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:50.357310 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e"} Jul 28 18:02:51.152678 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.152651 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.230087 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230010 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-out\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230087 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230072 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-main-tls\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230095 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-volume\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230118 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vbq9\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-kube-api-access-9vbq9\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230149 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-web\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230183 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230211 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-metrics-client-ca\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230235 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230281 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-tls-assets\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230325 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-web-config\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230365 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-cluster-tls-config\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230789 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230398 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-metric\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.230789 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230447 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-main-db\") pod \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\" (UID: \"98e639c5-9cab-4ff7-9b2b-ad3066ad6604\") " Jul 28 18:02:51.231082 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.230820 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:51.231082 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.231023 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:02:51.232524 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.232467 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:51.234430 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.234400 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:51.234552 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.234447 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:51.234552 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.234489 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-kube-api-access-9vbq9" (OuterVolumeSpecName: "kube-api-access-9vbq9") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "kube-api-access-9vbq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:51.234552 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.234510 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-volume" (OuterVolumeSpecName: "config-volume") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:51.235042 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.235006 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-out" (OuterVolumeSpecName: "config-out") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:02:51.235372 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.235352 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:51.235797 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.235763 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:51.236386 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.236352 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:51.239360 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.239178 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:51.246810 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.246783 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-web-config" (OuterVolumeSpecName: "web-config") pod "98e639c5-9cab-4ff7-9b2b-ad3066ad6604" (UID: "98e639c5-9cab-4ff7-9b2b-ad3066ad6604"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:51.331581 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331551 2531 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-main-db\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331581 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331578 2531 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-out\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331592 2531 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-main-tls\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331601 2531 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-config-volume\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331609 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vbq9\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-kube-api-access-9vbq9\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331618 2531 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331626 2531 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331638 2531 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-metrics-client-ca\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331648 2531 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331656 2531 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-tls-assets\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331665 2531 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-web-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331672 2531 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-cluster-tls-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.331767 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.331681 2531 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98e639c5-9cab-4ff7-9b2b-ad3066ad6604-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:51.363945 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.363912 2531 generic.go:356] "Generic (PLEG): container finished" podID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerID="a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb" exitCode=0 Jul 28 18:02:51.363945 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.363937 2531 generic.go:356] "Generic (PLEG): container finished" podID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerID="26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8" exitCode=0 Jul 28 18:02:51.364137 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.363991 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb"} Jul 28 18:02:51.364137 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.364019 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.364137 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.364084 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8"} Jul 28 18:02:51.364137 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.364128 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98e639c5-9cab-4ff7-9b2b-ad3066ad6604","Type":"ContainerDied","Data":"1f572a394528ff086a337d838b5d72e23e86d77f4925d620d46ca998181166b0"} Jul 28 18:02:51.364271 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.364147 2531 scope.go:117] "RemoveContainer" containerID="baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce" Jul 28 18:02:51.372802 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.372782 2531 scope.go:117] "RemoveContainer" containerID="a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb" Jul 28 18:02:51.380233 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.380215 2531 scope.go:117] "RemoveContainer" containerID="c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63" Jul 28 18:02:51.387172 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.387152 2531 scope.go:117] "RemoveContainer" containerID="26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8" Jul 28 18:02:51.392780 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.392757 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:02:51.395165 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.395132 2531 scope.go:117] "RemoveContainer" containerID="5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c" Jul 28 18:02:51.398041 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.398011 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:02:51.403358 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.403329 2531 scope.go:117] "RemoveContainer" containerID="f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e" Jul 28 18:02:51.410745 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.410730 2531 scope.go:117] "RemoveContainer" containerID="cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831" Jul 28 18:02:51.418646 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.418616 2531 scope.go:117] "RemoveContainer" containerID="baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce" Jul 28 18:02:51.418893 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:51.418848 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce\": container with ID starting with baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce not found: ID does not exist" containerID="baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce" Jul 28 18:02:51.418993 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.418903 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce"} err="failed to get container status \"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce\": rpc error: code = NotFound desc = could not find container \"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce\": container with ID starting with baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce not found: ID does not exist" Jul 28 18:02:51.418993 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.418931 2531 scope.go:117] "RemoveContainer" containerID="a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb" Jul 28 18:02:51.419229 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:51.419209 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb\": container with ID starting with a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb not found: ID does not exist" containerID="a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb" Jul 28 18:02:51.419280 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.419238 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb"} err="failed to get container status \"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb\": rpc error: code = NotFound desc = could not find container \"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb\": container with ID starting with a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb not found: ID does not exist" Jul 28 18:02:51.419280 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.419261 2531 scope.go:117] "RemoveContainer" containerID="c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63" Jul 28 18:02:51.419474 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:51.419457 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63\": container with ID starting with c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63 not found: ID does not exist" containerID="c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63" Jul 28 18:02:51.419528 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.419476 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63"} err="failed to get container status \"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63\": rpc error: code = NotFound desc = could not find container \"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63\": container with ID starting with c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63 not found: ID does not exist" Jul 28 18:02:51.419528 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.419491 2531 scope.go:117] "RemoveContainer" containerID="26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8" Jul 28 18:02:51.419714 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:51.419697 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8\": container with ID starting with 26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8 not found: ID does not exist" containerID="26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8" Jul 28 18:02:51.419779 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.419716 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8"} err="failed to get container status \"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8\": rpc error: code = NotFound desc = could not find container \"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8\": container with ID starting with 26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8 not found: ID does not exist" Jul 28 18:02:51.419779 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.419734 2531 scope.go:117] "RemoveContainer" containerID="5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c" Jul 28 18:02:51.420005 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:51.419983 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c\": container with ID starting with 5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c not found: ID does not exist" containerID="5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c" Jul 28 18:02:51.420063 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420014 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c"} err="failed to get container status \"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c\": rpc error: code = NotFound desc = could not find container \"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c\": container with ID starting with 5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c not found: ID does not exist" Jul 28 18:02:51.420063 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420035 2531 scope.go:117] "RemoveContainer" containerID="f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e" Jul 28 18:02:51.420278 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:51.420259 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e\": container with ID starting with f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e not found: ID does not exist" containerID="f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e" Jul 28 18:02:51.420341 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420287 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e"} err="failed to get container status \"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e\": rpc error: code = NotFound desc = could not find container \"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e\": container with ID starting with f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e not found: ID does not exist" Jul 28 18:02:51.420341 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420310 2531 scope.go:117] "RemoveContainer" containerID="cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831" Jul 28 18:02:51.420529 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:51.420512 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831\": container with ID starting with cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831 not found: ID does not exist" containerID="cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831" Jul 28 18:02:51.420573 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420535 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831"} err="failed to get container status \"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831\": rpc error: code = NotFound desc = could not find container \"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831\": container with ID starting with cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831 not found: ID does not exist" Jul 28 18:02:51.420573 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420555 2531 scope.go:117] "RemoveContainer" containerID="baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce" Jul 28 18:02:51.420741 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420717 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce"} err="failed to get container status \"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce\": rpc error: code = NotFound desc = could not find container \"baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce\": container with ID starting with baf209e7daa92e9285d8102f60e61e0e4e85cb59231ab53fb75f7dc5ce3262ce not found: ID does not exist" Jul 28 18:02:51.420741 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420740 2531 scope.go:117] "RemoveContainer" containerID="a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb" Jul 28 18:02:51.421038 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.420981 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb"} err="failed to get container status \"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb\": rpc error: code = NotFound desc = could not find container \"a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb\": container with ID starting with a7563df8906d9cbc1ddd65410e1adaa4f9a0e95bf447871902451bb4bbe781fb not found: ID does not exist" Jul 28 18:02:51.421038 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.421011 2531 scope.go:117] "RemoveContainer" containerID="c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63" Jul 28 18:02:51.421265 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.421232 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63"} err="failed to get container status \"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63\": rpc error: code = NotFound desc = could not find container \"c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63\": container with ID starting with c46dd2a400b46444d9a9aef566385cfa9c68c79bfdd804bd2223d46eefdb8f63 not found: ID does not exist" Jul 28 18:02:51.421265 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.421262 2531 scope.go:117] "RemoveContainer" containerID="26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8" Jul 28 18:02:51.422112 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.422086 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8"} err="failed to get container status \"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8\": rpc error: code = NotFound desc = could not find container \"26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8\": container with ID starting with 26a496668622a789f07a27431e54403fe55ee06a35d544f3128d4ae10da635f8 not found: ID does not exist" Jul 28 18:02:51.422205 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.422114 2531 scope.go:117] "RemoveContainer" containerID="5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c" Jul 28 18:02:51.422452 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.422422 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c"} err="failed to get container status \"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c\": rpc error: code = NotFound desc = could not find container \"5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c\": container with ID starting with 5e9ab39ebfb99f25b57d7a37270f6405ce0f628a44acc236b6a9674feedeba2c not found: ID does not exist" Jul 28 18:02:51.422452 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.422445 2531 scope.go:117] "RemoveContainer" containerID="f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e" Jul 28 18:02:51.422679 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.422657 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e"} err="failed to get container status \"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e\": rpc error: code = NotFound desc = could not find container \"f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e\": container with ID starting with f10c264e45ef7a5f25d48516076597b8168d6b28ba54baa13523b1391643862e not found: ID does not exist" Jul 28 18:02:51.422679 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.422680 2531 scope.go:117] "RemoveContainer" containerID="cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831" Jul 28 18:02:51.422914 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.422861 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831"} err="failed to get container status \"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831\": rpc error: code = NotFound desc = could not find container \"cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831\": container with ID starting with cea4f08465d6eebd587dcb5d4cecbfc21ff1e08ca03be8e6b559d6ada6f75831 not found: ID does not exist" Jul 28 18:02:51.431904 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.431883 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:02:51.432198 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432184 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="config-reloader" Jul 28 18:02:51.432240 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432203 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="config-reloader" Jul 28 18:02:51.432240 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432220 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="alertmanager" Jul 28 18:02:51.432240 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432226 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="alertmanager" Jul 28 18:02:51.432240 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432237 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-metric" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432243 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-metric" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432253 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="init-config-reloader" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432258 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="init-config-reloader" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432265 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819ef033-8b96-46dd-a1c4-c767b7c094d0" containerName="registry" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432270 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="819ef033-8b96-46dd-a1c4-c767b7c094d0" containerName="registry" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432276 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432281 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432295 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-web" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432303 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-web" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432311 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="prom-label-proxy" Jul 28 18:02:51.432353 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432315 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="prom-label-proxy" Jul 28 18:02:51.432665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432361 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="config-reloader" Jul 28 18:02:51.432665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432370 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-web" Jul 28 18:02:51.432665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432381 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="prom-label-proxy" Jul 28 18:02:51.432665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432389 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="alertmanager" Jul 28 18:02:51.432665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432394 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy-metric" Jul 28 18:02:51.432665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432399 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" containerName="kube-rbac-proxy" Jul 28 18:02:51.432665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.432405 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="819ef033-8b96-46dd-a1c4-c767b7c094d0" containerName="registry" Jul 28 18:02:51.437511 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.437493 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.443180 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.443153 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 18:02:51.443302 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.443287 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-28cp4\"" Jul 28 18:02:51.443618 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.443603 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 18:02:51.443918 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.443903 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 18:02:51.444241 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.444225 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 18:02:51.444313 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.444299 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 18:02:51.444564 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.444548 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 18:02:51.444643 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.444548 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 18:02:51.462371 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.462348 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 18:02:51.494672 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.494586 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:02:51.494822 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.494697 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 18:02:51.533474 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533439 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533490 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533513 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533531 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533581 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-config-out\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533606 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533626 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-web-config\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533665 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533649 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747kb\" (UniqueName: \"kubernetes.io/projected/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-kube-api-access-747kb\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533979 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533676 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533979 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533692 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533979 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533755 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533979 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533794 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.533979 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.533837 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635189 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635124 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635189 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635168 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635446 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635214 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635446 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635238 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635446 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635259 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635446 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635275 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635446 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635297 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-config-out\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635727 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635437 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635727 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635563 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635727 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635605 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-web-config\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635727 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635648 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-747kb\" (UniqueName: \"kubernetes.io/projected/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-kube-api-access-747kb\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635727 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635696 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.635727 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635722 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.636195 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.635758 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.636327 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.636302 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.636667 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.636640 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.638541 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.638481 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.638660 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.638616 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.638798 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.638779 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.638981 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.638956 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.639089 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.639072 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.639322 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.639304 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.639397 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.639317 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-config-out\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.639962 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.639946 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.640236 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.640220 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-web-config\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.647089 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.647073 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-747kb\" (UniqueName: \"kubernetes.io/projected/fd344ab8-3412-47a1-b3fa-3ed9600bf1e6-kube-api-access-747kb\") pod \"alertmanager-main-0\" (UID: \"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.752091 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.752007 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 18:02:51.898492 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:51.898461 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 18:02:51.902342 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:02:51.902312 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd344ab8_3412_47a1_b3fa_3ed9600bf1e6.slice/crio-c6c9cab328d317449adcb69438a0b7073a89d268a058bd4d8a2420d1a51333f6 WatchSource:0}: Error finding container c6c9cab328d317449adcb69438a0b7073a89d268a058bd4d8a2420d1a51333f6: Status 404 returned error can't find the container with id c6c9cab328d317449adcb69438a0b7073a89d268a058bd4d8a2420d1a51333f6 Jul 28 18:02:52.370639 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:52.370608 2531 generic.go:356] "Generic (PLEG): container finished" podID="fd344ab8-3412-47a1-b3fa-3ed9600bf1e6" containerID="db99c19670e8bb06e3ebae084e410eb4591bfbb98e6288bfcc4b774963622b89" exitCode=0 Jul 28 18:02:52.371094 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:52.370695 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerDied","Data":"db99c19670e8bb06e3ebae084e410eb4591bfbb98e6288bfcc4b774963622b89"} Jul 28 18:02:52.371094 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:52.370768 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerStarted","Data":"c6c9cab328d317449adcb69438a0b7073a89d268a058bd4d8a2420d1a51333f6"} Jul 28 18:02:53.387348 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.387312 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e639c5-9cab-4ff7-9b2b-ad3066ad6604" path="/var/lib/kubelet/pods/98e639c5-9cab-4ff7-9b2b-ad3066ad6604/volumes" Jul 28 18:02:53.387985 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.387962 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerStarted","Data":"509123cd78fb4d20952728b343fe51e9c903dc64e3567cb8e34f9895586a6141"} Jul 28 18:02:53.388085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.388018 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerStarted","Data":"9f23f2107269d75bece2ec73f13273d55df7842257fff6d5e7cc8478b591596b"} Jul 28 18:02:53.388085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.388044 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerStarted","Data":"e0c4fbe9c43cfb695b1eef9104fe4ba22a746a4b99e878d4810e05cbbd2fbaab"} Jul 28 18:02:53.388085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.388066 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerStarted","Data":"4d38c0870134ea264318aab3be8305e6a904dd7738f58c3cb88c3998cf6d3fa6"} Jul 28 18:02:53.388180 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.388087 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerStarted","Data":"9ddeb2c389c40bdb7b090c05729b6b0222448f87eada3ca3a3f9fa985fb7c116"} Jul 28 18:02:53.388180 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.388108 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fd344ab8-3412-47a1-b3fa-3ed9600bf1e6","Type":"ContainerStarted","Data":"8ccbecb82553f450f5eae3bb185d2db87b5cf0bba4636a1f2ef3741a23222be6"} Jul 28 18:02:53.420150 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:53.420090 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.400619369 podStartE2EDuration="2.420068338s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.448969ms" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:53.418306834 +0000 UTC m=+192.513132889" watchObservedRunningTime="2026-07-28 18:02:53.420068338 +0000 UTC m=+192.514894395" Jul 28 18:02:54.284008 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.283971 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:54.284633 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.284579 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="prometheus" containerID="cri-o://d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" gracePeriod=600 Jul 28 18:02:54.284997 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.284960 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy" containerID="cri-o://0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" gracePeriod=600 Jul 28 18:02:54.285376 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.284974 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-web" containerID="cri-o://b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" gracePeriod=600 Jul 28 18:02:54.285471 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.285003 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="thanos-sidecar" containerID="cri-o://ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" gracePeriod=600 Jul 28 18:02:54.285556 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.285019 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="config-reloader" containerID="cri-o://47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" gracePeriod=600 Jul 28 18:02:54.285556 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.285235 2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" gracePeriod=600 Jul 28 18:02:54.543259 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.543194 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:54.563057 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563021 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563057 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563056 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-grpc-tls\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563302 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563077 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-trusted-ca-bundle\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563302 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563094 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-metrics-client-certs\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563302 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563128 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563302 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563259 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-tls\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563302 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563300 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-1\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563327 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-db\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563353 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563392 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-serving-certs-ca-bundle\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563428 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config-out\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563451 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-thanos-prometheus-http-client-file\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563486 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-tls-assets\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563486 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563509 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-0\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.563539 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563539 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mwm8\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-kube-api-access-9mwm8\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.564006 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563581 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-web-config\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.564006 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563620 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-kube-rbac-proxy\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.564006 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563649 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-2\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.564006 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563706 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-metrics-client-ca\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.564006 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.563794 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-kubelet-serving-ca-bundle\") pod \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\" (UID: \"68dfcbef-0b66-4435-a898-d6fd1af6b6ee\") " Jul 28 18:02:54.564243 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.564084 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:54.564291 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.564248 2531 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.564569 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.564533 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:02:54.564924 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.564896 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:54.566186 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.566144 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:54.566285 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.566229 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:54.566595 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.566487 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:54.566726 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.566668 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:54.567781 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.567730 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-kube-api-access-9mwm8" (OuterVolumeSpecName: "kube-api-access-9mwm8") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "kube-api-access-9mwm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:54.568087 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.568061 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.568519 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.568487 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.568640 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.568613 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config" (OuterVolumeSpecName: "config") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.568772 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.568738 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.568916 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.568807 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config-out" (OuterVolumeSpecName: "config-out") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:02:54.569024 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.569002 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.569330 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.569302 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.569572 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.569549 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.570099 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.570079 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:54.570593 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.570568 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.584654 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.584615 2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-web-config" (OuterVolumeSpecName: "web-config") pod "68dfcbef-0b66-4435-a898-d6fd1af6b6ee" (UID: "68dfcbef-0b66-4435-a898-d6fd1af6b6ee"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:54.664813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664776 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mwm8\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-kube-api-access-9mwm8\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.664813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664809 2531 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-web-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.664813 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664818 2531 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-kube-rbac-proxy\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664827 2531 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664836 2531 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-metrics-client-ca\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664848 2531 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664858 2531 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664891 2531 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-grpc-tls\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664900 2531 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-metrics-client-certs\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664908 2531 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664917 2531 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664926 2531 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664935 2531 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-db\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664943 2531 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664950 2531 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664960 2531 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-config-out\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664970 2531 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664978 2531 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-tls-assets\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:54.665085 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:54.664986 2531 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68dfcbef-0b66-4435-a898-d6fd1af6b6ee-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 28 18:02:55.401176 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401143 2531 generic.go:356] "Generic (PLEG): container finished" podID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" exitCode=0 Jul 28 18:02:55.401176 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401175 2531 generic.go:356] "Generic (PLEG): container finished" podID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" exitCode=0 Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401184 2531 generic.go:356] "Generic (PLEG): container finished" podID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" exitCode=0 Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401192 2531 generic.go:356] "Generic (PLEG): container finished" podID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" exitCode=0 Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401200 2531 generic.go:356] "Generic (PLEG): container finished" podID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" exitCode=0 Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401207 2531 generic.go:356] "Generic (PLEG): container finished" podID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" exitCode=0 Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401225 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401291 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401236 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401319 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401344 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401367 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401378 2531 scope.go:117] "RemoveContainer" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.401399 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401390 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} Jul 28 18:02:55.401851 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.401416 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68dfcbef-0b66-4435-a898-d6fd1af6b6ee","Type":"ContainerDied","Data":"8b51d66038a23705cd643a8f5b88a1f0ccf27a04d813af1470fbb9aa6399a4f1"} Jul 28 18:02:55.409457 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.409437 2531 scope.go:117] "RemoveContainer" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.416810 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.416790 2531 scope.go:117] "RemoveContainer" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.424423 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.424394 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:55.424879 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.424852 2531 scope.go:117] "RemoveContainer" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.427975 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.427953 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:55.432423 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.432406 2531 scope.go:117] "RemoveContainer" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.439409 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.439390 2531 scope.go:117] "RemoveContainer" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.447377 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.447357 2531 scope.go:117] "RemoveContainer" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.452533 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452514 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:55.452831 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452816 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="init-config-reloader" Jul 28 18:02:55.452935 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452834 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="init-config-reloader" Jul 28 18:02:55.452935 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452847 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy" Jul 28 18:02:55.452935 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452857 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy" Jul 28 18:02:55.452935 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452911 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="config-reloader" Jul 28 18:02:55.452935 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452921 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="config-reloader" Jul 28 18:02:55.452935 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452936 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="prometheus" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452944 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="prometheus" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452958 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="thanos-sidecar" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452968 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="thanos-sidecar" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452977 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-thanos" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452986 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-thanos" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.452997 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-web" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.453006 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-web" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.453083 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="config-reloader" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.453095 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-web" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.453106 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy-thanos" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.453117 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="prometheus" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.453126 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="kube-rbac-proxy" Jul 28 18:02:55.453269 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.453136 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" containerName="thanos-sidecar" Jul 28 18:02:55.455535 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.455513 2531 scope.go:117] "RemoveContainer" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.460549 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:55.460465 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": container with ID starting with 0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c not found: ID does not exist" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.460764 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.460509 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} err="failed to get container status \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": rpc error: code = NotFound desc = could not find container \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": container with ID starting with 0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c not found: ID does not exist" Jul 28 18:02:55.460911 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.460771 2531 scope.go:117] "RemoveContainer" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.461178 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:55.461156 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": container with ID starting with 0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8 not found: ID does not exist" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.461250 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.461189 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} err="failed to get container status \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": rpc error: code = NotFound desc = could not find container \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": container with ID starting with 0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8 not found: ID does not exist" Jul 28 18:02:55.461250 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.461209 2531 scope.go:117] "RemoveContainer" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.461525 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:55.461505 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": container with ID starting with b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937 not found: ID does not exist" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.461582 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.461530 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} err="failed to get container status \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": rpc error: code = NotFound desc = could not find container \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": container with ID starting with b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937 not found: ID does not exist" Jul 28 18:02:55.461582 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.461547 2531 scope.go:117] "RemoveContainer" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.461795 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:55.461778 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": container with ID starting with ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff not found: ID does not exist" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.461849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.461801 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} err="failed to get container status \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": rpc error: code = NotFound desc = could not find container \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": container with ID starting with ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff not found: ID does not exist" Jul 28 18:02:55.461849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.461816 2531 scope.go:117] "RemoveContainer" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.462128 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.462113 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.462218 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:55.462108 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": container with ID starting with 47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850 not found: ID does not exist" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.462267 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.462230 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} err="failed to get container status \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": rpc error: code = NotFound desc = could not find container \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": container with ID starting with 47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850 not found: ID does not exist" Jul 28 18:02:55.462267 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.462251 2531 scope.go:117] "RemoveContainer" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.462617 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:55.462588 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": container with ID starting with d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f not found: ID does not exist" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.462710 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.462625 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} err="failed to get container status \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": rpc error: code = NotFound desc = could not find container \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": container with ID starting with d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f not found: ID does not exist" Jul 28 18:02:55.462710 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.462644 2531 scope.go:117] "RemoveContainer" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.462952 ip-10-0-140-220 kubenswrapper[2531]: E0728 18:02:55.462934 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": container with ID starting with 8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5 not found: ID does not exist" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.463007 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.462959 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5"} err="failed to get container status \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": rpc error: code = NotFound desc = could not find container \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": container with ID starting with 8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5 not found: ID does not exist" Jul 28 18:02:55.463007 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.462974 2531 scope.go:117] "RemoveContainer" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.463216 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.463196 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} err="failed to get container status \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": rpc error: code = NotFound desc = could not find container \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": container with ID starting with 0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c not found: ID does not exist" Jul 28 18:02:55.463296 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.463217 2531 scope.go:117] "RemoveContainer" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.463474 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.463450 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} err="failed to get container status \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": rpc error: code = NotFound desc = could not find container \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": container with ID starting with 0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8 not found: ID does not exist" Jul 28 18:02:55.463528 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.463478 2531 scope.go:117] "RemoveContainer" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.463745 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.463723 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} err="failed to get container status \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": rpc error: code = NotFound desc = could not find container \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": container with ID starting with b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937 not found: ID does not exist" Jul 28 18:02:55.463821 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.463748 2531 scope.go:117] "RemoveContainer" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.464032 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.464015 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} err="failed to get container status \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": rpc error: code = NotFound desc = could not find container \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": container with ID starting with ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff not found: ID does not exist" Jul 28 18:02:55.464110 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.464034 2531 scope.go:117] "RemoveContainer" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.464379 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.464297 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} err="failed to get container status \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": rpc error: code = NotFound desc = could not find container \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": container with ID starting with 47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850 not found: ID does not exist" Jul 28 18:02:55.464451 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.464387 2531 scope.go:117] "RemoveContainer" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.464676 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.464648 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} err="failed to get container status \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": rpc error: code = NotFound desc = could not find container \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": container with ID starting with d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f not found: ID does not exist" Jul 28 18:02:55.464738 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.464684 2531 scope.go:117] "RemoveContainer" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.465012 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.464978 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5"} err="failed to get container status \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": rpc error: code = NotFound desc = could not find container \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": container with ID starting with 8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5 not found: ID does not exist" Jul 28 18:02:55.465117 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465010 2531 scope.go:117] "RemoveContainer" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.465328 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465303 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} err="failed to get container status \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": rpc error: code = NotFound desc = could not find container \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": container with ID starting with 0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c not found: ID does not exist" Jul 28 18:02:55.465328 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465328 2531 scope.go:117] "RemoveContainer" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.465497 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465340 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 18:02:55.465497 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465345 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 18:02:55.465691 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465670 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} err="failed to get container status \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": rpc error: code = NotFound desc = could not find container \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": container with ID starting with 0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8 not found: ID does not exist" Jul 28 18:02:55.465773 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465694 2531 scope.go:117] "RemoveContainer" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.465773 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465720 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 18:02:55.466007 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.465982 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} err="failed to get container status \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": rpc error: code = NotFound desc = could not find container \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": container with ID starting with b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937 not found: ID does not exist" Jul 28 18:02:55.466103 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466007 2531 scope.go:117] "RemoveContainer" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.466103 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466067 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 18:02:55.466277 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466108 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 18:02:55.466277 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466137 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 18:02:55.466277 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466184 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 18:02:55.466431 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466294 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 18:02:55.466431 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466298 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 18:02:55.466431 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466334 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bh99l72mfvapm\"" Jul 28 18:02:55.466431 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466300 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 18:02:55.466595 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466462 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} err="failed to get container status \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": rpc error: code = NotFound desc = could not find container \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": container with ID starting with ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff not found: ID does not exist" Jul 28 18:02:55.466595 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466492 2531 scope.go:117] "RemoveContainer" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.466693 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466593 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 18:02:55.466693 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466618 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wcxqv\"" Jul 28 18:02:55.466849 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466829 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} err="failed to get container status \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": rpc error: code = NotFound desc = could not find container \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": container with ID starting with 47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850 not found: ID does not exist" Jul 28 18:02:55.466940 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466852 2531 scope.go:117] "RemoveContainer" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.466940 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.466918 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 18:02:55.467228 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.467206 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} err="failed to get container status \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": rpc error: code = NotFound desc = could not find container \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": container with ID starting with d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f not found: ID does not exist" Jul 28 18:02:55.467274 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.467231 2531 scope.go:117] "RemoveContainer" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.467496 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.467475 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5"} err="failed to get container status \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": rpc error: code = NotFound desc = could not find container \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": container with ID starting with 8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5 not found: ID does not exist" Jul 28 18:02:55.467496 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.467496 2531 scope.go:117] "RemoveContainer" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.467740 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.467712 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} err="failed to get container status \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": rpc error: code = NotFound desc = could not find container \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": container with ID starting with 0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c not found: ID does not exist" Jul 28 18:02:55.467787 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.467740 2531 scope.go:117] "RemoveContainer" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.468013 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.467994 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} err="failed to get container status \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": rpc error: code = NotFound desc = could not find container \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": container with ID starting with 0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8 not found: ID does not exist" Jul 28 18:02:55.468074 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.468015 2531 scope.go:117] "RemoveContainer" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.468261 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.468245 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} err="failed to get container status \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": rpc error: code = NotFound desc = could not find container \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": container with ID starting with b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937 not found: ID does not exist" Jul 28 18:02:55.468313 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.468262 2531 scope.go:117] "RemoveContainer" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.468493 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.468475 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} err="failed to get container status \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": rpc error: code = NotFound desc = could not find container \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": container with ID starting with ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff not found: ID does not exist" Jul 28 18:02:55.468493 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.468491 2531 scope.go:117] "RemoveContainer" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.468791 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.468763 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} err="failed to get container status \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": rpc error: code = NotFound desc = could not find container \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": container with ID starting with 47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850 not found: ID does not exist" Jul 28 18:02:55.468791 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.468792 2531 scope.go:117] "RemoveContainer" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.469116 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469098 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} err="failed to get container status \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": rpc error: code = NotFound desc = could not find container \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": container with ID starting with d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f not found: ID does not exist" Jul 28 18:02:55.469116 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469116 2531 scope.go:117] "RemoveContainer" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.469368 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469348 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5"} err="failed to get container status \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": rpc error: code = NotFound desc = could not find container \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": container with ID starting with 8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5 not found: ID does not exist" Jul 28 18:02:55.469427 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469371 2531 scope.go:117] "RemoveContainer" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.469623 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469604 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} err="failed to get container status \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": rpc error: code = NotFound desc = could not find container \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": container with ID starting with 0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c not found: ID does not exist" Jul 28 18:02:55.469705 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469624 2531 scope.go:117] "RemoveContainer" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.469985 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469946 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} err="failed to get container status \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": rpc error: code = NotFound desc = could not find container \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": container with ID starting with 0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8 not found: ID does not exist" Jul 28 18:02:55.469985 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.469970 2531 scope.go:117] "RemoveContainer" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.470330 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.470294 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} err="failed to get container status \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": rpc error: code = NotFound desc = could not find container \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": container with ID starting with b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937 not found: ID does not exist" Jul 28 18:02:55.470406 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.470331 2531 scope.go:117] "RemoveContainer" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.470629 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.470589 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} err="failed to get container status \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": rpc error: code = NotFound desc = could not find container \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": container with ID starting with ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff not found: ID does not exist" Jul 28 18:02:55.470629 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.470618 2531 scope.go:117] "RemoveContainer" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.470923 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.470905 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} err="failed to get container status \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": rpc error: code = NotFound desc = could not find container \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": container with ID starting with 47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850 not found: ID does not exist" Jul 28 18:02:55.470923 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.470924 2531 scope.go:117] "RemoveContainer" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.471190 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.471160 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} err="failed to get container status \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": rpc error: code = NotFound desc = could not find container \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": container with ID starting with d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f not found: ID does not exist" Jul 28 18:02:55.471190 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.471181 2531 scope.go:117] "RemoveContainer" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.471442 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.471427 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5"} err="failed to get container status \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": rpc error: code = NotFound desc = could not find container \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": container with ID starting with 8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5 not found: ID does not exist" Jul 28 18:02:55.471506 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.471445 2531 scope.go:117] "RemoveContainer" containerID="0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c" Jul 28 18:02:55.471704 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.471683 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c"} err="failed to get container status \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": rpc error: code = NotFound desc = could not find container \"0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c\": container with ID starting with 0da256ca4f99c7e4a271a21a92064d712ae240f1ad4a2cf6361ca5a0c4b4000c not found: ID does not exist" Jul 28 18:02:55.471775 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.471706 2531 scope.go:117] "RemoveContainer" containerID="0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8" Jul 28 18:02:55.472021 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.471995 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8"} err="failed to get container status \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": rpc error: code = NotFound desc = could not find container \"0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8\": container with ID starting with 0fd69056cda6bc6a5f068a6215a76a15abb06238fd651d04533a288b74ab14e8 not found: ID does not exist" Jul 28 18:02:55.472120 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.472024 2531 scope.go:117] "RemoveContainer" containerID="b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937" Jul 28 18:02:55.472328 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.472303 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937"} err="failed to get container status \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": rpc error: code = NotFound desc = could not find container \"b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937\": container with ID starting with b3a05cfa179467baea3f285ac6584120dfe88872c8b9504fcbe45a9afa8f5937 not found: ID does not exist" Jul 28 18:02:55.472328 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.472328 2531 scope.go:117] "RemoveContainer" containerID="ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff" Jul 28 18:02:55.472657 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.472626 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff"} err="failed to get container status \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": rpc error: code = NotFound desc = could not find container \"ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff\": container with ID starting with ab5cae58c3087f51f4df695780551d16cbdab46b7701723053eafb18435444ff not found: ID does not exist" Jul 28 18:02:55.472657 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.472658 2531 scope.go:117] "RemoveContainer" containerID="47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850" Jul 28 18:02:55.474109 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.474000 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850"} err="failed to get container status \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": rpc error: code = NotFound desc = could not find container \"47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850\": container with ID starting with 47e2e88a9b0aae3bf21f5b057ab1ae44f0d4cc8fd0627b38cb1e096691ac2850 not found: ID does not exist" Jul 28 18:02:55.474109 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.474023 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 18:02:55.474109 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.474026 2531 scope.go:117] "RemoveContainer" containerID="d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f" Jul 28 18:02:55.474620 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.474598 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f"} err="failed to get container status \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": rpc error: code = NotFound desc = could not find container \"d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f\": container with ID starting with d956af471269d6f9f213004609237b87f460d6e643f55a1c48020c31281ba76f not found: ID does not exist" Jul 28 18:02:55.474620 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.474620 2531 scope.go:117] "RemoveContainer" containerID="8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5" Jul 28 18:02:55.477124 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.475245 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5"} err="failed to get container status \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": rpc error: code = NotFound desc = could not find container \"8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5\": container with ID starting with 8ced36b1f2672316766989a64ff94ba7384329b4c43680fd8b426aa7a9edacb5 not found: ID does not exist" Jul 28 18:02:55.477124 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.475461 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:55.477124 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.476654 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 18:02:55.571107 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571019 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-config-out\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571107 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571052 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-web-config\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571107 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571071 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571107 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571090 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571107 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571112 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571168 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-config\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571209 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571247 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571279 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571348 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571373 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ft76\" (UniqueName: \"kubernetes.io/projected/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-kube-api-access-7ft76\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571403 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571432 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571455 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571509 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571535 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571557 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571621 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571651 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.571720 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.571670 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.672950 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.672908 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.672950 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.672947 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ft76\" (UniqueName: \"kubernetes.io/projected/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-kube-api-access-7ft76\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.672967 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.672992 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673013 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673033 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673055 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673079 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673114 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673139 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673165 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673215 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673215 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-config-out\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673238 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-web-config\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673271 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673299 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673326 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673352 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-config\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673381 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673416 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.673718 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673444 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.674299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.673835 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.674299 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.674190 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.674738 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.674500 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.675711 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.675685 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.676978 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.676600 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.676978 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.676612 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.676978 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.676615 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.676978 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.676733 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.676978 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.676941 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.677270 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.677172 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.678138 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.678117 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.678747 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.678719 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.679093 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.679038 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.679333 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.679311 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.679425 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.679340 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-config\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.679425 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.679343 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-web-config\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.679505 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.679417 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.679737 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.679715 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.680486 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.680470 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-config-out\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.683166 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.683147 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ft76\" (UniqueName: \"kubernetes.io/projected/35be126a-7699-4fec-8f7e-7e1bdcb1d40b-kube-api-access-7ft76\") pod \"prometheus-k8s-0\" (UID: \"35be126a-7699-4fec-8f7e-7e1bdcb1d40b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.774613 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.774578 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:02:55.925710 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:55.925684 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 18:02:55.928203 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:02:55.928172 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35be126a_7699_4fec_8f7e_7e1bdcb1d40b.slice/crio-2d58dcf73fe2615fca0d47b271090e76821436e39e556f497e8b68bc3a124140 WatchSource:0}: Error finding container 2d58dcf73fe2615fca0d47b271090e76821436e39e556f497e8b68bc3a124140: Status 404 returned error can't find the container with id 2d58dcf73fe2615fca0d47b271090e76821436e39e556f497e8b68bc3a124140 Jul 28 18:02:56.407348 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:56.407310 2531 generic.go:356] "Generic (PLEG): container finished" podID="35be126a-7699-4fec-8f7e-7e1bdcb1d40b" containerID="b4c67c6a1ee95faf2a6eac72bf7cbc47c63b09524e417488f1bca79ecb50f2fa" exitCode=0 Jul 28 18:02:56.407506 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:56.407375 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerDied","Data":"b4c67c6a1ee95faf2a6eac72bf7cbc47c63b09524e417488f1bca79ecb50f2fa"} Jul 28 18:02:56.407506 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:56.407442 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerStarted","Data":"2d58dcf73fe2615fca0d47b271090e76821436e39e556f497e8b68bc3a124140"} Jul 28 18:02:57.379398 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.379355 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68dfcbef-0b66-4435-a898-d6fd1af6b6ee" path="/var/lib/kubelet/pods/68dfcbef-0b66-4435-a898-d6fd1af6b6ee/volumes" Jul 28 18:02:57.415070 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.415034 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerStarted","Data":"c5e1cc9e574077acf353b13107f8c907c69ecd2820fc96537cc1a33e60fb500f"} Jul 28 18:02:57.415264 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.415097 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerStarted","Data":"b175a44f1fe2ae67b143fdfffa39130bb17c1ced936daa85e74520733fb38e8d"} Jul 28 18:02:57.415264 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.415122 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerStarted","Data":"63b45ea37226143ac01b07e0f17674aa92e0a7d91ab5e8fef0136d8c6099a32a"} Jul 28 18:02:57.415264 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.415148 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerStarted","Data":"48b742b223e165eac57f7568e50067dd82761248c7a7c930ef9536fe2f3ef990"} Jul 28 18:02:57.415264 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.415171 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerStarted","Data":"ebfb09f80806e67387a6e7f05b34a559ab60058a8a4e03a7b224e92a37e00c4a"} Jul 28 18:02:57.415264 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.415194 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"35be126a-7699-4fec-8f7e-7e1bdcb1d40b","Type":"ContainerStarted","Data":"0d19932195bb82c3e70ce62d7f6257dbc62a7c269035543867b57c082e892810"} Jul 28 18:02:57.449794 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:02:57.449722 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.430689695 podStartE2EDuration="2.449698792s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.009097ms" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:57.447669443 +0000 UTC m=+196.542495509" watchObservedRunningTime="2026-07-28 18:02:57.449698792 +0000 UTC m=+196.544524851" Jul 28 18:03:00.775263 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:03:00.775229 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:55.775155 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:03:55.775114 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:55.791562 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:03:55.791536 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:03:56.662599 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:03:56.662574 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 18:04:41.312413 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:04:41.312383 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/2.log" Jul 28 18:04:41.317145 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:04:41.317119 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/0.log" Jul 28 18:04:41.319980 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:04:41.319957 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/2.log" Jul 28 18:04:41.322958 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:04:41.322941 2531 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 18:04:41.324898 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:04:41.324861 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/0.log" Jul 28 18:05:11.220139 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:11.220070 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5bnqd_ccf43db2-ddfa-48a8-aef0-cf406aca7359/global-pull-secret-syncer/0.log" Jul 28 18:05:11.409004 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:11.408978 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ftfxg_87f8ac69-acda-4005-adc4-da8508ba47f1/konnectivity-agent/0.log" Jul 28 18:05:11.494631 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:11.494534 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-220.ec2.internal_923ffe0ad7855c90d360d5355866467b/haproxy/0.log" Jul 28 18:05:15.145375 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.145347 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fd344ab8-3412-47a1-b3fa-3ed9600bf1e6/alertmanager/0.log" Jul 28 18:05:15.187195 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.187169 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fd344ab8-3412-47a1-b3fa-3ed9600bf1e6/config-reloader/0.log" Jul 28 18:05:15.228699 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.228626 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fd344ab8-3412-47a1-b3fa-3ed9600bf1e6/kube-rbac-proxy-web/0.log" Jul 28 18:05:15.275634 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.275612 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fd344ab8-3412-47a1-b3fa-3ed9600bf1e6/kube-rbac-proxy/0.log" Jul 28 18:05:15.321575 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.321540 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fd344ab8-3412-47a1-b3fa-3ed9600bf1e6/kube-rbac-proxy-metric/0.log" Jul 28 18:05:15.360776 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.360750 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fd344ab8-3412-47a1-b3fa-3ed9600bf1e6/prom-label-proxy/0.log" Jul 28 18:05:15.413221 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.413193 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fd344ab8-3412-47a1-b3fa-3ed9600bf1e6/init-config-reloader/0.log" Jul 28 18:05:15.538854 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.538771 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-ngtzd_e2791ac5-f727-45d2-834a-87062c0cc791/kube-state-metrics/0.log" Jul 28 18:05:15.593742 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.593717 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-ngtzd_e2791ac5-f727-45d2-834a-87062c0cc791/kube-rbac-proxy-main/0.log" Jul 28 18:05:15.626770 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.626739 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-ngtzd_e2791ac5-f727-45d2-834a-87062c0cc791/kube-rbac-proxy-self/0.log" Jul 28 18:05:15.697725 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.697693 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-97686d8cc-54bzn_ac23e3a7-e34e-490b-95d0-f5d238b68785/metrics-server/0.log" Jul 28 18:05:15.794926 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.794838 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hpdp_86452666-3538-4571-83e4-4cf52038c8f7/node-exporter/0.log" Jul 28 18:05:15.834912 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.834854 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hpdp_86452666-3538-4571-83e4-4cf52038c8f7/kube-rbac-proxy/0.log" Jul 28 18:05:15.880195 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:15.880171 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hpdp_86452666-3538-4571-83e4-4cf52038c8f7/init-textfile/0.log" Jul 28 18:05:16.286538 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.286510 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_35be126a-7699-4fec-8f7e-7e1bdcb1d40b/prometheus/0.log" Jul 28 18:05:16.341970 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.341941 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_35be126a-7699-4fec-8f7e-7e1bdcb1d40b/config-reloader/0.log" Jul 28 18:05:16.397156 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.397130 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_35be126a-7699-4fec-8f7e-7e1bdcb1d40b/thanos-sidecar/0.log" Jul 28 18:05:16.452970 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.452944 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_35be126a-7699-4fec-8f7e-7e1bdcb1d40b/kube-rbac-proxy-web/0.log" Jul 28 18:05:16.561280 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.561186 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_35be126a-7699-4fec-8f7e-7e1bdcb1d40b/kube-rbac-proxy/0.log" Jul 28 18:05:16.672424 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.672388 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_35be126a-7699-4fec-8f7e-7e1bdcb1d40b/kube-rbac-proxy-thanos/0.log" Jul 28 18:05:16.743731 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.743706 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_35be126a-7699-4fec-8f7e-7e1bdcb1d40b/init-config-reloader/0.log" Jul 28 18:05:16.808954 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.808922 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wp78d_308fadd9-9a0a-4ec7-8a9c-2b423b09a277/prometheus-operator/0.log" Jul 28 18:05:16.853232 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.853154 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wp78d_308fadd9-9a0a-4ec7-8a9c-2b423b09a277/kube-rbac-proxy/0.log" Jul 28 18:05:16.896025 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:16.895999 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-sqnr4_2a94ef44-1f03-4ada-ba13-197a4c3eb177/prometheus-operator-admission-webhook/0.log" Jul 28 18:05:18.260734 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.260655 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx"] Jul 28 18:05:18.264179 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.264162 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.267494 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.267471 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-28dk5\"/\"kube-root-ca.crt\"" Jul 28 18:05:18.268306 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.268290 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-28dk5\"/\"default-dockercfg-zp4f9\"" Jul 28 18:05:18.268306 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.268298 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-28dk5\"/\"openshift-service-ca.crt\"" Jul 28 18:05:18.276124 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.276098 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx"] Jul 28 18:05:18.291333 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.291305 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-proc\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.291474 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.291341 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-podres\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.291474 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.291380 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269kj\" (UniqueName: \"kubernetes.io/projected/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-kube-api-access-269kj\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.291474 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.291399 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-lib-modules\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.291590 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.291463 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-sys\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.391966 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.391931 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-proc\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.391966 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.391973 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-podres\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.392191 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.392022 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-269kj\" (UniqueName: \"kubernetes.io/projected/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-kube-api-access-269kj\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.392191 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.392042 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-lib-modules\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.392191 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.392057 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-proc\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.392191 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.392089 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-sys\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.392191 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.392168 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-sys\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.392191 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.392179 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-podres\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.392384 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.392205 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-lib-modules\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.403829 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.403804 2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-269kj\" (UniqueName: \"kubernetes.io/projected/6e34b8db-50ac-4963-b5d5-d99b95fc0a43-kube-api-access-269kj\") pod \"perf-node-gather-daemonset-wfjmx\" (UID: \"6e34b8db-50ac-4963-b5d5-d99b95fc0a43\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.574045 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.573947 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.727971 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.727947 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx"] Jul 28 18:05:18.730046 ip-10-0-140-220 kubenswrapper[2531]: W0728 18:05:18.730019 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6e34b8db_50ac_4963_b5d5_d99b95fc0a43.slice/crio-a8ff85dcbb7838e47492f88bcadfb6d2543939b0951bd82b2dcc8bf09c8eecc0 WatchSource:0}: Error finding container a8ff85dcbb7838e47492f88bcadfb6d2543939b0951bd82b2dcc8bf09c8eecc0: Status 404 returned error can't find the container with id a8ff85dcbb7838e47492f88bcadfb6d2543939b0951bd82b2dcc8bf09c8eecc0 Jul 28 18:05:18.957374 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.957343 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" event={"ID":"6e34b8db-50ac-4963-b5d5-d99b95fc0a43","Type":"ContainerStarted","Data":"e9d3cc288cf8e4bd82ec6b0fb004cab3924897e2f4dae2f18682aa1dccc77ebf"} Jul 28 18:05:18.957560 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.957400 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" event={"ID":"6e34b8db-50ac-4963-b5d5-d99b95fc0a43","Type":"ContainerStarted","Data":"a8ff85dcbb7838e47492f88bcadfb6d2543939b0951bd82b2dcc8bf09c8eecc0"} Jul 28 18:05:18.957560 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.957439 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:18.995611 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:18.995554 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" podStartSLOduration=0.99553648 podStartE2EDuration="995.53648ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:18.994221199 +0000 UTC m=+338.089047255" watchObservedRunningTime="2026-07-28 18:05:18.99553648 +0000 UTC m=+338.090362576" Jul 28 18:05:19.227398 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:19.227369 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/2.log" Jul 28 18:05:19.233286 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:19.233258 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-dgmp5_d49ae05b-a674-49ff-a1bd-248c87459476/console-operator/3.log" Jul 28 18:05:21.151323 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:21.151292 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p47xq_f31e431d-fcac-423c-89d0-1905bd47a348/dns/0.log" Jul 28 18:05:21.178776 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:21.178750 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p47xq_f31e431d-fcac-423c-89d0-1905bd47a348/kube-rbac-proxy/0.log" Jul 28 18:05:21.375086 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:21.375054 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nsg46_2a793fc5-fe86-4b82-99a5-884363908d9d/dns-node-resolver/0.log" Jul 28 18:05:21.989913 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:21.989885 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6bnc_93ade919-a86c-4821-ae45-19b98cef7921/node-ca/0.log" Jul 28 18:05:22.939627 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:22.939600 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b46fb7df9-5d469_bab977b3-6bc1-4fbe-928e-7e3f8a89fb20/router/0.log" Jul 28 18:05:23.460553 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:23.460519 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4bh8_4b5c0a08-17fb-43c7-bc66-29f054141d40/serve-healthcheck-canary/0.log" Jul 28 18:05:23.954726 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:23.954702 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xvt2_85c654b1-eff6-45c8-8767-75528f9e6875/kube-rbac-proxy/0.log" Jul 28 18:05:23.987791 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:23.987762 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xvt2_85c654b1-eff6-45c8-8767-75528f9e6875/exporter/0.log" Jul 28 18:05:24.023268 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:24.023238 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xvt2_85c654b1-eff6-45c8-8767-75528f9e6875/extractor/0.log" Jul 28 18:05:24.971386 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:24.971363 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-wfjmx" Jul 28 18:05:31.065792 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.065762 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6hwlb_7c709b5c-12ba-4b70-8f53-e9e6b2a0af51/kube-multus/0.log" Jul 28 18:05:31.356493 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.356406 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vkbr_e10d3429-0fea-48f5-9ed5-1efc3a675453/kube-multus-additional-cni-plugins/0.log" Jul 28 18:05:31.389915 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.389855 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vkbr_e10d3429-0fea-48f5-9ed5-1efc3a675453/egress-router-binary-copy/0.log" Jul 28 18:05:31.422062 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.422035 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vkbr_e10d3429-0fea-48f5-9ed5-1efc3a675453/cni-plugins/0.log" Jul 28 18:05:31.456964 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.456937 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vkbr_e10d3429-0fea-48f5-9ed5-1efc3a675453/bond-cni-plugin/0.log" Jul 28 18:05:31.491861 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.491832 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vkbr_e10d3429-0fea-48f5-9ed5-1efc3a675453/routeoverride-cni/0.log" Jul 28 18:05:31.529316 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.529286 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vkbr_e10d3429-0fea-48f5-9ed5-1efc3a675453/whereabouts-cni-bincopy/0.log" Jul 28 18:05:31.563695 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:31.563664 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vkbr_e10d3429-0fea-48f5-9ed5-1efc3a675453/whereabouts-cni/0.log" Jul 28 18:05:32.011074 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:32.011043 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zns9q_3faf12a1-9706-49f3-8981-d1f8ea7517ec/network-metrics-daemon/0.log" Jul 28 18:05:32.041389 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:32.041359 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zns9q_3faf12a1-9706-49f3-8981-d1f8ea7517ec/kube-rbac-proxy/0.log" Jul 28 18:05:33.194613 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.194588 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-controller/0.log" Jul 28 18:05:33.232520 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.232491 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/0.log" Jul 28 18:05:33.232695 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.232524 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovn-acl-logging/1.log" Jul 28 18:05:33.265097 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.265060 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/kube-rbac-proxy-node/0.log" Jul 28 18:05:33.310019 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.309991 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 18:05:33.352355 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.352332 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/northd/0.log" Jul 28 18:05:33.390404 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.390376 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/nbdb/0.log" Jul 28 18:05:33.436410 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.436388 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/sbdb/0.log" Jul 28 18:05:33.507711 ip-10-0-140-220 kubenswrapper[2531]: I0728 18:05:33.507681 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fpmjp_30b23486-0f02-42f2-a971-2416b8670ac7/ovnkube-controller/0.log"