Jul 16 16:38:55.943864 ip-10-0-141-195 systemd[1]: Starting Kubernetes Kubelet... Jul 16 16:38:56.329069 ip-10-0-141-195 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:38:56.329069 ip-10-0-141-195 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 16:38:56.329069 ip-10-0-141-195 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:38:56.329069 ip-10-0-141-195 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 16:38:56.329069 ip-10-0-141-195 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:38:56.329069 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.325601 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332537 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332548 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332552 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332555 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332559 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332562 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332565 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332567 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332570 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332572 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332575 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332578 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332580 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332583 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332585 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332588 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332590 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332593 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332595 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:38:56.345334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332598 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332600 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332604 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332619 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332622 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332624 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332627 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332631 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332633 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332636 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332639 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332641 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332644 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332647 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332649 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332652 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332655 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332658 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332660 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332665 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:38:56.359791 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332670 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332673 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332678 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332682 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332685 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332687 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332690 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332693 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332695 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332698 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332700 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332703 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332705 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332708 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332710 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332713 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332715 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332718 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332720 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:38:56.361515 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332723 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332726 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332728 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332731 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332734 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332736 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332739 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332742 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332744 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332748 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332750 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332753 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332756 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332761 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332764 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332767 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332769 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332772 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332774 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332777 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:38:56.363838 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332779 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332783 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332786 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332789 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332792 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332795 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332797 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332800 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332803 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332805 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332807 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332810 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332812 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332815 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332818 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332820 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332823 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332826 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332829 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:38:56.375713 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332831 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.332834 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333510 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333517 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333519 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333522 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333525 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333533 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333536 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333539 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333541 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333543 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333546 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333548 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333551 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333553 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333556 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333558 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333561 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333563 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:38:56.524263 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333566 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333570 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333573 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333576 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333578 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333581 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333586 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333589 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333591 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333593 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333596 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333599 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333601 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333604 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333621 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333623 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333626 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333628 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333631 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333633 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:38:56.526097 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333641 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333644 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333646 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333649 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333651 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333654 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333656 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333659 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333661 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333663 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333666 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333669 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333671 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333674 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333676 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333679 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333681 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333684 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333687 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333690 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:38:56.528355 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333692 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333695 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333697 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333700 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333702 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333705 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333707 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333711 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333715 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333718 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333720 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333723 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333726 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333734 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333737 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333740 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333744 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333746 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333749 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:38:56.544030 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333752 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:38:56.541866 ip-10-0-141-195 systemd[1]: Started Kubernetes Kubelet. Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333754 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333757 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333759 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333764 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333767 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333770 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333773 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333776 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333778 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333781 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333785 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333788 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333791 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333793 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333795 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333798 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333800 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333803 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:38:56.546124 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333805 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333808 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.333810 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334187 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334192 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334195 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334198 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334201 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334204 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334207 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334210 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334213 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334216 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334219 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334221 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334224 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334227 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334229 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334232 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334235 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:38:56.548562 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334238 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334240 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334243 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334246 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334249 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334252 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334254 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334257 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334259 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334262 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334264 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334267 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334271 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334273 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334276 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334278 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334281 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334283 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334285 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:38:56.551806 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334288 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334296 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334299 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334303 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334306 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334309 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334312 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334315 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334318 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334320 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334323 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334325 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334328 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334330 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334333 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334335 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334337 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334341 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334344 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334346 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:38:56.556480 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334348 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334351 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334353 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334356 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334360 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334363 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334366 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334368 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334370 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334373 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334375 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334378 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334380 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334384 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334393 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334405 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334408 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334410 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334414 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:38:56.557166 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334417 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334420 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334422 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334425 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334427 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334429 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334432 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334434 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334437 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334439 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334443 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334445 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334448 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334450 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334453 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334456 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334458 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334461 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334464 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334467 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:38:56.562177 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334469 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334472 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334474 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.334477 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334534 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334541 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334549 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334553 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334569 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334572 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334576 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334580 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334583 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334585 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334589 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334592 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334594 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334597 2566 flags.go:64] FLAG: --cgroup-root="" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334600 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334603 2566 flags.go:64] FLAG: --client-ca-file="" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334606 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334623 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334629 2566 flags.go:64] FLAG: --cluster-domain="" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334632 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 16:38:56.563153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334635 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334638 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334641 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334644 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334647 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334650 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334654 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334657 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334660 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334663 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334666 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334668 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334684 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334688 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334691 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334694 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334697 2566 flags.go:64] FLAG: --enable-server="true" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334700 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334704 2566 flags.go:64] FLAG: --event-burst="100" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334707 2566 flags.go:64] FLAG: --event-qps="50" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334709 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334712 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334715 2566 flags.go:64] FLAG: --eviction-hard="" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334719 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 16:38:56.564027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334721 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334724 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334727 2566 flags.go:64] FLAG: --eviction-soft="" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334730 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334732 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334735 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334740 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334742 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334745 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334748 2566 flags.go:64] FLAG: --feature-gates="" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334751 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334754 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334757 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334760 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334765 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334767 2566 flags.go:64] FLAG: --help="false" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334770 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334773 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334776 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334778 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334781 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334785 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334787 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 16:38:56.565011 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334790 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334793 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334795 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334798 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334801 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334804 2566 flags.go:64] FLAG: --kube-reserved="" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334807 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334810 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334812 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334815 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334818 2566 flags.go:64] FLAG: --lock-file="" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334821 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334823 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334826 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334831 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334835 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334838 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334841 2566 flags.go:64] FLAG: --logging-format="text" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334843 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334846 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334849 2566 flags.go:64] FLAG: --manifest-url="" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334852 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334856 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334860 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334864 2566 flags.go:64] FLAG: --max-pods="110" Jul 16 16:38:56.565849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334867 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334870 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334872 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334875 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334878 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334880 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334883 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334889 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334892 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334895 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334898 2566 flags.go:64] FLAG: --pod-cidr="" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334901 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334906 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334909 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334912 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334915 2566 flags.go:64] FLAG: --port="10250" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334918 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334920 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c5766411676d586" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334923 2566 flags.go:64] FLAG: --qos-reserved="" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334926 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334929 2566 flags.go:64] FLAG: --register-node="true" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334932 2566 flags.go:64] FLAG: --register-with-taints="" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334935 2566 flags.go:64] FLAG: --registry-burst="10" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334939 2566 flags.go:64] FLAG: --registry-qps="5" Jul 16 16:38:56.566951 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334942 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334945 2566 flags.go:64] FLAG: --reserved-memory="" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334948 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334951 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334954 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334957 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334962 2566 flags.go:64] FLAG: --runonce="false" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334965 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334968 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334971 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334973 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334976 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334979 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334982 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334985 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334988 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334990 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334993 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334996 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.334999 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335002 2566 flags.go:64] FLAG: --system-cgroups="" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335005 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335010 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335012 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335015 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 16:38:56.567824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335019 2566 flags.go:64] FLAG: --tls-min-version="" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335022 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335025 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335028 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335030 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335033 2566 flags.go:64] FLAG: --v="2" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335038 2566 flags.go:64] FLAG: --version="false" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335042 2566 flags.go:64] FLAG: --vmodule="" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335045 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335048 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335163 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335167 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335170 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335174 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335177 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335180 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335183 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335185 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335188 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335190 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335193 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:38:56.568893 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335195 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335198 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335200 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335203 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335205 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335208 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335210 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335213 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335215 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335218 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335220 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335223 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335226 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335228 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335232 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335235 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335238 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335242 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335245 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335248 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:38:56.569545 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335251 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335254 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335256 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335259 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335263 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335266 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335269 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335272 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335274 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335277 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335279 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335281 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335284 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335286 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335289 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335292 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335294 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335297 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335299 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335301 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:38:56.570126 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335304 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335307 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335309 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335312 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335314 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335316 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335319 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335321 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335324 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335329 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335331 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335334 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335336 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335339 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335341 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335343 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335347 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335350 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335352 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335355 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:38:56.570752 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335357 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335360 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335362 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335365 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335367 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335369 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335372 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335374 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335377 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335379 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335382 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335385 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335399 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335402 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335405 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335408 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335411 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335414 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335417 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335419 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:38:56.571361 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335422 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335426 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335428 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335431 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335434 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335437 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335440 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.335443 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.335453 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.341668 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.341685 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.341702 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.341708 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341755 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:38:56.571978 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341759 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341763 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341765 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341768 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341771 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341774 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341777 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341779 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341782 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341785 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341787 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341790 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341792 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341795 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341797 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341800 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341802 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341804 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341807 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341810 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:38:56.670645 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341812 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341815 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341817 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341820 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341822 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341825 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341828 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341830 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341833 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341836 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341838 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341841 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341843 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341845 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341848 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341850 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341852 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341857 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341860 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341862 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:38:56.671421 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341864 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341867 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341870 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341872 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341874 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341877 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341882 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341886 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341889 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341892 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341895 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341898 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341901 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341903 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341906 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341909 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341911 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341915 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341917 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:38:56.672054 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341920 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341923 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341925 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341928 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341930 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341933 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341935 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341938 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341940 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341943 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341946 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341949 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341952 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341955 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341958 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341961 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341964 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341967 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341969 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341973 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:38:56.672890 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341976 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341978 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341981 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341983 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341986 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341989 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341991 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341994 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.341996 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342000 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342004 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342007 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342010 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342012 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342014 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342017 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342020 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342022 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:38:56.673496 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342024 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.342029 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342126 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342130 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342133 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342137 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342139 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342142 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342144 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342147 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342150 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342152 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342155 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342159 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342161 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:38:56.674103 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342164 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342166 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342169 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342173 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342176 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342179 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342182 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342185 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342187 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342190 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342192 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342194 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342197 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342199 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342202 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342205 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342207 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342210 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342212 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:38:56.674552 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342214 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342217 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342219 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342223 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342225 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342228 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342230 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342232 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342235 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342237 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342240 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342243 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342246 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342248 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342251 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342253 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342256 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342258 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342260 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342263 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:38:56.675445 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342265 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342269 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342272 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342275 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342278 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342280 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342283 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342285 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342288 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342291 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342293 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342296 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342298 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342300 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342303 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342307 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342310 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342312 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342314 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:38:56.676021 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342317 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342319 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342322 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342324 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342328 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342331 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342333 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342336 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342338 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342340 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342343 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342345 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342347 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342350 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342354 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342357 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342359 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342362 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342365 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:38:56.755730 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342367 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342370 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342373 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342376 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342381 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342384 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342386 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342388 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:56.342391 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.342405 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.342506 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.346778 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.347902 2566 server.go:1019] "Starting client certificate rotation" Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.348000 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:38:56.769854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.348037 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:38:56.770271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.351878 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:38:56.770271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.356583 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:38:56.770271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.369275 2566 log.go:25] "Validated CRI v1 runtime API" Jul 16 16:38:56.770271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.370952 2566 log.go:25] "Validated CRI v1 image API" Jul 16 16:38:56.770271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.373272 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 16:38:56.770271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.376817 2566 fs.go:135] Filesystem UUIDs: map[50b431e2-b7bb-4aa0-960a-9dcd624189f2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c1fe5477-ccf8-418d-b5d0-256c01e1f45b:/dev/nvme0n1p3] Jul 16 16:38:56.770271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.376831 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.382155 2566 manager.go:216] Machine: {Timestamp:2026-07-16 16:38:56.381030101 +0000 UTC m=+0.319152909 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204485 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28e5d979425bd5352cd6473fc174d2 SystemUUID:ec28e5d9-7942-5bd5-352c-d6473fc174d2 BootID:a249f9b0-c7c4-4c01-aea6-1ec6a8c9d986 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:af:65:7c:82:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:af:65:7c:82:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:85:12:fe:eb:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.382243 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.382333 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.383655 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.385528 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.385560 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.386804 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.386816 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.386831 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.387626 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.420566 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5b6bq" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.432080 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5b6bq" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.524746 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530212 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:38:56.771074 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530315 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530342 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530354 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530368 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530376 2566 kubelet.go:398] "Adding apiserver pod source" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530383 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530753 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.530784 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.533879 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536644 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536672 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536831 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536843 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536850 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536858 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536867 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.536873 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.537330 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.537336 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.537342 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.537349 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.537360 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.537369 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.538086 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.538092 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.541143 2566 server.go:1268] "Started kubelet" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.541231 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.541225 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.541293 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.544956 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.549130 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.549766 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.550148 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.550652 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.554803 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.554809 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.555029 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-195.ec2.internal\" not found" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.555347 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.555349 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.555367 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.555472 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.555478 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.563444 2566 factory.go:55] Registering systemd factory Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.563456 2566 factory.go:223] Registration of the systemd container factory successfully Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.564189 2566 factory.go:153] Registering CRI-O factory Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.564204 2566 factory.go:223] Registration of the crio container factory successfully Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.564280 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.564303 2566 factory.go:103] Registering Raw factory Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.564332 2566 manager.go:1196] Started watching for new ooms in manager Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.564998 2566 manager.go:349] Starting recovery of all containers Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.565916 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.574899 2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-195.ec2.internal" not found Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.575148 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-195.ec2.internal\" not found" node="ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.771898 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.580074 2566 manager.go:354] Recovery completed Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.584250 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.586084 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.586101 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.586111 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.586686 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.586693 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.586707 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.587668 2566 policy_none.go:49] "None policy: Start" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.587679 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.587688 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.588243 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.588828 2566 policy_none.go:47] "Start" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.588875 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.588894 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.588904 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.598513 2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-195.ec2.internal" not found Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.654107 2566 manager.go:337] "Starting Device Plugin manager" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.654135 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.654143 2566 server.go:87] "Starting device plugin registration server" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.654328 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.654341 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.654444 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.654555 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.654565 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.654901 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.654936 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-195.ec2.internal\" not found" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.660389 2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-195.ec2.internal" not found Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.751416 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.752740 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.752777 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.752815 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.752852 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.754938 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.755661 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.755679 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.755691 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.755709 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.756822 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:38:56.773550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.764172 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.879060 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.852966 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal"] Jul 16 16:38:56.879060 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.854725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.879060 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.855674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.879060 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.855710 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.879060 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.856353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9718661c04ac56f3b27f8d30fcd6b96b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal\" (UID: \"9718661c04ac56f3b27f8d30fcd6b96b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.879060 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.856372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9718661c04ac56f3b27f8d30fcd6b96b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal\" (UID: \"9718661c04ac56f3b27f8d30fcd6b96b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.879060 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.856389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c16a73d284a64f53cba0169247e9921-config\") pod \"kube-apiserver-proxy-ip-10-0-141-195.ec2.internal\" (UID: \"5c16a73d284a64f53cba0169247e9921\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.883979 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.884072 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.902050 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.911262 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.912075 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.934042 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.934070 2566 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.936383 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:56.936405 2566 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-195.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.956597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9718661c04ac56f3b27f8d30fcd6b96b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal\" (UID: \"9718661c04ac56f3b27f8d30fcd6b96b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.956648 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9718661c04ac56f3b27f8d30fcd6b96b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal\" (UID: \"9718661c04ac56f3b27f8d30fcd6b96b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.956684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c16a73d284a64f53cba0169247e9921-config\") pod \"kube-apiserver-proxy-ip-10-0-141-195.ec2.internal\" (UID: \"5c16a73d284a64f53cba0169247e9921\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.956688 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9718661c04ac56f3b27f8d30fcd6b96b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal\" (UID: \"9718661c04ac56f3b27f8d30fcd6b96b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.956708 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c16a73d284a64f53cba0169247e9921-config\") pod \"kube-apiserver-proxy-ip-10-0-141-195.ec2.internal\" (UID: \"5c16a73d284a64f53cba0169247e9921\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:56.976384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:56.956727 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9718661c04ac56f3b27f8d30fcd6b96b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal\" (UID: \"9718661c04ac56f3b27f8d30fcd6b96b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:58.334709 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.298207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" Jul 16 16:38:58.334709 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.300988 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" Jul 16 16:38:58.450921 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.409270 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 16:38:58.450921 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.409366 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:38:58.450921 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.409403 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:38:58.450921 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.409423 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.589951 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 16:33:57 +0000 UTC" deadline="2028-03-05 23:58:56.411826955 +0000 UTC" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.589997 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14359h19m57.82183269s" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.593098 2566 apiserver.go:52] "Watching apiserver" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.605986 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.606830 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal","openshift-multus/multus-fb244","openshift-multus/network-metrics-daemon-xmhth","kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal","openshift-dns/node-resolver-gr27j","openshift-multus/multus-additional-cni-plugins-xzsh6","openshift-network-diagnostics/network-check-target-qlfdh","openshift-network-operator/iptables-alerter-vsfqg","openshift-ovn-kubernetes/ovnkube-node-bjkf9","kube-system/global-pull-secret-syncer-kmj9t","kube-system/konnectivity-agent-5r6xt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6","openshift-cluster-node-tuning-operator/tuned-5zhgd","openshift-image-registry/node-ca-6d69r"] Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.608568 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.608622 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.609477 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.610538 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.610582 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.611480 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.612434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.614061 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.614878 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.616355 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.616945 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.617339 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.617787 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.619682 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fb244" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.619895 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.619927 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-os-release\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.635337 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-slash\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628171 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97c50344-aced-4b14-8860-661ae2c20d59-kubelet-config\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysctl-d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-systemd-units\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-systemd\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-cni-bin\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-cni-netd\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.628300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-ovn\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.630329 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.631318 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9w8xn\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.631428 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.631495 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9t4z5\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.631597 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jnbv2\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.631686 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.631803 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.631811 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 16:38:58.636382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.632023 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639580 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639598 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639605 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639701 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639713 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gmdp6\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639774 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639793 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cfq48\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639873 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m87jz\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639877 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639583 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639949 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639993 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5lrvh\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.639997 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 16:38:58.640153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.640054 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 16:38:58.641238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.640164 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 16:38:58.641238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.640202 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 16:38:58.641238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.640211 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 16:38:58.641238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.640306 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nz9tn\"" Jul 16 16:38:58.641238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.640356 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642689 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97c50344-aced-4b14-8860-661ae2c20d59-dbus\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642743 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jm7tz\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642757 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642782 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-node-log\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642809 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642815 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovn-node-metrics-cert\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642843 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13e7bbbe-ca22-427b-a6ce-2d3c134b7194-agent-certs\") pod \"konnectivity-agent-5r6xt\" (UID: \"13e7bbbe-ca22-427b-a6ce-2d3c134b7194\") " pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642858 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysctl-conf\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-iptables-alerter-script\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642959 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13e7bbbe-ca22-427b-a6ce-2d3c134b7194-konnectivity-ca\") pod \"konnectivity-agent-5r6xt\" (UID: \"13e7bbbe-ca22-427b-a6ce-2d3c134b7194\") " pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642982 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.642989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-device-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-modprobe-d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-kubernetes\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643087 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 16:38:58.643097 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643099 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-registration-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-var-lib-kubelet\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-env-overrides\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-host\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-tuned\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-log-socket\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643313 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn49g\" (UniqueName: \"kubernetes.io/projected/5f0ae342-aebb-4dc2-956c-359d800ea9c4-kube-api-access-jn49g\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/498957fb-acdd-4109-84a6-e50e4d40c0a1-serviceca\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-etc-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-run-netns\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-var-lib-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/498957fb-acdd-4109-84a6-e50e4d40c0a1-host\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysconfig\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.643835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovnkube-script-lib\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643558 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj6h7\" (UniqueName: \"kubernetes.io/projected/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-kube-api-access-nj6h7\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-sys-fs\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5wq\" (UniqueName: \"kubernetes.io/projected/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-kube-api-access-7j5wq\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/748b6668-c372-4f86-b186-4ea2d6fc3e7f-tmp\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cnibin\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-host-slash\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ts55\" (UniqueName: \"kubernetes.io/projected/3e0af0e0-bc91-4fe2-ad71-38f68975f024-kube-api-access-7ts55\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643771 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovnkube-config\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-sys\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-lib-modules\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-system-cni-dir\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-kubelet\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48xq\" (UniqueName: \"kubernetes.io/projected/b94b15c8-a383-4478-bd05-012b50ddb4c9-kube-api-access-s48xq\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643897 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzjvs\" (UniqueName: \"kubernetes.io/projected/498957fb-acdd-4109-84a6-e50e4d40c0a1-kube-api-access-zzjvs\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.644778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b94b15c8-a383-4478-bd05-012b50ddb4c9-hosts-file\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-systemd\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6mwf\" (UniqueName: \"kubernetes.io/projected/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-kube-api-access-l6mwf\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.643990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cni-binary-copy\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.644009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94b15c8-a383-4478-bd05-012b50ddb4c9-tmp-dir\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.644023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.644044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-socket-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.644059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-run\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.644079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlr4d\" (UniqueName: \"kubernetes.io/projected/748b6668-c372-4f86-b186-4ea2d6fc3e7f-kube-api-access-xlr4d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.644106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.656224 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.664694 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lxhdh" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.681419 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lxhdh" Jul 16 16:38:58.736199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.717469 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-cni-netd\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-ovn\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744445 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97c50344-aced-4b14-8860-661ae2c20d59-dbus\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-node-log\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744513 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-cni-netd\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744527 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-ovn\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovn-node-metrics-cert\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744559 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-node-log\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-cni-binary-copy\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744596 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97c50344-aced-4b14-8860-661ae2c20d59-dbus\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-k8s-cni-cncf-io\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-cni-bin\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-multus-certs\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13e7bbbe-ca22-427b-a6ce-2d3c134b7194-agent-certs\") pod \"konnectivity-agent-5r6xt\" (UID: \"13e7bbbe-ca22-427b-a6ce-2d3c134b7194\") " pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.746442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744836 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysctl-conf\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744839 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744861 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-iptables-alerter-script\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-system-cni-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744932 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysctl-conf\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13e7bbbe-ca22-427b-a6ce-2d3c134b7194-konnectivity-ca\") pod \"konnectivity-agent-5r6xt\" (UID: \"13e7bbbe-ca22-427b-a6ce-2d3c134b7194\") " pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-device-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.744999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-modprobe-d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-kubernetes\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-cnibin\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-kubelet\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r45k8\" (UniqueName: \"kubernetes.io/projected/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-kube-api-access-r45k8\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-registration-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745137 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-var-lib-kubelet\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-env-overrides\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.747241 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745166 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-modprobe-d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745204 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-host\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745204 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-kubernetes\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745236 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-device-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-host\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745252 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-registration-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-tuned\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-log-socket\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745288 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-var-lib-kubelet\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn49g\" (UniqueName: \"kubernetes.io/projected/5f0ae342-aebb-4dc2-956c-359d800ea9c4-kube-api-access-jn49g\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/498957fb-acdd-4109-84a6-e50e4d40c0a1-serviceca\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-etc-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-socket-dir-parent\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-run-netns\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-var-lib-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.748571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/498957fb-acdd-4109-84a6-e50e4d40c0a1-host\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-etc-kubernetes\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745442 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysconfig\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745456 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovnkube-script-lib\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj6h7\" (UniqueName: \"kubernetes.io/projected/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-kube-api-access-nj6h7\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745483 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-sys-fs\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-daemon-config\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5wq\" (UniqueName: \"kubernetes.io/projected/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-kube-api-access-7j5wq\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/748b6668-c372-4f86-b186-4ea2d6fc3e7f-tmp\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cnibin\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-host-slash\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-os-release\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-conf-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ts55\" (UniqueName: \"kubernetes.io/projected/3e0af0e0-bc91-4fe2-ad71-38f68975f024-kube-api-access-7ts55\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovnkube-config\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-hostroot\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-sys\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-lib-modules\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-system-cni-dir\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-kubelet\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745757 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s48xq\" (UniqueName: \"kubernetes.io/projected/b94b15c8-a383-4478-bd05-012b50ddb4c9-kube-api-access-s48xq\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745771 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzjvs\" (UniqueName: \"kubernetes.io/projected/498957fb-acdd-4109-84a6-e50e4d40c0a1-kube-api-access-zzjvs\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b94b15c8-a383-4478-bd05-012b50ddb4c9-hosts-file\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745803 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-netns\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-cni-multus\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745852 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-systemd\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6mwf\" (UniqueName: \"kubernetes.io/projected/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-kube-api-access-l6mwf\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cni-binary-copy\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94b15c8-a383-4478-bd05-012b50ddb4c9-tmp-dir\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745909 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-cni-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-socket-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.822430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745953 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-run\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlr4d\" (UniqueName: \"kubernetes.io/projected/748b6668-c372-4f86-b186-4ea2d6fc3e7f-kube-api-access-xlr4d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.745986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-os-release\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-slash\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97c50344-aced-4b14-8860-661ae2c20d59-kubelet-config\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysctl-d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-systemd-units\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-systemd\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-cni-bin\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746194 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-cni-bin\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746460 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-sys\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746494 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746529 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-system-cni-dir\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746499 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-log-socket\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.823675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746589 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-lib-modules\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746634 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-etc-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746648 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746724 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-kubelet\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.746795 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-sys-fs\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747038 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747040 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-run-systemd\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747043 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-run-netns\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.747417 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.747471 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747535 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-systemd\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747559 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-os-release\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747939 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-env-overrides\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747970 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-systemd-units\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747975 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cni-binary-copy\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.747986 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/498957fb-acdd-4109-84a6-e50e4d40c0a1-serviceca\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748017 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97c50344-aced-4b14-8860-661ae2c20d59-kubelet-config\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:58.825562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748100 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysctl-d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748103 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-iptables-alerter-script\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748140 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-host-slash\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748175 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-var-lib-openvswitch\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748212 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/498957fb-acdd-4109-84a6-e50e4d40c0a1-host\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748373 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovnkube-script-lib\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748396 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovn-node-metrics-cert\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748426 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748533 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-run\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748536 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13e7bbbe-ca22-427b-a6ce-2d3c134b7194-konnectivity-ca\") pod \"konnectivity-agent-5r6xt\" (UID: \"13e7bbbe-ca22-427b-a6ce-2d3c134b7194\") " pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748640 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-sysconfig\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748713 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e0af0e0-bc91-4fe2-ad71-38f68975f024-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748767 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e0af0e0-bc91-4fe2-ad71-38f68975f024-cnibin\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748800 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f0ae342-aebb-4dc2-956c-359d800ea9c4-ovnkube-config\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748823 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b94b15c8-a383-4478-bd05-012b50ddb4c9-tmp-dir\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748840 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b94b15c8-a383-4478-bd05-012b50ddb4c9-hosts-file\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748844 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.826180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748883 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f0ae342-aebb-4dc2-956c-359d800ea9c4-host-slash\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.748908 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-socket-dir\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.748919 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret podName:97c50344-aced-4b14-8860-661ae2c20d59 nodeName:}" failed. No retries permitted until 2026-07-16 16:38:59.248900054 +0000 UTC m=+2.125127802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret") pod "global-pull-secret-syncer-kmj9t" (UID: "97c50344-aced-4b14-8860-661ae2c20d59") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.748943 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:38:59.248932253 +0000 UTC m=+2.125159978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.749870 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/748b6668-c372-4f86-b186-4ea2d6fc3e7f-etc-tuned\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.750147 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13e7bbbe-ca22-427b-a6ce-2d3c134b7194-agent-certs\") pod \"konnectivity-agent-5r6xt\" (UID: \"13e7bbbe-ca22-427b-a6ce-2d3c134b7194\") " pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.750810 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/748b6668-c372-4f86-b186-4ea2d6fc3e7f-tmp\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.785532 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.785550 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.785562 2566 projected.go:196] Error preparing data for projected volume kube-api-access-92b44 for pod openshift-network-diagnostics/network-check-target-qlfdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:58.785630 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44 podName:68284f0c-6366-4695-9567-e6e1957ed8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:38:59.285612635 +0000 UTC m=+2.161840376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-92b44" (UniqueName: "kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44") pod "network-check-target-qlfdh" (UID: "68284f0c-6366-4695-9567-e6e1957ed8eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.787993 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6mwf\" (UniqueName: \"kubernetes.io/projected/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-kube-api-access-l6mwf\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.788024 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzjvs\" (UniqueName: \"kubernetes.io/projected/498957fb-acdd-4109-84a6-e50e4d40c0a1-kube-api-access-zzjvs\") pod \"node-ca-6d69r\" (UID: \"498957fb-acdd-4109-84a6-e50e4d40c0a1\") " pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.788040 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn49g\" (UniqueName: \"kubernetes.io/projected/5f0ae342-aebb-4dc2-956c-359d800ea9c4-kube-api-access-jn49g\") pod \"ovnkube-node-bjkf9\" (UID: \"5f0ae342-aebb-4dc2-956c-359d800ea9c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.788158 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ts55\" (UniqueName: \"kubernetes.io/projected/3e0af0e0-bc91-4fe2-ad71-38f68975f024-kube-api-access-7ts55\") pod \"multus-additional-cni-plugins-xzsh6\" (UID: \"3e0af0e0-bc91-4fe2-ad71-38f68975f024\") " pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.828855 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.788380 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5wq\" (UniqueName: \"kubernetes.io/projected/8fdfbe5f-ab71-46a0-997f-e456fa78f8c8-kube-api-access-7j5wq\") pod \"aws-ebs-csi-driver-node-482r6\" (UID: \"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:58.829478 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.788741 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48xq\" (UniqueName: \"kubernetes.io/projected/b94b15c8-a383-4478-bd05-012b50ddb4c9-kube-api-access-s48xq\") pod \"node-resolver-gr27j\" (UID: \"b94b15c8-a383-4478-bd05-012b50ddb4c9\") " pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:58.829478 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.789608 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlr4d\" (UniqueName: \"kubernetes.io/projected/748b6668-c372-4f86-b186-4ea2d6fc3e7f-kube-api-access-xlr4d\") pod \"tuned-5zhgd\" (UID: \"748b6668-c372-4f86-b186-4ea2d6fc3e7f\") " pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:58.829478 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.790316 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj6h7\" (UniqueName: \"kubernetes.io/projected/bb2918fc-1a74-4f6a-8eac-48bd9ad7199a-kube-api-access-nj6h7\") pod \"iptables-alerter-vsfqg\" (UID: \"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a\") " pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:58.829478 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.797389 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" Jul 16 16:38:58.829478 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.818359 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846354 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-etc-kubernetes\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-daemon-config\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-os-release\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846418 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-conf-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846439 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-etc-kubernetes\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-hostroot\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846485 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-os-release\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846492 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-conf-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846489 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-hostroot\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-netns\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846574 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-netns\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-cni-multus\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846702 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-cni-multus\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-cni-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-cni-binary-copy\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846824 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-k8s-cni-cncf-io\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846836 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-cni-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-cni-bin\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-multus-certs\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846874 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-k8s-cni-cncf-io\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846901 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-cni-bin\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846916 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-run-multus-certs\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846935 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-system-cni-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-cnibin\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-kubelet\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846980 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-system-cni-dir\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.846985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r45k8\" (UniqueName: \"kubernetes.io/projected/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-kube-api-access-r45k8\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.847016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-socket-dir-parent\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.847036 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-cnibin\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.847035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-host-var-lib-kubelet\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.847067 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-socket-dir-parent\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.847375 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-multus-daemon-config\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.847409 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-cni-binary-copy\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.848977 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6d69r" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.874121 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r45k8\" (UniqueName: \"kubernetes.io/projected/5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9-kube-api-access-r45k8\") pod \"multus-fb244\" (UID: \"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9\") " pod="openshift-multus/multus-fb244" Jul 16 16:38:58.919985 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.889738 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vsfqg" Jul 16 16:38:59.025320 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.924079 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:38:59.025320 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.966231 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" Jul 16 16:38:59.025320 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.970205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fb244" Jul 16 16:38:59.025320 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:58.995210 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" Jul 16 16:38:59.119131 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.059220 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gr27j" Jul 16 16:38:59.250725 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.250702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:38:59.250821 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.250736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:59.250855 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.250841 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:38:59.250925 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.250847 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:38:59.250925 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.250894 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:39:00.250880745 +0000 UTC m=+3.127108466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:38:59.250925 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.250906 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret podName:97c50344-aced-4b14-8860-661ae2c20d59 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:00.25090043 +0000 UTC m=+3.127128151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret") pod "global-pull-secret-syncer-kmj9t" (UID: "97c50344-aced-4b14-8860-661ae2c20d59") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:38:59.260796 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:59.260755 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498957fb_acdd_4109_84a6_e50e4d40c0a1.slice/crio-e16824e963aad7ba03f6296db79f67f90ccd065ca9f51c081a08a30c4035e79a WatchSource:0}: Error finding container e16824e963aad7ba03f6296db79f67f90ccd065ca9f51c081a08a30c4035e79a: Status 404 returned error can't find the container with id e16824e963aad7ba03f6296db79f67f90ccd065ca9f51c081a08a30c4035e79a Jul 16 16:38:59.261003 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:59.260981 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0ae342_aebb_4dc2_956c_359d800ea9c4.slice/crio-76c8d4627a338d0ac4e26968f99550e06f63ba25e3320179d700b7f91e409300 WatchSource:0}: Error finding container 76c8d4627a338d0ac4e26968f99550e06f63ba25e3320179d700b7f91e409300: Status 404 returned error can't find the container with id 76c8d4627a338d0ac4e26968f99550e06f63ba25e3320179d700b7f91e409300 Jul 16 16:38:59.264772 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.264756 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:38:59.351839 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.351816 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:38:59.351927 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.351919 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:38:59.351977 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.351931 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:38:59.351977 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.351939 2566 projected.go:196] Error preparing data for projected volume kube-api-access-92b44 for pod openshift-network-diagnostics/network-check-target-qlfdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:38:59.351977 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.351977 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44 podName:68284f0c-6366-4695-9567-e6e1957ed8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:39:00.351965268 +0000 UTC m=+3.228192990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-92b44" (UniqueName: "kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44") pod "network-check-target-qlfdh" (UID: "68284f0c-6366-4695-9567-e6e1957ed8eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:38:59.406759 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:59.406693 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5909f75c_6cdc_4fc3_b1f9_27ffa33d76d9.slice/crio-da913183db43cc47ce998035a133686c0bc38c31d929a4b2363c7c02b7abdf16 WatchSource:0}: Error finding container da913183db43cc47ce998035a133686c0bc38c31d929a4b2363c7c02b7abdf16: Status 404 returned error can't find the container with id da913183db43cc47ce998035a133686c0bc38c31d929a4b2363c7c02b7abdf16 Jul 16 16:38:59.421064 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:59.421044 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2918fc_1a74_4f6a_8eac_48bd9ad7199a.slice/crio-32bdc25de67cf830c154a4b748cf9b650ed09ab730ac28b41bb6aa87e6252091 WatchSource:0}: Error finding container 32bdc25de67cf830c154a4b748cf9b650ed09ab730ac28b41bb6aa87e6252091: Status 404 returned error can't find the container with id 32bdc25de67cf830c154a4b748cf9b650ed09ab730ac28b41bb6aa87e6252091 Jul 16 16:38:59.455995 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:59.455975 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94b15c8_a383_4478_bd05_012b50ddb4c9.slice/crio-79f0395dff3b35c4a41e84c73be4d638062c2f84e6baf96d2106afc370bb311d WatchSource:0}: Error finding container 79f0395dff3b35c4a41e84c73be4d638062c2f84e6baf96d2106afc370bb311d: Status 404 returned error can't find the container with id 79f0395dff3b35c4a41e84c73be4d638062c2f84e6baf96d2106afc370bb311d Jul 16 16:38:59.477470 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:59.477453 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748b6668_c372_4f86_b186_4ea2d6fc3e7f.slice/crio-0334f4df8188b1c6736d29c50a1905507528fa938f63d2e289fc7859ba9ee48a WatchSource:0}: Error finding container 0334f4df8188b1c6736d29c50a1905507528fa938f63d2e289fc7859ba9ee48a: Status 404 returned error can't find the container with id 0334f4df8188b1c6736d29c50a1905507528fa938f63d2e289fc7859ba9ee48a Jul 16 16:38:59.623018 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.622998 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:38:59.667197 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:38:59.667177 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fdfbe5f_ab71_46a0_997f_e456fa78f8c8.slice/crio-9c088d195ed9978bf0166a7211d3bef1c5863ad02c2fd8333bedab7dcc0790a3 WatchSource:0}: Error finding container 9c088d195ed9978bf0166a7211d3bef1c5863ad02c2fd8333bedab7dcc0790a3: Status 404 returned error can't find the container with id 9c088d195ed9978bf0166a7211d3bef1c5863ad02c2fd8333bedab7dcc0790a3 Jul 16 16:38:59.683372 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.683315 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:33:58 +0000 UTC" deadline="2028-02-14 08:21:12.561367762 +0000 UTC" Jul 16 16:38:59.683372 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.683364 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13863h42m12.878007894s" Jul 16 16:38:59.730998 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.730975 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:38:59.815994 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.815969 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:38:59.816130 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:38:59.816107 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:38:59.819760 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.819716 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"76c8d4627a338d0ac4e26968f99550e06f63ba25e3320179d700b7f91e409300"} Jul 16 16:38:59.821096 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.821049 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerStarted","Data":"e65ae8aa971805065e644e1c89851e87f2d83a5a4c5b773d8fa705ecb3fccb51"} Jul 16 16:38:59.822234 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.822210 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6d69r" event={"ID":"498957fb-acdd-4109-84a6-e50e4d40c0a1","Type":"ContainerStarted","Data":"e16824e963aad7ba03f6296db79f67f90ccd065ca9f51c081a08a30c4035e79a"} Jul 16 16:38:59.823547 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.823523 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" event={"ID":"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8","Type":"ContainerStarted","Data":"9c088d195ed9978bf0166a7211d3bef1c5863ad02c2fd8333bedab7dcc0790a3"} Jul 16 16:38:59.824800 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.824774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" event={"ID":"748b6668-c372-4f86-b186-4ea2d6fc3e7f","Type":"ContainerStarted","Data":"0334f4df8188b1c6736d29c50a1905507528fa938f63d2e289fc7859ba9ee48a"} Jul 16 16:38:59.826316 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.826292 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gr27j" event={"ID":"b94b15c8-a383-4478-bd05-012b50ddb4c9","Type":"ContainerStarted","Data":"79f0395dff3b35c4a41e84c73be4d638062c2f84e6baf96d2106afc370bb311d"} Jul 16 16:38:59.827556 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.827531 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vsfqg" event={"ID":"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a","Type":"ContainerStarted","Data":"32bdc25de67cf830c154a4b748cf9b650ed09ab730ac28b41bb6aa87e6252091"} Jul 16 16:38:59.828826 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.828802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fb244" event={"ID":"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9","Type":"ContainerStarted","Data":"da913183db43cc47ce998035a133686c0bc38c31d929a4b2363c7c02b7abdf16"} Jul 16 16:38:59.885949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:38:59.885922 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:39:00.260637 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:00.260595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:00.260814 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:00.260657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:00.260814 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.260796 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:00.260995 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.260858 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:39:02.260840108 +0000 UTC m=+5.137067843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:00.261268 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.261248 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:00.261344 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.261306 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret podName:97c50344-aced-4b14-8860-661ae2c20d59 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:02.26129079 +0000 UTC m=+5.137518517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret") pod "global-pull-secret-syncer-kmj9t" (UID: "97c50344-aced-4b14-8860-661ae2c20d59") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:00.361856 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:00.361229 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:00.361856 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.361425 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:39:00.361856 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.361447 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:39:00.361856 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.361459 2566 projected.go:196] Error preparing data for projected volume kube-api-access-92b44 for pod openshift-network-diagnostics/network-check-target-qlfdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:00.361856 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.361531 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44 podName:68284f0c-6366-4695-9567-e6e1957ed8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:39:02.361497957 +0000 UTC m=+5.237725692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-92b44" (UniqueName: "kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44") pod "network-check-target-qlfdh" (UID: "68284f0c-6366-4695-9567-e6e1957ed8eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:00.684425 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:00.684259 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:33:58 +0000 UTC" deadline="2028-02-14 15:28:27.607189762 +0000 UTC" Jul 16 16:39:00.684425 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:00.684324 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13870h49m26.922869552s" Jul 16 16:39:00.815363 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:00.815333 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:00.815559 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.815496 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:00.815960 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:00.815941 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:00.816052 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:00.816033 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:01.815659 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:01.815625 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:01.816092 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:01.815771 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:01.840905 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:01.840838 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" event={"ID":"9718661c04ac56f3b27f8d30fcd6b96b","Type":"ContainerStarted","Data":"ab489d8c834e55bb1dc03f37f127dc2c9fbfd0223e6a9ef89adea97436312386"} Jul 16 16:39:02.276828 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:02.276132 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:02.276828 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:02.276185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:02.276828 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.276311 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:02.276828 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.276370 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:39:06.276353321 +0000 UTC m=+9.152581049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:02.276828 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.276753 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:02.276828 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.276796 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret podName:97c50344-aced-4b14-8860-661ae2c20d59 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:06.276782413 +0000 UTC m=+9.153010138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret") pod "global-pull-secret-syncer-kmj9t" (UID: "97c50344-aced-4b14-8860-661ae2c20d59") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:02.377651 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:02.377049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:02.377651 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.377221 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:39:02.377651 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.377243 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:39:02.377651 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.377258 2566 projected.go:196] Error preparing data for projected volume kube-api-access-92b44 for pod openshift-network-diagnostics/network-check-target-qlfdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:02.377651 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.377314 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44 podName:68284f0c-6366-4695-9567-e6e1957ed8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:39:06.377296546 +0000 UTC m=+9.253524285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-92b44" (UniqueName: "kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44") pod "network-check-target-qlfdh" (UID: "68284f0c-6366-4695-9567-e6e1957ed8eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:02.815611 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:02.815122 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:02.815611 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.815239 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:02.815611 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:02.815356 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:02.815611 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:02.815465 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:03.815724 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:03.815693 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:03.815921 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:03.815833 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:04.815713 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:04.815679 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:04.815883 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:04.815802 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:04.816309 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:04.816167 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:04.816309 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:04.816260 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:05.816559 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:05.815784 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:05.816559 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:05.816127 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:06.308824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:06.308321 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:06.308824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:06.308373 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:06.308824 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.308556 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:06.308824 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.308619 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:39:14.308598612 +0000 UTC m=+17.184826335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:06.308824 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.308663 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:06.308824 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.308712 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret podName:97c50344-aced-4b14-8860-661ae2c20d59 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:14.308697976 +0000 UTC m=+17.184925713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret") pod "global-pull-secret-syncer-kmj9t" (UID: "97c50344-aced-4b14-8860-661ae2c20d59") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:06.410023 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:06.409460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:06.410023 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.409620 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:39:06.410023 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.409641 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:39:06.410023 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.409653 2566 projected.go:196] Error preparing data for projected volume kube-api-access-92b44 for pod openshift-network-diagnostics/network-check-target-qlfdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:06.410023 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.409706 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44 podName:68284f0c-6366-4695-9567-e6e1957ed8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:39:14.409688515 +0000 UTC m=+17.285916257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-92b44" (UniqueName: "kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44") pod "network-check-target-qlfdh" (UID: "68284f0c-6366-4695-9567-e6e1957ed8eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:06.815691 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:06.815611 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:06.815691 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:06.815655 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:06.815918 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.815736 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:06.816159 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:06.816134 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:07.816734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:07.816227 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:07.816734 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:07.816364 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:08.815571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:08.815535 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:08.815692 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:08.815535 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:08.815692 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:08.815639 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:08.815805 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:08.815694 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:09.814928 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:09.814902 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:09.815371 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:09.815039 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:10.815773 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:10.815729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:10.816160 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:10.815729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:10.816160 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:10.815841 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:10.816160 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:10.815941 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:11.815371 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:11.815300 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:11.815570 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:11.815442 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:12.815351 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:12.815323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:12.815725 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:12.815454 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:12.815725 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:12.815499 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:12.815725 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:12.815589 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:13.815351 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:13.815317 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:13.815792 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:13.815460 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:14.372971 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:14.372934 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:14.372971 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:14.372985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:14.373214 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.373114 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:14.373214 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.373116 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:14.373214 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.373175 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:39:30.373156896 +0000 UTC m=+33.249384619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:14.373214 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.373194 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret podName:97c50344-aced-4b14-8860-661ae2c20d59 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:30.373185013 +0000 UTC m=+33.249412739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret") pod "global-pull-secret-syncer-kmj9t" (UID: "97c50344-aced-4b14-8860-661ae2c20d59") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:14.474051 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:14.474016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:14.474214 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.474195 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:39:14.474271 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.474220 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:39:14.474271 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.474233 2566 projected.go:196] Error preparing data for projected volume kube-api-access-92b44 for pod openshift-network-diagnostics/network-check-target-qlfdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:14.474358 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.474291 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44 podName:68284f0c-6366-4695-9567-e6e1957ed8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:39:30.474273193 +0000 UTC m=+33.350500933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-92b44" (UniqueName: "kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44") pod "network-check-target-qlfdh" (UID: "68284f0c-6366-4695-9567-e6e1957ed8eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:14.815737 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:14.815663 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:14.816134 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.815778 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:14.816134 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:14.815827 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:14.816134 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:14.815913 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:15.815516 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:15.815471 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:15.815673 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:15.815603 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:16.815317 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:16.815281 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:16.815734 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:16.815426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:16.815734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:16.815468 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:16.815734 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:16.815595 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:17.396150 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:39:17.396122 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e7bbbe_ca22_427b_a6ce_2d3c134b7194.slice/crio-5a2a78c4e7f4dcd619f593e35a57827a67cbaed7b6da4905010edbd61c34b15d WatchSource:0}: Error finding container 5a2a78c4e7f4dcd619f593e35a57827a67cbaed7b6da4905010edbd61c34b15d: Status 404 returned error can't find the container with id 5a2a78c4e7f4dcd619f593e35a57827a67cbaed7b6da4905010edbd61c34b15d Jul 16 16:39:17.397141 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:39:17.397125 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c16a73d284a64f53cba0169247e9921.slice/crio-d80e38b104a94100dcb406b727e78766f39c585c29e088765dea2af9869861d2 WatchSource:0}: Error finding container d80e38b104a94100dcb406b727e78766f39c585c29e088765dea2af9869861d2: Status 404 returned error can't find the container with id d80e38b104a94100dcb406b727e78766f39c585c29e088765dea2af9869861d2 Jul 16 16:39:17.816169 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:17.816104 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:17.816612 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:17.816193 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:17.867333 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:17.867293 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" event={"ID":"5c16a73d284a64f53cba0169247e9921","Type":"ContainerStarted","Data":"d80e38b104a94100dcb406b727e78766f39c585c29e088765dea2af9869861d2"} Jul 16 16:39:17.868829 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:17.868795 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5r6xt" event={"ID":"13e7bbbe-ca22-427b-a6ce-2d3c134b7194","Type":"ContainerStarted","Data":"5a2a78c4e7f4dcd619f593e35a57827a67cbaed7b6da4905010edbd61c34b15d"} Jul 16 16:39:17.870980 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:17.870942 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" event={"ID":"748b6668-c372-4f86-b186-4ea2d6fc3e7f","Type":"ContainerStarted","Data":"820d9e9cf40fc8b6116056257a1c3124bd317fd028beb8612ba9ae4634526acc"} Jul 16 16:39:17.872706 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:17.872680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fb244" event={"ID":"5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9","Type":"ContainerStarted","Data":"2e300f0c65442da60f68aef97cb885d409fb346d0a9123a2c28c204a9cd2c4c6"} Jul 16 16:39:17.939016 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:17.938971 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5zhgd" podStartSLOduration=3.237100302 podStartE2EDuration="20.93895562s" totalImagesPullingTime="17.701855318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:17.909737146 +0000 UTC m=+20.785964892" watchObservedRunningTime="2026-07-16 16:39:17.93895562 +0000 UTC m=+20.815183363" Jul 16 16:39:18.815411 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.814989 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:18.815411 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.815055 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:18.815623 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:18.815447 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:18.815623 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:18.815549 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:18.876089 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.876062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" event={"ID":"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8","Type":"ContainerStarted","Data":"1c2fc7758537ab1209fbfa6b531011da9d333652e1bbbf4d87a67c2c8f826521"} Jul 16 16:39:18.877597 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.877572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gr27j" event={"ID":"b94b15c8-a383-4478-bd05-012b50ddb4c9","Type":"ContainerStarted","Data":"e37674bb7a3f61f700502ab7c85b4412e28804f4887b8605eaea73daa4bcbe8b"} Jul 16 16:39:18.879267 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.879242 2566 generic.go:356] "Generic (PLEG): container finished" podID="3e0af0e0-bc91-4fe2-ad71-38f68975f024" containerID="8d2fb7c18ba0dffed5e36c41f40eaef4662a57242a5b0ad92cb5fe77af4443f9" exitCode=0 Jul 16 16:39:18.879364 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.879321 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerDied","Data":"8d2fb7c18ba0dffed5e36c41f40eaef4662a57242a5b0ad92cb5fe77af4443f9"} Jul 16 16:39:18.880940 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.880867 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6d69r" event={"ID":"498957fb-acdd-4109-84a6-e50e4d40c0a1","Type":"ContainerStarted","Data":"555673cb2486d22b3c97e5e36be6d0312150692030b16de620ebd2d6008f2976"} Jul 16 16:39:18.882684 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.882660 2566 generic.go:356] "Generic (PLEG): container finished" podID="9718661c04ac56f3b27f8d30fcd6b96b" containerID="fbe69cd865e3990665e291b3d6ae51dd3fe3d356d00ae3ca5609ffd297846960" exitCode=0 Jul 16 16:39:18.882758 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.882700 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" event={"ID":"9718661c04ac56f3b27f8d30fcd6b96b","Type":"ContainerDied","Data":"fbe69cd865e3990665e291b3d6ae51dd3fe3d356d00ae3ca5609ffd297846960"} Jul 16 16:39:18.887257 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.887230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vsfqg" event={"ID":"bb2918fc-1a74-4f6a-8eac-48bd9ad7199a","Type":"ContainerStarted","Data":"05bed9e89ae64ece40b18ee0125ffa6be85d49b64f170f7508df7510af2db472"} Jul 16 16:39:18.890254 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890238 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/0.log" Jul 16 16:39:18.890612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890589 2566 generic.go:356] "Generic (PLEG): container finished" podID="5f0ae342-aebb-4dc2-956c-359d800ea9c4" containerID="2a1ddf09bf956f2bb60690f07f92408d0737bbeb459d583b1f70b230895bfe0f" exitCode=1 Jul 16 16:39:18.890710 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890665 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"ef87c8aac277d875a6ddb1694e49a3b7f54e438b255298c829718945d0c858bc"} Jul 16 16:39:18.890772 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890738 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"25d7533e2e773d0dc99ff5a65cfe0b4d098077679a4422b31a25d86da15a9840"} Jul 16 16:39:18.890822 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"d5bd302548a5e504d68be00409d6abbe5c3716233b1482c8b461328dabd69dfd"} Jul 16 16:39:18.890878 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890838 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"a0e8044585e67b194d0bdb60fcef4d0130db0ab807b8e9aca69d29029d77e8a3"} Jul 16 16:39:18.890927 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerDied","Data":"2a1ddf09bf956f2bb60690f07f92408d0737bbeb459d583b1f70b230895bfe0f"} Jul 16 16:39:18.890975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.890936 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"8ca6a4e7505c8fe2037567fcc4bcb8e015808d413f48cb6b1d642d5b40eb8005"} Jul 16 16:39:18.895824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.895788 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fb244" podStartSLOduration=2.912389533 podStartE2EDuration="20.895776782s" totalImagesPullingTime="17.983387249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:17.939308871 +0000 UTC m=+20.815536646" watchObservedRunningTime="2026-07-16 16:39:18.895776782 +0000 UTC m=+21.772004524" Jul 16 16:39:18.895981 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.895945 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gr27j" podStartSLOduration=4.17292717 podStartE2EDuration="21.895938574s" totalImagesPullingTime="17.723011404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:18.894141362 +0000 UTC m=+21.770369115" watchObservedRunningTime="2026-07-16 16:39:18.895938574 +0000 UTC m=+21.772166383" Jul 16 16:39:18.984955 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:18.984915 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6d69r" podStartSLOduration=12.155326432 podStartE2EDuration="21.984899966s" totalImagesPullingTime="9.829573534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:18.959191913 +0000 UTC m=+21.835419655" watchObservedRunningTime="2026-07-16 16:39:18.984899966 +0000 UTC m=+21.861127711" Jul 16 16:39:19.010182 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.010132 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vsfqg" podStartSLOduration=4.313104016 podStartE2EDuration="22.010112978s" totalImagesPullingTime="17.697008962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:19.00944295 +0000 UTC m=+21.885670714" watchObservedRunningTime="2026-07-16 16:39:19.010112978 +0000 UTC m=+21.886340723" Jul 16 16:39:19.435278 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.435250 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 16:39:19.733416 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.733241 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T16:39:19.4352727Z","UUID":"92c432df-32ff-4d4c-beea-c99d56c0d3e7","Handler":null,"Name":"","Endpoint":""} Jul 16 16:39:19.734861 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.734828 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 16:39:19.734969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.734878 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 16:39:19.815072 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.815043 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:19.815212 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:19.815172 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:19.894597 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.894537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" event={"ID":"9718661c04ac56f3b27f8d30fcd6b96b","Type":"ContainerStarted","Data":"8c74fd84d27df49659c114200e0a5a5349de73d0a21affbd0b88cae9f91dcb23"} Jul 16 16:39:19.896359 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.896335 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5r6xt" event={"ID":"13e7bbbe-ca22-427b-a6ce-2d3c134b7194","Type":"ContainerStarted","Data":"edc1becbeda41d65e45d89ba72b01c65030eaf8b0eab4b39eeff25b3760b4130"} Jul 16 16:39:19.898250 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.898228 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" event={"ID":"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8","Type":"ContainerStarted","Data":"f61a21851c6e701db4997a33a412089644d97d9c2cfb2ebc3dd9c7820861bb97"} Jul 16 16:39:19.924116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.924073 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-195.ec2.internal" podStartSLOduration=22.924056456 podStartE2EDuration="22.924056456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:19.923894907 +0000 UTC m=+22.800122668" watchObservedRunningTime="2026-07-16 16:39:19.924056456 +0000 UTC m=+22.800284201" Jul 16 16:39:19.949860 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:19.949818 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5r6xt" podStartSLOduration=21.05538792 podStartE2EDuration="22.949801204s" totalImagesPullingTime="1.894413284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:19.94922566 +0000 UTC m=+22.825453403" watchObservedRunningTime="2026-07-16 16:39:19.949801204 +0000 UTC m=+22.826028948" Jul 16 16:39:20.771001 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.770956 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:39:20.771817 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.771791 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:39:20.815422 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.815396 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:20.815422 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.815415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:20.815664 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:20.815556 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:20.815728 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:20.815679 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:20.905179 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.905115 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/0.log" Jul 16 16:39:20.905816 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.905793 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"456e97707cf969b63bbd2a6f380a8b1f370ae32f0406bfc9ec0ffcd1537264a5"} Jul 16 16:39:20.908216 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.908151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" event={"ID":"8fdfbe5f-ab71-46a0-997f-e456fa78f8c8","Type":"ContainerStarted","Data":"05f3857d2b2e9e8d0456ed5ce1a60ebf23de167d610e8c21b7f88c6dc329a007"} Jul 16 16:39:20.908925 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.908908 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:39:20.909343 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.909324 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5r6xt" Jul 16 16:39:20.929166 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:20.929122 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-482r6" podStartSLOduration=3.05116155 podStartE2EDuration="22.929107025s" totalImagesPullingTime="19.877945475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:20.928586631 +0000 UTC m=+23.804814392" watchObservedRunningTime="2026-07-16 16:39:20.929107025 +0000 UTC m=+23.805334771" Jul 16 16:39:21.814986 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:21.814952 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:21.815236 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:21.815059 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:22.815173 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:22.815140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:22.815616 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:22.815257 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:22.815616 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:22.815285 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:22.815616 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:22.815354 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:23.817580 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.815526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:23.817580 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:23.815820 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:23.916285 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.916185 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerStarted","Data":"53335bbb3f8dc22e316744f28c920887af431d705a852defacfedc61a9056e48"} Jul 16 16:39:23.917840 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.917706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" event={"ID":"5c16a73d284a64f53cba0169247e9921","Type":"ContainerStarted","Data":"1f87ae09b47c1f82d702d0f2796e126cb096a5785a4e9b42df942c884297defd"} Jul 16 16:39:23.921411 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.921383 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/0.log" Jul 16 16:39:23.923227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.921835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"27889d99451f1476c041cb101613e0fac6c9106a548957ff3b56772fa70306d1"} Jul 16 16:39:23.923227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.922144 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:39:23.923227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.922206 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:39:23.923227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.922252 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:39:23.923227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.922315 2566 scope.go:117] "RemoveContainer" containerID="2a1ddf09bf956f2bb60690f07f92408d0737bbeb459d583b1f70b230895bfe0f" Jul 16 16:39:23.934132 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.934021 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-195.ec2.internal" podStartSLOduration=26.934003287 podStartE2EDuration="26.934003287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:23.933704185 +0000 UTC m=+26.809931930" watchObservedRunningTime="2026-07-16 16:39:23.934003287 +0000 UTC m=+26.810231031" Jul 16 16:39:23.940165 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.940110 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:39:23.940800 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:23.940680 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:39:24.815174 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:24.815153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:24.815285 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:24.815235 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:24.815320 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:24.815293 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:24.815391 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:24.815374 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:24.927489 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:24.927460 2566 generic.go:356] "Generic (PLEG): container finished" podID="3e0af0e0-bc91-4fe2-ad71-38f68975f024" containerID="53335bbb3f8dc22e316744f28c920887af431d705a852defacfedc61a9056e48" exitCode=0 Jul 16 16:39:24.928162 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:24.927581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerDied","Data":"53335bbb3f8dc22e316744f28c920887af431d705a852defacfedc61a9056e48"} Jul 16 16:39:24.931714 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:24.931550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/0.log" Jul 16 16:39:24.932099 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:24.932081 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" event={"ID":"5f0ae342-aebb-4dc2-956c-359d800ea9c4","Type":"ContainerStarted","Data":"0be78968ead6bc9b0c523a394df480b487fe82ea9f1c3547ed8b84d644f3df0a"} Jul 16 16:39:24.989392 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:24.989324 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" podStartSLOduration=9.408117364 podStartE2EDuration="27.989313735s" totalImagesPullingTime="18.581196371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:24.98899944 +0000 UTC m=+27.865227183" watchObservedRunningTime="2026-07-16 16:39:24.989313735 +0000 UTC m=+27.865541478" Jul 16 16:39:25.815250 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.815224 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:25.815389 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:25.815360 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:25.862262 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.862240 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qlfdh"] Jul 16 16:39:25.862370 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.862334 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:25.862424 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:25.862404 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:25.866095 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.866030 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmj9t"] Jul 16 16:39:25.866172 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.866140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:25.866248 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:25.866226 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:25.866713 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.866691 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmhth"] Jul 16 16:39:25.935784 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.935757 2566 generic.go:356] "Generic (PLEG): container finished" podID="3e0af0e0-bc91-4fe2-ad71-38f68975f024" containerID="c240887a5648925cfb473dd3913d0fdc351151ace305c27aa72f8defbc5925fa" exitCode=0 Jul 16 16:39:25.936194 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.935836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerDied","Data":"c240887a5648925cfb473dd3913d0fdc351151ace305c27aa72f8defbc5925fa"} Jul 16 16:39:25.936194 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:25.935881 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:25.936194 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:25.936079 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:26.939958 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:26.939931 2566 generic.go:356] "Generic (PLEG): container finished" podID="3e0af0e0-bc91-4fe2-ad71-38f68975f024" containerID="43beaf4fc307513330716f4dc73dd3ad1c3c3e8df3ffaeaddf282de04aafde17" exitCode=0 Jul 16 16:39:26.940267 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:26.939990 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerDied","Data":"43beaf4fc307513330716f4dc73dd3ad1c3c3e8df3ffaeaddf282de04aafde17"} Jul 16 16:39:27.817053 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:27.816776 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:27.817210 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:27.816852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:27.817210 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:27.817100 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:27.817210 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:27.816888 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:27.817210 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:27.817189 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:27.817419 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:27.817276 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:29.815244 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:29.815212 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:29.815244 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:29.815227 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:29.815892 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:29.815354 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:29.815892 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:29.815334 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmj9t" podUID="97c50344-aced-4b14-8860-661ae2c20d59" Jul 16 16:39:29.815892 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:29.815450 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlfdh" podUID="68284f0c-6366-4695-9567-e6e1957ed8eb" Jul 16 16:39:29.815892 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:29.815558 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmhth" podUID="68db2a89-b8a8-48e1-86f8-cf3a82a73c0c" Jul 16 16:39:30.395066 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.395035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:30.395066 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.395070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:30.395259 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.395182 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:30.395259 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.395188 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:30.395259 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.395247 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:40:02.395229994 +0000 UTC m=+65.271457732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:39:30.395259 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.395261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret podName:97c50344-aced-4b14-8860-661ae2c20d59 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:02.395255183 +0000 UTC m=+65.271482904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret") pod "global-pull-secret-syncer-kmj9t" (UID: "97c50344-aced-4b14-8860-661ae2c20d59") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:39:30.403807 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.403741 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-195.ec2.internal" event="NodeReady" Jul 16 16:39:30.403958 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.403848 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 16:39:30.452917 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.451426 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54cc8dd856-prsmp"] Jul 16 16:39:30.487439 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.487414 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z6x6r"] Jul 16 16:39:30.487591 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.487539 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.491147 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.491122 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 16:39:30.491271 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.491157 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-twq28\"" Jul 16 16:39:30.491434 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.491417 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 16:39:30.491669 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.491649 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 16:39:30.495838 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.495816 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65acb107-ee0c-43eb-b42f-c58751e36dd9-ca-trust-extracted\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.495939 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.495845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-bound-sa-token\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.495939 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.495865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-trusted-ca\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.496024 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.495969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-installation-pull-secrets\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.496024 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.496000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w7q6\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-kube-api-access-8w7q6\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.496117 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.496053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.496174 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.496133 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-image-registry-private-configuration\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.496227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.496181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:30.496227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.496207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-certificates\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.496601 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.496337 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:39:30.496601 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.496360 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:39:30.496601 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.496373 2566 projected.go:196] Error preparing data for projected volume kube-api-access-92b44 for pod openshift-network-diagnostics/network-check-target-qlfdh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:30.496601 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.496420 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44 podName:68284f0c-6366-4695-9567-e6e1957ed8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:40:02.496404772 +0000 UTC m=+65.372632513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-92b44" (UniqueName: "kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44") pod "network-check-target-qlfdh" (UID: "68284f0c-6366-4695-9567-e6e1957ed8eb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:39:30.501262 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.501245 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 16:39:30.505422 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.505403 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cc8dd856-prsmp"] Jul 16 16:39:30.505514 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.505436 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dhq9c"] Jul 16 16:39:30.505578 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.505518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.512664 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.512644 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hghq8\"" Jul 16 16:39:30.513825 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.513806 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 16:39:30.513966 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.513950 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 16:39:30.523612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.523594 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhq9c"] Jul 16 16:39:30.523716 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.523626 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6x6r"] Jul 16 16:39:30.523716 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.523668 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:30.526335 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.526319 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9q89x\"" Jul 16 16:39:30.526424 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.526380 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 16:39:30.526494 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.526479 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 16:39:30.526793 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.526777 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 16:39:30.597058 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-installation-pull-secrets\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597068 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w7q6\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-kube-api-access-8w7q6\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8e52341-d9ec-45be-a0aa-0b2874c54545-cert\") pod \"ingress-canary-dhq9c\" (UID: \"b8e52341-d9ec-45be-a0aa-0b2874c54545\") " pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:30.597180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpfhw\" (UniqueName: \"kubernetes.io/projected/b8e52341-d9ec-45be-a0aa-0b2874c54545-kube-api-access-qpfhw\") pod \"ingress-canary-dhq9c\" (UID: \"b8e52341-d9ec-45be-a0aa-0b2874c54545\") " pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:30.597376 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-image-registry-private-configuration\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597376 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-certificates\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597376 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcgh4\" (UniqueName: \"kubernetes.io/projected/c86df681-3549-4fab-90e5-1316361b3e37-kube-api-access-qcgh4\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.597376 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597323 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.597376 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65acb107-ee0c-43eb-b42f-c58751e36dd9-ca-trust-extracted\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597558 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c86df681-3549-4fab-90e5-1316361b3e37-tmp-dir\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.597558 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-bound-sa-token\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597558 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-trusted-ca\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.597558 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.597432 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:39:30.597558 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.597453 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cc8dd856-prsmp: secret "image-registry-tls" not found Jul 16 16:39:30.597756 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.597561 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls podName:65acb107-ee0c-43eb-b42f-c58751e36dd9 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:31.097542578 +0000 UTC m=+33.973770314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls") pod "image-registry-54cc8dd856-prsmp" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9") : secret "image-registry-tls" not found Jul 16 16:39:30.597854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597834 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c86df681-3549-4fab-90e5-1316361b3e37-config-volume\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.598007 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.597964 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-certificates\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.598093 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.598011 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65acb107-ee0c-43eb-b42f-c58751e36dd9-ca-trust-extracted\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.598558 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.598537 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-trusted-ca\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.601779 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.601756 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-image-registry-private-configuration\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.601865 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.601762 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-installation-pull-secrets\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.608293 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.608246 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w7q6\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-kube-api-access-8w7q6\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.609782 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.609764 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-bound-sa-token\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:30.698602 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.698552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8e52341-d9ec-45be-a0aa-0b2874c54545-cert\") pod \"ingress-canary-dhq9c\" (UID: \"b8e52341-d9ec-45be-a0aa-0b2874c54545\") " pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:30.698602 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.698580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpfhw\" (UniqueName: \"kubernetes.io/projected/b8e52341-d9ec-45be-a0aa-0b2874c54545-kube-api-access-qpfhw\") pod \"ingress-canary-dhq9c\" (UID: \"b8e52341-d9ec-45be-a0aa-0b2874c54545\") " pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:30.698778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.698610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgh4\" (UniqueName: \"kubernetes.io/projected/c86df681-3549-4fab-90e5-1316361b3e37-kube-api-access-qcgh4\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.698778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.698634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.698778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.698661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c86df681-3549-4fab-90e5-1316361b3e37-tmp-dir\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.698778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.698688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c86df681-3549-4fab-90e5-1316361b3e37-config-volume\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.698778 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.698760 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:39:30.699002 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:30.698830 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls podName:c86df681-3549-4fab-90e5-1316361b3e37 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:31.198809855 +0000 UTC m=+34.075037601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls") pod "dns-default-z6x6r" (UID: "c86df681-3549-4fab-90e5-1316361b3e37") : secret "dns-default-metrics-tls" not found Jul 16 16:39:30.699002 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.698955 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c86df681-3549-4fab-90e5-1316361b3e37-tmp-dir\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.699187 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.699169 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c86df681-3549-4fab-90e5-1316361b3e37-config-volume\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.699456 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.699438 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:30.700653 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.700637 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8e52341-d9ec-45be-a0aa-0b2874c54545-cert\") pod \"ingress-canary-dhq9c\" (UID: \"b8e52341-d9ec-45be-a0aa-0b2874c54545\") " pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:30.707035 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.707016 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcgh4\" (UniqueName: \"kubernetes.io/projected/c86df681-3549-4fab-90e5-1316361b3e37-kube-api-access-qcgh4\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:30.707223 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.707164 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpfhw\" (UniqueName: \"kubernetes.io/projected/b8e52341-d9ec-45be-a0aa-0b2874c54545-kube-api-access-qpfhw\") pod \"ingress-canary-dhq9c\" (UID: \"b8e52341-d9ec-45be-a0aa-0b2874c54545\") " pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:30.793390 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.793371 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:30.832645 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:30.832628 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhq9c" Jul 16 16:39:31.015183 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.015157 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhq9c"] Jul 16 16:39:31.034334 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:39:31.034310 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e52341_d9ec_45be_a0aa_0b2874c54545.slice/crio-61ffb839256c9020def03d69bce920de4e29623a45e048d9d1b4d0cb6acf7234 WatchSource:0}: Error finding container 61ffb839256c9020def03d69bce920de4e29623a45e048d9d1b4d0cb6acf7234: Status 404 returned error can't find the container with id 61ffb839256c9020def03d69bce920de4e29623a45e048d9d1b4d0cb6acf7234 Jul 16 16:39:31.100587 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.100564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:31.100725 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:31.100696 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:39:31.100725 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:31.100719 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cc8dd856-prsmp: secret "image-registry-tls" not found Jul 16 16:39:31.100840 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:31.100766 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls podName:65acb107-ee0c-43eb-b42f-c58751e36dd9 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:32.100751753 +0000 UTC m=+34.976979474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls") pod "image-registry-54cc8dd856-prsmp" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9") : secret "image-registry-tls" not found Jul 16 16:39:31.201028 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.200857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:31.201125 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:31.200999 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:39:31.201125 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:31.201084 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls podName:c86df681-3549-4fab-90e5-1316361b3e37 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:32.201069346 +0000 UTC m=+35.077297068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls") pod "dns-default-z6x6r" (UID: "c86df681-3549-4fab-90e5-1316361b3e37") : secret "dns-default-metrics-tls" not found Jul 16 16:39:31.618493 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.618436 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:31.687936 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.687904 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:31.815786 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.815761 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:39:31.815933 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.815789 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:39:31.816000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.815951 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:39:31.820476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.820453 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 16:39:31.820637 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.820621 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 16:39:31.821555 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.821532 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:39:31.821672 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.821612 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tpj5v\"" Jul 16 16:39:31.821672 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.821659 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:39:31.821851 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.821836 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mb2b9\"" Jul 16 16:39:31.956838 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.956761 2566 generic.go:356] "Generic (PLEG): container finished" podID="3e0af0e0-bc91-4fe2-ad71-38f68975f024" containerID="095153c3d667afda84c9cb76ef2f24cdaa33467c61d56e0246248165c26780ec" exitCode=0 Jul 16 16:39:31.957341 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.956860 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerDied","Data":"095153c3d667afda84c9cb76ef2f24cdaa33467c61d56e0246248165c26780ec"} Jul 16 16:39:31.958232 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:31.958208 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhq9c" event={"ID":"b8e52341-d9ec-45be-a0aa-0b2874c54545","Type":"ContainerStarted","Data":"61ffb839256c9020def03d69bce920de4e29623a45e048d9d1b4d0cb6acf7234"} Jul 16 16:39:32.107567 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:32.107497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:32.107718 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:32.107698 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:39:32.107718 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:32.107718 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cc8dd856-prsmp: secret "image-registry-tls" not found Jul 16 16:39:32.107831 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:32.107772 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls podName:65acb107-ee0c-43eb-b42f-c58751e36dd9 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:34.107755551 +0000 UTC m=+36.983983284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls") pod "image-registry-54cc8dd856-prsmp" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9") : secret "image-registry-tls" not found Jul 16 16:39:32.208603 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:32.208544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:32.208730 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:32.208712 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:39:32.208797 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:32.208786 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls podName:c86df681-3549-4fab-90e5-1316361b3e37 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:34.208766646 +0000 UTC m=+37.084994381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls") pod "dns-default-z6x6r" (UID: "c86df681-3549-4fab-90e5-1316361b3e37") : secret "dns-default-metrics-tls" not found Jul 16 16:39:32.743537 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:32.743484 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:32.871319 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:32.871286 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:32.962992 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:32.962958 2566 generic.go:356] "Generic (PLEG): container finished" podID="3e0af0e0-bc91-4fe2-ad71-38f68975f024" containerID="27c7606c2228385881d0f3622c68cd8f2697fba6635893cc84329cc9c4112d28" exitCode=0 Jul 16 16:39:32.963353 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:32.963000 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerDied","Data":"27c7606c2228385881d0f3622c68cd8f2697fba6635893cc84329cc9c4112d28"} Jul 16 16:39:33.968566 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:33.968538 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" event={"ID":"3e0af0e0-bc91-4fe2-ad71-38f68975f024","Type":"ContainerStarted","Data":"319a9a8b8b5e7a36d4a73b7ce5d62de3e1f2a5284c022d821bcce6fff36cecd6"} Jul 16 16:39:33.993966 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:33.993929 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xzsh6" podStartSLOduration=8.73863991 podStartE2EDuration="36.99391484s" totalImagesPullingTime="28.25527493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:33.992707966 +0000 UTC m=+36.868935727" watchObservedRunningTime="2026-07-16 16:39:33.99391484 +0000 UTC m=+36.870142583" Jul 16 16:39:34.121742 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:34.121699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:34.121894 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:34.121805 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:39:34.121894 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:34.121822 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cc8dd856-prsmp: secret "image-registry-tls" not found Jul 16 16:39:34.121894 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:34.121864 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls podName:65acb107-ee0c-43eb-b42f-c58751e36dd9 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:38.12185117 +0000 UTC m=+40.998078891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls") pod "image-registry-54cc8dd856-prsmp" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9") : secret "image-registry-tls" not found Jul 16 16:39:34.122186 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:34.122165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:34.221866 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:34.221790 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:34.222089 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:34.222071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:34.222215 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:34.222202 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:39:34.222267 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:34.222259 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls podName:c86df681-3549-4fab-90e5-1316361b3e37 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:38.222245234 +0000 UTC m=+41.098472955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls") pod "dns-default-z6x6r" (UID: "c86df681-3549-4fab-90e5-1316361b3e37") : secret "dns-default-metrics-tls" not found Jul 16 16:39:34.971838 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:34.971664 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhq9c" event={"ID":"b8e52341-d9ec-45be-a0aa-0b2874c54545","Type":"ContainerStarted","Data":"cbd77ae6a5ba590c0878bb9ece19a62b4735fd3f750732044f223e4e072b8260"} Jul 16 16:39:34.988279 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:34.988233 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dhq9c" podStartSLOduration=2.053186468 podStartE2EDuration="4.988219891s" totalImagesPullingTime="2.935033423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:39:34.988097144 +0000 UTC m=+37.864324888" watchObservedRunningTime="2026-07-16 16:39:34.988219891 +0000 UTC m=+37.864447633" Jul 16 16:39:36.190630 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:36.190604 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:36.248165 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:36.248143 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:38.150233 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:38.150197 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:38.150579 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:38.150335 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:39:38.150579 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:38.150350 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cc8dd856-prsmp: secret "image-registry-tls" not found Jul 16 16:39:38.150579 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:38.150396 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls podName:65acb107-ee0c-43eb-b42f-c58751e36dd9 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:46.150382543 +0000 UTC m=+49.026610264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls") pod "image-registry-54cc8dd856-prsmp" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9") : secret "image-registry-tls" not found Jul 16 16:39:38.250576 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:38.250552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:38.250687 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:38.250674 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:39:38.250734 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:38.250720 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls podName:c86df681-3549-4fab-90e5-1316361b3e37 nodeName:}" failed. No retries permitted until 2026-07-16 16:39:46.250707662 +0000 UTC m=+49.126935383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls") pod "dns-default-z6x6r" (UID: "c86df681-3549-4fab-90e5-1316361b3e37") : secret "dns-default-metrics-tls" not found Jul 16 16:39:39.237497 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:39.237468 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:39.301069 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:39.301048 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:40.132481 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:40.132448 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:40.233093 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:40.233067 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:41.174214 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:41.174181 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:41.274566 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:41.274536 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:43.014729 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:43.014695 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:46.203589 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:46.203564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:39:46.203922 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:46.203657 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:39:46.203922 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:46.203668 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cc8dd856-prsmp: secret "image-registry-tls" not found Jul 16 16:39:46.203922 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:46.203725 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls podName:65acb107-ee0c-43eb-b42f-c58751e36dd9 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:02.20371044 +0000 UTC m=+65.079938165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls") pod "image-registry-54cc8dd856-prsmp" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9") : secret "image-registry-tls" not found Jul 16 16:39:46.304367 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:46.304343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:39:46.304484 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:46.304458 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:39:46.304536 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:39:46.304500 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls podName:c86df681-3549-4fab-90e5-1316361b3e37 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:02.304489386 +0000 UTC m=+65.180717112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls") pod "dns-default-z6x6r" (UID: "c86df681-3549-4fab-90e5-1316361b3e37") : secret "dns-default-metrics-tls" not found Jul 16 16:39:53.332587 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:53.332556 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:53.434731 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:53.434705 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:54.942660 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:54.942628 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:55.049146 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:55.049121 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:55.782979 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:55.782956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:55.855564 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:55.855521 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:55.924708 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:55.924680 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:55.945810 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:55.945788 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkf9" Jul 16 16:39:56.135625 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:56.135603 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:56.232807 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:56.232788 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:57.713559 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:57.713530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:39:57.815473 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:39:57.815448 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:00.159807 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:00.159748 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:00.260069 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:00.260042 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:00.359858 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:00.359841 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:01.067864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.067832 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lf5gl"] Jul 16 16:40:01.075219 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.075194 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.078110 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.078089 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 16:40:01.078232 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.078112 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fdqgr\"" Jul 16 16:40:01.078232 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.078210 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 16:40:01.079335 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.079317 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 16:40:01.079384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.079337 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 16:40:01.083000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.082966 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lf5gl"] Jul 16 16:40:01.091028 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.091007 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:01.108860 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.108836 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.108976 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.108903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcgld\" (UniqueName: \"kubernetes.io/projected/4861afaa-f679-4248-b832-c32809715310-kube-api-access-vcgld\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.108976 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.108959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4861afaa-f679-4248-b832-c32809715310-crio-socket\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.109078 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.109006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.109078 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.109059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4861afaa-f679-4248-b832-c32809715310-data-volume\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.209400 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.209374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.209466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcgld\" (UniqueName: \"kubernetes.io/projected/4861afaa-f679-4248-b832-c32809715310-kube-api-access-vcgld\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.209522 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4861afaa-f679-4248-b832-c32809715310-crio-socket\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.209527 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.209582 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4861afaa-f679-4248-b832-c32809715310-crio-socket\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.209598 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:01.709577898 +0000 UTC m=+64.585805625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : secret "insights-runtime-extractor-tls" not found Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.209622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.209645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4861afaa-f679-4248-b832-c32809715310-data-volume\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.209703 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:40:01.209769 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.209767 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:01.709754479 +0000 UTC m=+64.585982223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : configmap "kube-rbac-proxy" not found Jul 16 16:40:01.210061 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.209881 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4861afaa-f679-4248-b832-c32809715310-data-volume\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.212035 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.212015 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:01.222300 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.222283 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcgld\" (UniqueName: \"kubernetes.io/projected/4861afaa-f679-4248-b832-c32809715310-kube-api-access-vcgld\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.713879 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.713846 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.714037 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:01.713891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:01.714037 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.713956 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:40:01.714037 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.714015 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:40:01.714037 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.714031 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:02.714014103 +0000 UTC m=+65.590241827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : configmap "kube-rbac-proxy" not found Jul 16 16:40:01.714171 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:01.714065 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:02.714053225 +0000 UTC m=+65.590280946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : secret "insights-runtime-extractor-tls" not found Jul 16 16:40:02.217447 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.217413 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:40:02.217826 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.217597 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:40:02.217826 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.217613 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cc8dd856-prsmp: secret "image-registry-tls" not found Jul 16 16:40:02.217826 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.217670 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls podName:65acb107-ee0c-43eb-b42f-c58751e36dd9 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:34.217653934 +0000 UTC m=+97.093881655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls") pod "image-registry-54cc8dd856-prsmp" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9") : secret "image-registry-tls" not found Jul 16 16:40:02.318261 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.318225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:40:02.318413 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.318397 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:40:02.318470 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.318460 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls podName:c86df681-3549-4fab-90e5-1316361b3e37 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:34.318442343 +0000 UTC m=+97.194670066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls") pod "dns-default-z6x6r" (UID: "c86df681-3549-4fab-90e5-1316361b3e37") : secret "dns-default-metrics-tls" not found Jul 16 16:40:02.418714 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.418684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:40:02.418897 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.418877 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:40:02.421604 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.421582 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:40:02.421955 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.421942 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:40:02.429274 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.429254 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 16:40:02.429375 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.429312 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs podName:68db2a89-b8a8-48e1-86f8-cf3a82a73c0c nodeName:}" failed. No retries permitted until 2026-07-16 16:41:06.429297153 +0000 UTC m=+129.305524878 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs") pod "network-metrics-daemon-xmhth" (UID: "68db2a89-b8a8-48e1-86f8-cf3a82a73c0c") : secret "metrics-daemon-secret" not found Jul 16 16:40:02.431362 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.431336 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97c50344-aced-4b14-8860-661ae2c20d59-original-pull-secret\") pod \"global-pull-secret-syncer-kmj9t\" (UID: \"97c50344-aced-4b14-8860-661ae2c20d59\") " pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:40:02.519810 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.519748 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:40:02.522667 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.522651 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 16:40:02.533596 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.533574 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 16:40:02.543500 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.543472 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92b44\" (UniqueName: \"kubernetes.io/projected/68284f0c-6366-4695-9567-e6e1957ed8eb-kube-api-access-92b44\") pod \"network-check-target-qlfdh\" (UID: \"68284f0c-6366-4695-9567-e6e1957ed8eb\") " pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:40:02.721290 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.721254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:02.721462 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.721303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:02.721462 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.721362 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:40:02.721462 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.721395 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:40:02.721462 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.721441 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:04.721424573 +0000 UTC m=+67.597652309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : secret "insights-runtime-extractor-tls" not found Jul 16 16:40:02.721462 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:02.721461 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:04.721453747 +0000 UTC m=+67.597681468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : configmap "kube-rbac-proxy" not found Jul 16 16:40:02.729975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.729953 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmj9t" Jul 16 16:40:02.739934 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.739915 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tpj5v\"" Jul 16 16:40:02.747837 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.747818 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:40:02.882037 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.882009 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmj9t"] Jul 16 16:40:02.884807 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:02.884780 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c50344_aced_4b14_8860_661ae2c20d59.slice/crio-7dde8defedd044c1a7acff4a7d8c91037e82fa7a58cd5cf7d0336654cf73e319 WatchSource:0}: Error finding container 7dde8defedd044c1a7acff4a7d8c91037e82fa7a58cd5cf7d0336654cf73e319: Status 404 returned error can't find the container with id 7dde8defedd044c1a7acff4a7d8c91037e82fa7a58cd5cf7d0336654cf73e319 Jul 16 16:40:02.899303 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:02.899283 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qlfdh"] Jul 16 16:40:02.903710 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:02.903404 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68284f0c_6366_4695_9567_e6e1957ed8eb.slice/crio-9450ca6ef43b6d21240847b0c075e0cc0f4049a53fcfcf0f6378f98753dce5b1 WatchSource:0}: Error finding container 9450ca6ef43b6d21240847b0c075e0cc0f4049a53fcfcf0f6378f98753dce5b1: Status 404 returned error can't find the container with id 9450ca6ef43b6d21240847b0c075e0cc0f4049a53fcfcf0f6378f98753dce5b1 Jul 16 16:40:03.032238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:03.032150 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qlfdh" event={"ID":"68284f0c-6366-4695-9567-e6e1957ed8eb","Type":"ContainerStarted","Data":"9450ca6ef43b6d21240847b0c075e0cc0f4049a53fcfcf0f6378f98753dce5b1"} Jul 16 16:40:03.033209 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:03.033188 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmj9t" event={"ID":"97c50344-aced-4b14-8860-661ae2c20d59","Type":"ContainerStarted","Data":"7dde8defedd044c1a7acff4a7d8c91037e82fa7a58cd5cf7d0336654cf73e319"} Jul 16 16:40:03.308287 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:03.308195 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gr27j_b94b15c8-a383-4478-bd05-012b50ddb4c9/dns-node-resolver/0.log" Jul 16 16:40:03.705304 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:03.705270 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6d69r_498957fb-acdd-4109-84a6-e50e4d40c0a1/node-ca/0.log" Jul 16 16:40:04.503031 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.502999 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhq9c_b8e52341-d9ec-45be-a0aa-0b2874c54545/serve-healthcheck-canary/0.log" Jul 16 16:40:04.737822 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.737609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:04.737822 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.737730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:04.737822 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:04.737760 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:40:04.737822 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:04.737813 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:40:04.738120 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:04.737838 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:08.737817937 +0000 UTC m=+71.614045659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : secret "insights-runtime-extractor-tls" not found Jul 16 16:40:04.738120 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:04.737863 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:08.737847732 +0000 UTC m=+71.614075468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : configmap "kube-rbac-proxy" not found Jul 16 16:40:04.749571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.749546 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:04.780294 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.780219 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27"] Jul 16 16:40:04.783463 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.783439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" Jul 16 16:40:04.786352 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.786329 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 16:40:04.786453 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.786330 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lc6w8\"" Jul 16 16:40:04.787695 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.787498 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 16:40:04.798417 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.798360 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27"] Jul 16 16:40:04.825755 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.825727 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:04.838927 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.838899 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79n9m\" (UniqueName: \"kubernetes.io/projected/b1c574e5-b1ad-4327-badd-1613e78c02b1-kube-api-access-79n9m\") pod \"migrator-7f59b54f6c-fxf27\" (UID: \"b1c574e5-b1ad-4327-badd-1613e78c02b1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" Jul 16 16:40:04.888282 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.888245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:04.940329 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.940299 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79n9m\" (UniqueName: \"kubernetes.io/projected/b1c574e5-b1ad-4327-badd-1613e78c02b1-kube-api-access-79n9m\") pod \"migrator-7f59b54f6c-fxf27\" (UID: \"b1c574e5-b1ad-4327-badd-1613e78c02b1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" Jul 16 16:40:04.951254 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:04.951221 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79n9m\" (UniqueName: \"kubernetes.io/projected/b1c574e5-b1ad-4327-badd-1613e78c02b1-kube-api-access-79n9m\") pod \"migrator-7f59b54f6c-fxf27\" (UID: \"b1c574e5-b1ad-4327-badd-1613e78c02b1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" Jul 16 16:40:05.095043 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:05.094965 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" Jul 16 16:40:07.275633 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:07.275480 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27"] Jul 16 16:40:07.279465 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:07.279442 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c574e5_b1ad_4327_badd_1613e78c02b1.slice/crio-5424116513ed382590966b6758e4cfd7ba0dcf3f7410fb5bc952941823489a3e WatchSource:0}: Error finding container 5424116513ed382590966b6758e4cfd7ba0dcf3f7410fb5bc952941823489a3e: Status 404 returned error can't find the container with id 5424116513ed382590966b6758e4cfd7ba0dcf3f7410fb5bc952941823489a3e Jul 16 16:40:07.594264 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:07.594190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:07.658147 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:07.658124 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:08.048382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.048344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qlfdh" event={"ID":"68284f0c-6366-4695-9567-e6e1957ed8eb","Type":"ContainerStarted","Data":"359a74819b7c07af5f8e57f2583f294bab681de87ec3a99a6c459755ba963529"} Jul 16 16:40:08.048571 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.048481 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:40:08.049980 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.049950 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmj9t" event={"ID":"97c50344-aced-4b14-8860-661ae2c20d59","Type":"ContainerStarted","Data":"a09fcbdeb433c86dbc0069aa712e3649b9480a1f2ca6cd8869a35befdb54f32b"} Jul 16 16:40:08.051225 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.051201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" event={"ID":"b1c574e5-b1ad-4327-badd-1613e78c02b1","Type":"ContainerStarted","Data":"5424116513ed382590966b6758e4cfd7ba0dcf3f7410fb5bc952941823489a3e"} Jul 16 16:40:08.069094 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.069056 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qlfdh" podStartSLOduration=66.833932815 podStartE2EDuration="1m11.069040688s" totalImagesPullingTime="4.235107873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:08.068291182 +0000 UTC m=+70.944518919" watchObservedRunningTime="2026-07-16 16:40:08.069040688 +0000 UTC m=+70.945268433" Jul 16 16:40:08.287576 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.287544 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:08.354244 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.354166 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:08.772730 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.772704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:08.772818 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:08.772749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:08.772856 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:08.772824 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:40:08.772856 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:08.772846 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:40:08.772914 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:08.772876 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:16.772861543 +0000 UTC m=+79.649089264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : configmap "kube-rbac-proxy" not found Jul 16 16:40:08.772914 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:08.772890 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:16.772883741 +0000 UTC m=+79.649111462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : secret "insights-runtime-extractor-tls" not found Jul 16 16:40:09.056427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.056394 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" event={"ID":"b1c574e5-b1ad-4327-badd-1613e78c02b1","Type":"ContainerStarted","Data":"9c114f7f491914093eca2ecf4e48375fb253885c4f9ede59999e0dac37f76203"} Jul 16 16:40:09.056583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.056457 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" event={"ID":"b1c574e5-b1ad-4327-badd-1613e78c02b1","Type":"ContainerStarted","Data":"31faf5e9a53ff4be47c72f448076f8e93dc56107df044ed60b60f9901fb22451"} Jul 16 16:40:09.076054 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.076019 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kmj9t" podStartSLOduration=66.814800328 podStartE2EDuration="1m11.07600561s" totalImagesPullingTime="4.261205282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:08.084055145 +0000 UTC m=+70.960282886" watchObservedRunningTime="2026-07-16 16:40:09.07600561 +0000 UTC m=+71.952233353" Jul 16 16:40:09.076428 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.076406 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fxf27" podStartSLOduration=3.743513778 podStartE2EDuration="5.07639869s" totalImagesPullingTime="1.332884912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:09.0748784 +0000 UTC m=+71.951106153" watchObservedRunningTime="2026-07-16 16:40:09.07639869 +0000 UTC m=+71.952626433" Jul 16 16:40:09.171982 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.171960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:09.251517 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.251482 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:09.881574 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.881545 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-55bw7"] Jul 16 16:40:09.883430 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.883415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:09.886171 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.886150 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f44ws\"" Jul 16 16:40:09.886280 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.886248 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 16 16:40:09.886280 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.886261 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 16 16:40:09.887364 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.887348 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 16 16:40:09.887399 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.887382 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 16 16:40:09.893340 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.893316 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-55bw7"] Jul 16 16:40:09.925427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.925397 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:09.980450 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.980425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a65b12b-0961-43c8-9df2-799649ba9d15-signing-cabundle\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:09.980557 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.980453 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989zf\" (UniqueName: \"kubernetes.io/projected/2a65b12b-0961-43c8-9df2-799649ba9d15-kube-api-access-989zf\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:09.980557 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:09.980482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a65b12b-0961-43c8-9df2-799649ba9d15-signing-key\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.081065 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.081045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a65b12b-0961-43c8-9df2-799649ba9d15-signing-cabundle\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.081205 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.081070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989zf\" (UniqueName: \"kubernetes.io/projected/2a65b12b-0961-43c8-9df2-799649ba9d15-kube-api-access-989zf\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.081205 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.081095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a65b12b-0961-43c8-9df2-799649ba9d15-signing-key\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.081702 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.081682 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a65b12b-0961-43c8-9df2-799649ba9d15-signing-cabundle\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.083425 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.083406 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a65b12b-0961-43c8-9df2-799649ba9d15-signing-key\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.090599 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.090579 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-989zf\" (UniqueName: \"kubernetes.io/projected/2a65b12b-0961-43c8-9df2-799649ba9d15-kube-api-access-989zf\") pod \"service-ca-79f68b9f4f-55bw7\" (UID: \"2a65b12b-0961-43c8-9df2-799649ba9d15\") " pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.192171 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.192094 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" Jul 16 16:40:10.313918 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.313892 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-55bw7"] Jul 16 16:40:10.316762 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:10.316729 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a65b12b_0961_43c8_9df2_799649ba9d15.slice/crio-800aa6db8656d69217b98b96ee658b34fb9acccf476f8a8fc4afcdb1d096c227 WatchSource:0}: Error finding container 800aa6db8656d69217b98b96ee658b34fb9acccf476f8a8fc4afcdb1d096c227: Status 404 returned error can't find the container with id 800aa6db8656d69217b98b96ee658b34fb9acccf476f8a8fc4afcdb1d096c227 Jul 16 16:40:10.813063 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:10.812992 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:11.065325 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:11.065238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" event={"ID":"2a65b12b-0961-43c8-9df2-799649ba9d15","Type":"ContainerStarted","Data":"800aa6db8656d69217b98b96ee658b34fb9acccf476f8a8fc4afcdb1d096c227"} Jul 16 16:40:13.073236 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:13.073203 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" event={"ID":"2a65b12b-0961-43c8-9df2-799649ba9d15","Type":"ContainerStarted","Data":"fd33a7d6b09727ef81ea68f2b14ed6c87f6054085ff206f2c1e92272e50ae1b4"} Jul 16 16:40:13.095127 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:13.095081 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-55bw7" podStartSLOduration=2.280100294 podStartE2EDuration="4.095063513s" totalImagesPullingTime="1.814963219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:13.094071584 +0000 UTC m=+75.970299327" watchObservedRunningTime="2026-07-16 16:40:13.095063513 +0000 UTC m=+75.971291258" Jul 16 16:40:13.368469 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:13.368338 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:13.474370 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:13.474330 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:13.575228 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:13.575190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:13.673635 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:13.673606 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:13.780557 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:13.780530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:14.853238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:14.853205 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:14.926429 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:14.926401 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:15.281008 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:15.280976 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:15.476221 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:15.476186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:15.681310 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:15.681283 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:16.831956 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:16.831919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:16.832345 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:16.831975 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:16.832345 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:16.832084 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:40:16.832345 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:16.832151 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls podName:4861afaa-f679-4248-b832-c32809715310 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:32.832135627 +0000 UTC m=+95.708363348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lf5gl" (UID: "4861afaa-f679-4248-b832-c32809715310") : secret "insights-runtime-extractor-tls" not found Jul 16 16:40:16.832564 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:16.832542 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4861afaa-f679-4248-b832-c32809715310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:16.905727 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:16.905698 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:17.056117 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:17.056081 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:17.154468 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:17.154438 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:17.298123 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:17.298095 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:17.500444 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:17.500371 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:17.687460 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:17.687430 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:17.800278 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:17.800195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:18.692387 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:18.692359 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:18.830027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:18.830001 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:18.929417 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:18.929382 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.030092 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.030033 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.130774 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.130748 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.236490 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.236461 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.347550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.347489 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.478373 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.478348 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.680349 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.680328 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.802882 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.802853 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:19.903698 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:19.903596 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:20.474991 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:20.474960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:20.787050 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:20.786977 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:20.942149 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:20.942126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:21.131847 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:21.131827 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:21.285869 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:21.285849 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:21.392830 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:21.392772 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:21.494711 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:21.494689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:21.718330 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:21.718250 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:22.871816 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:22.871785 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:22.933048 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:22.933020 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:23.203589 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:23.203548 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:23.303793 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:23.303741 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:23.466487 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:23.466431 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:23.672666 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:23.672646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:24.173405 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:24.173377 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:24.476669 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:24.476595 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:25.331378 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:25.331354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:25.433542 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:25.433501 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:26.565141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:26.565114 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:26.830423 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:26.830361 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:29.430190 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:29.430160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:29.535678 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:29.535646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:29.629090 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:29.629061 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:29.960795 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:29.960772 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:30.326329 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:30.326269 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:30.392632 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:30.392609 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:32.304002 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.303972 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dc2hv"] Jul 16 16:40:32.308123 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.308101 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.312464 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.312445 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7t8bc\"" Jul 16 16:40:32.312578 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.312445 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 16:40:32.312578 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.312478 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 16:40:32.323827 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.323807 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dc2hv"] Jul 16 16:40:32.351317 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.351293 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz"] Jul 16 16:40:32.354105 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.354089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.358160 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.358133 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 16:40:32.358160 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.358141 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 16:40:32.358694 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.358674 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 16:40:32.358694 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.358675 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 16:40:32.358845 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.358775 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pcfc6\"" Jul 16 16:40:32.378961 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.378942 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz"] Jul 16 16:40:32.399377 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.399354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:32.412628 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.412608 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7"] Jul 16 16:40:32.415537 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.415520 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-r6hp4"] Jul 16 16:40:32.415633 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.415617 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" Jul 16 16:40:32.418338 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.418323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-r6hp4" Jul 16 16:40:32.418536 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.418519 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xrzxg\"" Jul 16 16:40:32.418619 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.418543 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 16:40:32.421454 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.421424 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 16:40:32.421909 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.421895 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-x6htr\"" Jul 16 16:40:32.422662 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.422646 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 16:40:32.429310 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.429292 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7"] Jul 16 16:40:32.432336 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.432306 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-r6hp4"] Jul 16 16:40:32.438610 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.438583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3d5ae5ec-98db-4f79-9156-c4a4116e60ea-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dc2hv\" (UID: \"3d5ae5ec-98db-4f79-9156-c4a4116e60ea\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.438689 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.438663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f435ffa7-b98a-4303-a32b-fc9fc024dfd6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64ddbf64cd-stfpz\" (UID: \"f435ffa7-b98a-4303-a32b-fc9fc024dfd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.438689 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.438685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d5ae5ec-98db-4f79-9156-c4a4116e60ea-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dc2hv\" (UID: \"3d5ae5ec-98db-4f79-9156-c4a4116e60ea\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.438757 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.438714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjlfl\" (UniqueName: \"kubernetes.io/projected/f435ffa7-b98a-4303-a32b-fc9fc024dfd6-kube-api-access-vjlfl\") pod \"managed-serviceaccount-addon-agent-64ddbf64cd-stfpz\" (UID: \"f435ffa7-b98a-4303-a32b-fc9fc024dfd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.514732 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.514706 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:32.539208 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.539188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjlfl\" (UniqueName: \"kubernetes.io/projected/f435ffa7-b98a-4303-a32b-fc9fc024dfd6-kube-api-access-vjlfl\") pod \"managed-serviceaccount-addon-agent-64ddbf64cd-stfpz\" (UID: \"f435ffa7-b98a-4303-a32b-fc9fc024dfd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.539264 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.539239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3d5ae5ec-98db-4f79-9156-c4a4116e60ea-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dc2hv\" (UID: \"3d5ae5ec-98db-4f79-9156-c4a4116e60ea\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.539311 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.539270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ba653f21-6817-4674-a9ef-1f9674ad95bd-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-cggs7\" (UID: \"ba653f21-6817-4674-a9ef-1f9674ad95bd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" Jul 16 16:40:32.539382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.539364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc5d8\" (UniqueName: \"kubernetes.io/projected/859b2b61-1446-4a6f-8942-db25062c1339-kube-api-access-hc5d8\") pod \"downloads-68c9cbb497-r6hp4\" (UID: \"859b2b61-1446-4a6f-8942-db25062c1339\") " pod="openshift-console/downloads-68c9cbb497-r6hp4" Jul 16 16:40:32.539801 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.539408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f435ffa7-b98a-4303-a32b-fc9fc024dfd6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64ddbf64cd-stfpz\" (UID: \"f435ffa7-b98a-4303-a32b-fc9fc024dfd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.539801 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.539430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d5ae5ec-98db-4f79-9156-c4a4116e60ea-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dc2hv\" (UID: \"3d5ae5ec-98db-4f79-9156-c4a4116e60ea\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.540019 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.540003 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3d5ae5ec-98db-4f79-9156-c4a4116e60ea-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dc2hv\" (UID: \"3d5ae5ec-98db-4f79-9156-c4a4116e60ea\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.541626 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.541607 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3d5ae5ec-98db-4f79-9156-c4a4116e60ea-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dc2hv\" (UID: \"3d5ae5ec-98db-4f79-9156-c4a4116e60ea\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.541754 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.541738 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f435ffa7-b98a-4303-a32b-fc9fc024dfd6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64ddbf64cd-stfpz\" (UID: \"f435ffa7-b98a-4303-a32b-fc9fc024dfd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.548148 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.548123 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjlfl\" (UniqueName: \"kubernetes.io/projected/f435ffa7-b98a-4303-a32b-fc9fc024dfd6-kube-api-access-vjlfl\") pod \"managed-serviceaccount-addon-agent-64ddbf64cd-stfpz\" (UID: \"f435ffa7-b98a-4303-a32b-fc9fc024dfd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.615046 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.614991 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:32.615882 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.615867 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" Jul 16 16:40:32.639947 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.639920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ba653f21-6817-4674-a9ef-1f9674ad95bd-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-cggs7\" (UID: \"ba653f21-6817-4674-a9ef-1f9674ad95bd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" Jul 16 16:40:32.640052 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.639963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc5d8\" (UniqueName: \"kubernetes.io/projected/859b2b61-1446-4a6f-8942-db25062c1339-kube-api-access-hc5d8\") pod \"downloads-68c9cbb497-r6hp4\" (UID: \"859b2b61-1446-4a6f-8942-db25062c1339\") " pod="openshift-console/downloads-68c9cbb497-r6hp4" Jul 16 16:40:32.642385 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.642359 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ba653f21-6817-4674-a9ef-1f9674ad95bd-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-cggs7\" (UID: \"ba653f21-6817-4674-a9ef-1f9674ad95bd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" Jul 16 16:40:32.650255 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.650235 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc5d8\" (UniqueName: \"kubernetes.io/projected/859b2b61-1446-4a6f-8942-db25062c1339-kube-api-access-hc5d8\") pod \"downloads-68c9cbb497-r6hp4\" (UID: \"859b2b61-1446-4a6f-8942-db25062c1339\") " pod="openshift-console/downloads-68c9cbb497-r6hp4" Jul 16 16:40:32.671287 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.671262 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" Jul 16 16:40:32.715346 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.715191 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:32.723982 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.723927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" Jul 16 16:40:32.730159 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.729007 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-r6hp4" Jul 16 16:40:32.763371 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:32.763339 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5ae5ec_98db_4f79_9156_c4a4116e60ea.slice/crio-4f84847f874385fe97292128f948ea3c6b11f04298ee7fe75823556f51849a88 WatchSource:0}: Error finding container 4f84847f874385fe97292128f948ea3c6b11f04298ee7fe75823556f51849a88: Status 404 returned error can't find the container with id 4f84847f874385fe97292128f948ea3c6b11f04298ee7fe75823556f51849a88 Jul 16 16:40:32.764857 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.764821 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dc2hv"] Jul 16 16:40:32.837776 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:32.837736 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf435ffa7_b98a_4303_a32b_fc9fc024dfd6.slice/crio-6df1c055c7fd6d8e45f40c3fb7a20f70c616f73e7e48500410b3576f4a103036 WatchSource:0}: Error finding container 6df1c055c7fd6d8e45f40c3fb7a20f70c616f73e7e48500410b3576f4a103036: Status 404 returned error can't find the container with id 6df1c055c7fd6d8e45f40c3fb7a20f70c616f73e7e48500410b3576f4a103036 Jul 16 16:40:32.841929 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.841901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:32.844169 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.844150 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4861afaa-f679-4248-b832-c32809715310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lf5gl\" (UID: \"4861afaa-f679-4248-b832-c32809715310\") " pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:32.845175 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.845152 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz"] Jul 16 16:40:32.880027 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.880003 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7"] Jul 16 16:40:32.882831 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:32.882806 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba653f21_6817_4674_a9ef_1f9674ad95bd.slice/crio-8316ae0782e1803b80017c627c21f401dca8eebf5eba2ec1ee7fa3a8d3a2980a WatchSource:0}: Error finding container 8316ae0782e1803b80017c627c21f401dca8eebf5eba2ec1ee7fa3a8d3a2980a: Status 404 returned error can't find the container with id 8316ae0782e1803b80017c627c21f401dca8eebf5eba2ec1ee7fa3a8d3a2980a Jul 16 16:40:32.883727 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.883709 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lf5gl" Jul 16 16:40:32.890574 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:32.890553 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-r6hp4"] Jul 16 16:40:32.892477 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:32.892457 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859b2b61_1446_4a6f_8942_db25062c1339.slice/crio-cdb9350549c0cd6932fdeeed387700e44ea37dd09a79e83d8153d4acb7652232 WatchSource:0}: Error finding container cdb9350549c0cd6932fdeeed387700e44ea37dd09a79e83d8153d4acb7652232: Status 404 returned error can't find the container with id cdb9350549c0cd6932fdeeed387700e44ea37dd09a79e83d8153d4acb7652232 Jul 16 16:40:33.021403 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:33.021247 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lf5gl"] Jul 16 16:40:33.023723 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:33.023696 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4861afaa_f679_4248_b832_c32809715310.slice/crio-e5267debe0d337dad6b72a6d7d4d6277b1beded40f4a1f4202c61e209a3e5370 WatchSource:0}: Error finding container e5267debe0d337dad6b72a6d7d4d6277b1beded40f4a1f4202c61e209a3e5370: Status 404 returned error can't find the container with id e5267debe0d337dad6b72a6d7d4d6277b1beded40f4a1f4202c61e209a3e5370 Jul 16 16:40:33.126539 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:33.126498 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" event={"ID":"f435ffa7-b98a-4303-a32b-fc9fc024dfd6","Type":"ContainerStarted","Data":"6df1c055c7fd6d8e45f40c3fb7a20f70c616f73e7e48500410b3576f4a103036"} Jul 16 16:40:33.127489 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:33.127466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-r6hp4" event={"ID":"859b2b61-1446-4a6f-8942-db25062c1339","Type":"ContainerStarted","Data":"cdb9350549c0cd6932fdeeed387700e44ea37dd09a79e83d8153d4acb7652232"} Jul 16 16:40:33.128444 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:33.128424 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" event={"ID":"ba653f21-6817-4674-a9ef-1f9674ad95bd","Type":"ContainerStarted","Data":"8316ae0782e1803b80017c627c21f401dca8eebf5eba2ec1ee7fa3a8d3a2980a"} Jul 16 16:40:33.129439 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:33.129419 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf5gl" event={"ID":"4861afaa-f679-4248-b832-c32809715310","Type":"ContainerStarted","Data":"e5267debe0d337dad6b72a6d7d4d6277b1beded40f4a1f4202c61e209a3e5370"} Jul 16 16:40:33.130398 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:33.130352 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" event={"ID":"3d5ae5ec-98db-4f79-9156-c4a4116e60ea","Type":"ContainerStarted","Data":"4f84847f874385fe97292128f948ea3c6b11f04298ee7fe75823556f51849a88"} Jul 16 16:40:34.256455 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.255900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:40:34.267163 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.267117 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"image-registry-54cc8dd856-prsmp\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:40:34.356689 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.356649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:40:34.368199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.368145 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86df681-3549-4fab-90e5-1316361b3e37-metrics-tls\") pod \"dns-default-z6x6r\" (UID: \"c86df681-3549-4fab-90e5-1316361b3e37\") " pod="openshift-dns/dns-default-z6x6r" Jul 16 16:40:34.402988 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.402769 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-twq28\"" Jul 16 16:40:34.410135 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.409895 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:40:34.417845 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.417673 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hghq8\"" Jul 16 16:40:34.424821 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:34.424626 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6x6r" Jul 16 16:40:35.308082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:35.307073 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cc8dd856-prsmp"] Jul 16 16:40:35.322724 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:35.322658 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6x6r"] Jul 16 16:40:36.327007 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.326972 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc7568fb6-kdxrq"] Jul 16 16:40:36.331380 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.330200 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.333916 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.333770 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 16:40:36.335015 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.334994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6bkcd\"" Jul 16 16:40:36.335139 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.335078 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 16:40:36.335299 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.335269 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 16:40:36.335408 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.335310 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 16:40:36.335463 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.335421 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 16:40:36.344838 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.344809 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc7568fb6-kdxrq"] Jul 16 16:40:36.348119 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.348095 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 16:40:36.475923 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.475796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrw6\" (UniqueName: \"kubernetes.io/projected/9516e011-af6a-457f-84c2-ce9465bc5f39-kube-api-access-2jrw6\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.475923 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.475846 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-oauth-serving-cert\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.475923 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.475878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-trusted-ca-bundle\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.476189 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.475976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-service-ca\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.476189 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.476017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-console-config\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.476189 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.476068 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-oauth-config\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.476189 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.476160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-serving-cert\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.503981 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:36.503943 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65acb107_ee0c_43eb_b42f_c58751e36dd9.slice/crio-f392df8e25f730bc06a02322a95d181814371408094b98b3d4a2b74a32a7e929 WatchSource:0}: Error finding container f392df8e25f730bc06a02322a95d181814371408094b98b3d4a2b74a32a7e929: Status 404 returned error can't find the container with id f392df8e25f730bc06a02322a95d181814371408094b98b3d4a2b74a32a7e929 Jul 16 16:40:36.505022 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:36.504387 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86df681_3549_4fab_90e5_1316361b3e37.slice/crio-c2ca1ee8cf3518e8da6e7345176e650b420b1a16b5c617cdff1271b48ae88e2c WatchSource:0}: Error finding container c2ca1ee8cf3518e8da6e7345176e650b420b1a16b5c617cdff1271b48ae88e2c: Status 404 returned error can't find the container with id c2ca1ee8cf3518e8da6e7345176e650b420b1a16b5c617cdff1271b48ae88e2c Jul 16 16:40:36.576943 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.576904 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-service-ca\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.577135 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.576945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-console-config\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.577135 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.577004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-oauth-config\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.577135 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.577042 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-serving-cert\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.577135 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.577073 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrw6\" (UniqueName: \"kubernetes.io/projected/9516e011-af6a-457f-84c2-ce9465bc5f39-kube-api-access-2jrw6\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.577135 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.577097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-oauth-serving-cert\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.577135 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.577122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-trusted-ca-bundle\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.577808 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.577760 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-service-ca\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.578019 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.577998 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-console-config\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.578117 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.578094 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-oauth-serving-cert\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.578175 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.578140 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-trusted-ca-bundle\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.579931 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.579867 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-serving-cert\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.580325 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.580285 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-oauth-config\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.587344 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.587302 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrw6\" (UniqueName: \"kubernetes.io/projected/9516e011-af6a-457f-84c2-ce9465bc5f39-kube-api-access-2jrw6\") pod \"console-6fc7568fb6-kdxrq\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.645487 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.645440 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:36.712254 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.712224 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:36.815893 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:36.815841 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:37.152180 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:37.152143 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" event={"ID":"65acb107-ee0c-43eb-b42f-c58751e36dd9","Type":"ContainerStarted","Data":"f392df8e25f730bc06a02322a95d181814371408094b98b3d4a2b74a32a7e929"} Jul 16 16:40:37.153469 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:37.153405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6x6r" event={"ID":"c86df681-3549-4fab-90e5-1316361b3e37","Type":"ContainerStarted","Data":"c2ca1ee8cf3518e8da6e7345176e650b420b1a16b5c617cdff1271b48ae88e2c"} Jul 16 16:40:38.467526 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:38.467478 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:38.545314 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:38.545283 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:39.060176 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:39.059618 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qlfdh" Jul 16 16:40:39.731872 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:39.731840 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc7568fb6-kdxrq"] Jul 16 16:40:40.167303 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.167258 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" event={"ID":"f435ffa7-b98a-4303-a32b-fc9fc024dfd6","Type":"ContainerStarted","Data":"2b5388ccbe2d39db95c847ce77bf939055340f28f42966934a25c4da57a8c00b"} Jul 16 16:40:40.169222 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.169157 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" event={"ID":"65acb107-ee0c-43eb-b42f-c58751e36dd9","Type":"ContainerStarted","Data":"e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae"} Jul 16 16:40:40.169365 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.169242 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:40:40.170927 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.170893 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" event={"ID":"ba653f21-6817-4674-a9ef-1f9674ad95bd","Type":"ContainerStarted","Data":"1516d00fc558deecb3f92cd00f26cfeeb6057ac71ac5e52cb86eedbd342faa7f"} Jul 16 16:40:40.171631 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.171411 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" Jul 16 16:40:40.173100 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.173081 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" event={"ID":"3d5ae5ec-98db-4f79-9156-c4a4116e60ea","Type":"ContainerStarted","Data":"c810e304f76ca0db6ffd03ca7bb96b1d11c49eef40f528f0ce0f23c3ad410aba"} Jul 16 16:40:40.177172 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.177132 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" Jul 16 16:40:40.186438 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.186305 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64ddbf64cd-stfpz" podStartSLOduration=1.9081296189999999 podStartE2EDuration="8.18629303s" totalImagesPullingTime="6.278163411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:40.184671895 +0000 UTC m=+103.060899650" watchObservedRunningTime="2026-07-16 16:40:40.18629303 +0000 UTC m=+103.062520772" Jul 16 16:40:40.208956 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.208908 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" podStartSLOduration=107.208890509 podStartE2EDuration="1m47.208890509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:40.207717694 +0000 UTC m=+103.083945458" watchObservedRunningTime="2026-07-16 16:40:40.208890509 +0000 UTC m=+103.085118252" Jul 16 16:40:40.225560 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.225487 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-dc2hv" podStartSLOduration=5.842379135 podStartE2EDuration="8.225470471s" totalImagesPullingTime="2.383091336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:40.224993627 +0000 UTC m=+103.101221371" watchObservedRunningTime="2026-07-16 16:40:40.225470471 +0000 UTC m=+103.101698217" Jul 16 16:40:40.247831 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.247778 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-cggs7" podStartSLOduration=5.984132542 podStartE2EDuration="8.247759776s" totalImagesPullingTime="2.263627234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:40.247273513 +0000 UTC m=+103.123501268" watchObservedRunningTime="2026-07-16 16:40:40.247759776 +0000 UTC m=+103.123987520" Jul 16 16:40:40.321176 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:40.321145 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9516e011_af6a_457f_84c2_ce9465bc5f39.slice/crio-fcbb1802a3c43d9b50c5fc3457d6cfee2f8ee3bc1892e5a08a97a94db27e8db4 WatchSource:0}: Error finding container fcbb1802a3c43d9b50c5fc3457d6cfee2f8ee3bc1892e5a08a97a94db27e8db4: Status 404 returned error can't find the container with id fcbb1802a3c43d9b50c5fc3457d6cfee2f8ee3bc1892e5a08a97a94db27e8db4 Jul 16 16:40:40.338939 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.338915 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:40.402657 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.402628 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:40.660462 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.660431 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:40.727075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:40.727048 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:41.184947 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.184855 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf5gl" event={"ID":"4861afaa-f679-4248-b832-c32809715310","Type":"ContainerStarted","Data":"0f8ee6c3d3700f9130c4afdbff36c363a98524e0d0ed2c19cada49a42ab4a1d4"} Jul 16 16:40:41.188664 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.188636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6x6r" event={"ID":"c86df681-3549-4fab-90e5-1316361b3e37","Type":"ContainerStarted","Data":"717d8a98c0fbf2d7d609bb30c39f34c1fb27751d3397e1192e08ccc30d7a1530"} Jul 16 16:40:41.188771 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.188686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6x6r" event={"ID":"c86df681-3549-4fab-90e5-1316361b3e37","Type":"ContainerStarted","Data":"b84b84fd348676cf93b4e45a3f0a2f2ff7fbe0f6d7f907421567808bdca9e111"} Jul 16 16:40:41.189446 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.189404 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z6x6r" Jul 16 16:40:41.193204 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.192098 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc7568fb6-kdxrq" event={"ID":"9516e011-af6a-457f-84c2-ce9465bc5f39","Type":"ContainerStarted","Data":"fcbb1802a3c43d9b50c5fc3457d6cfee2f8ee3bc1892e5a08a97a94db27e8db4"} Jul 16 16:40:41.224556 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.223176 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z6x6r" podStartSLOduration=67.082915218 podStartE2EDuration="1m11.223158538s" totalImagesPullingTime="4.14024332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:41.22266036 +0000 UTC m=+104.098888129" watchObservedRunningTime="2026-07-16 16:40:41.223158538 +0000 UTC m=+104.099386263" Jul 16 16:40:41.574712 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.574591 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:41.676122 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:41.676079 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:42.123726 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:42.123625 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:43.392699 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:43.392658 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:43.462785 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:43.462750 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:44.546767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:44.546690 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:44.645858 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:44.645812 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:45.148218 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:45.148182 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:45.209070 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:45.209029 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:46.223183 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:46.223152 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:48.811322 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:48.811280 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.039186 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.039116 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.099917 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.099854 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2ttqw"] Jul 16 16:40:49.102319 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.102236 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.105214 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.105192 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 16:40:49.108693 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.108669 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 16:40:49.108830 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.108806 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 16:40:49.109946 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.109742 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 16:40:49.109946 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.109861 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dbtz7\"" Jul 16 16:40:49.109946 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.109867 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 16:40:49.109946 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.109945 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 16:40:49.123805 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.123743 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2ttqw"] Jul 16 16:40:49.126343 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.126324 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z7znj"] Jul 16 16:40:49.128360 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.128331 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.131458 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.131421 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 16:40:49.131670 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.131650 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mwmff\"" Jul 16 16:40:49.132052 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.132035 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 16:40:49.132382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.132368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 16:40:49.145438 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.145403 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.188773 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlbtd\" (UniqueName: \"kubernetes.io/projected/7f8bf7da-b0ec-414f-a0b1-70b240300874-kube-api-access-rlbtd\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.188884 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-textfile\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.188884 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-tls\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.188884 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.188884 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-wtmp\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.189075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188891 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/71fb56ce-3e40-446c-ae99-f336291413bd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.189075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-root\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.189075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-sys\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.189075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.189075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.188994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.189075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.189033 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.189075 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.189056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km5zb\" (UniqueName: \"kubernetes.io/projected/71fb56ce-3e40-446c-ae99-f336291413bd-kube-api-access-km5zb\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.189404 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.189078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f8bf7da-b0ec-414f-a0b1-70b240300874-metrics-client-ca\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.189404 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.189113 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-accelerators-collector-config\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.189404 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.189164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71fb56ce-3e40-446c-ae99-f336291413bd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.252221 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.252165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.290593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71fb56ce-3e40-446c-ae99-f336291413bd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.290593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlbtd\" (UniqueName: \"kubernetes.io/projected/7f8bf7da-b0ec-414f-a0b1-70b240300874-kube-api-access-rlbtd\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290299 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-textfile\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-tls\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.290593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-wtmp\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290491 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-wtmp\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/71fb56ce-3e40-446c-ae99-f336291413bd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-root\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-sys\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290706 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km5zb\" (UniqueName: \"kubernetes.io/projected/71fb56ce-3e40-446c-ae99-f336291413bd-kube-api-access-km5zb\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f8bf7da-b0ec-414f-a0b1-70b240300874-metrics-client-ca\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290861 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-accelerators-collector-config\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.290969 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.290950 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71fb56ce-3e40-446c-ae99-f336291413bd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.291425 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.291028 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-textfile\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.291425 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.291079 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-sys\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.291425 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.291116 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7f8bf7da-b0ec-414f-a0b1-70b240300874-root\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.291425 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:49.291183 2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 16 16:40:49.291425 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:49.291246 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-tls podName:71fb56ce-3e40-446c-ae99-f336291413bd nodeName:}" failed. No retries permitted until 2026-07-16 16:40:49.791227628 +0000 UTC m=+112.667455366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-2ttqw" (UID: "71fb56ce-3e40-446c-ae99-f336291413bd") : secret "kube-state-metrics-tls" not found Jul 16 16:40:49.291678 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.291469 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-accelerators-collector-config\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.291867 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.291826 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f8bf7da-b0ec-414f-a0b1-70b240300874-metrics-client-ca\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.291970 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.291938 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/71fb56ce-3e40-446c-ae99-f336291413bd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.292383 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.292328 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.293237 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.293196 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-tls\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.293827 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.293798 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f8bf7da-b0ec-414f-a0b1-70b240300874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.295321 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.295299 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.302895 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.302873 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km5zb\" (UniqueName: \"kubernetes.io/projected/71fb56ce-3e40-446c-ae99-f336291413bd-kube-api-access-km5zb\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.304556 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.304534 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlbtd\" (UniqueName: \"kubernetes.io/projected/7f8bf7da-b0ec-414f-a0b1-70b240300874-kube-api-access-rlbtd\") pod \"node-exporter-z7znj\" (UID: \"7f8bf7da-b0ec-414f-a0b1-70b240300874\") " pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.351908 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.351842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.439203 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.439178 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z7znj" Jul 16 16:40:49.454032 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.454012 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.554710 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.554671 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.711177 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.711148 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.795561 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.795535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.798199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.798174 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71fb56ce-3e40-446c-ae99-f336291413bd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2ttqw\" (UID: \"71fb56ce-3e40-446c-ae99-f336291413bd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:49.804356 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.804323 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:49.905628 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:49.905602 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:50.006353 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.006278 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:50.015106 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.015081 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" Jul 16 16:40:50.100064 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.100028 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:50.106847 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.106826 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:40:50.109325 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.109305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.112563 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.112573 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.112623 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.112580 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.112869 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.112899 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.112933 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r2xlz\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.113034 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 16:40:50.113170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.113040 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 16:40:50.113570 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.113259 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 16:40:50.126835 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.126807 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:40:50.199671 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199794 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-web-config\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199794 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-out\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199794 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199794 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199996 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199996 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199846 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199996 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199874 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199996 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.199996 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199981 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.200259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.199999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.200259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.200023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.200259 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.200081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w254x\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-kube-api-access-w254x\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.300842 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w254x\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-kube-api-access-w254x\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.300975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.300975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-web-config\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.300975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-out\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.300975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300936 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.300975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300953 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.300975 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300975 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.301157 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.300990 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.301157 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.301008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.301157 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.301042 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.301157 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.301079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.301157 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.301099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.301157 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.301114 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.301391 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:50.301215 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle podName:9fa4e7ec-54e3-45b9-a2ef-59e33f704941 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:50.801201061 +0000 UTC m=+113.677428782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941") : configmap references non-existent config key: ca-bundle.crt Jul 16 16:40:50.301712 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:50.301576 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 16 16:40:50.301712 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:50.301650 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls podName:9fa4e7ec-54e3-45b9-a2ef-59e33f704941 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:50.801630602 +0000 UTC m=+113.677858342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941") : secret "alertmanager-main-tls" not found Jul 16 16:40:50.302213 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.302192 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.302427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.302404 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.305240 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.304966 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-out\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.305240 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.305117 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.305240 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.305199 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-web-config\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.305240 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.305229 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.305537 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.305316 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.306726 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.306708 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.306808 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.306723 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.306862 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.306832 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.314382 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.314361 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w254x\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-kube-api-access-w254x\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.596314 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.596236 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:50.805144 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.805108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.805324 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.805198 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.805967 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.805941 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:50.807849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:50.807819 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:51.021350 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:51.021320 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:40:52.057357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:52.057316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:52.157737 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:52.157701 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:52.202308 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:52.202272 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z6x6r" Jul 16 16:40:52.260647 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:52.260605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:52.512897 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:52.512861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:53.312313 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:53.312286 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8bf7da_b0ec_414f_a0b1_70b240300874.slice/crio-d7b2a07c867c190b8e12b4cb287f7dc74c7f13803792541e4a5900d9814d8706 WatchSource:0}: Error finding container d7b2a07c867c190b8e12b4cb287f7dc74c7f13803792541e4a5900d9814d8706: Status 404 returned error can't find the container with id d7b2a07c867c190b8e12b4cb287f7dc74c7f13803792541e4a5900d9814d8706 Jul 16 16:40:53.438762 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.438710 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d699f5d5f-m4nmb"] Jul 16 16:40:53.441608 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.441589 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.444847 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.444786 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 16:40:53.449114 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.447819 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 16:40:53.449114 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.448412 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c4776\"" Jul 16 16:40:53.449114 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.448646 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 16:40:53.449114 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.448889 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fdrnf41t904dd\"" Jul 16 16:40:53.449488 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.449151 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 16:40:53.458746 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.458702 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d699f5d5f-m4nmb"] Jul 16 16:40:53.484393 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.484332 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:40:53.487556 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:53.487531 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa4e7ec_54e3_45b9_a2ef_59e33f704941.slice/crio-b50982aa030fefa08e9efc3b517fab52701057e90f674c2951534e68bc7d4610 WatchSource:0}: Error finding container b50982aa030fefa08e9efc3b517fab52701057e90f674c2951534e68bc7d4610: Status 404 returned error can't find the container with id b50982aa030fefa08e9efc3b517fab52701057e90f674c2951534e68bc7d4610 Jul 16 16:40:53.492942 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.492922 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2ttqw"] Jul 16 16:40:53.495649 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:53.495626 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fb56ce_3e40_446c_ae99_f336291413bd.slice/crio-5a297eabc33b1f91e2209ba5f5e953790c649ea6cb75245d6bf71356f338a46b WatchSource:0}: Error finding container 5a297eabc33b1f91e2209ba5f5e953790c649ea6cb75245d6bf71356f338a46b: Status 404 returned error can't find the container with id 5a297eabc33b1f91e2209ba5f5e953790c649ea6cb75245d6bf71356f338a46b Jul 16 16:40:53.529014 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.528985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.529116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.529042 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-metrics-server-audit-profiles\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.529116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.529078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-secret-metrics-server-client-certs\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.529116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.529096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k67nz\" (UniqueName: \"kubernetes.io/projected/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-kube-api-access-k67nz\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.529240 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.529179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-secret-metrics-server-tls\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.529240 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.529209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-audit-log\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.529240 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.529235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-client-ca-bundle\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.630306 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.630272 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-client-ca-bundle\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.630480 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.630350 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.630480 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.630401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-metrics-server-audit-profiles\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.630480 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.630435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-secret-metrics-server-client-certs\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.630480 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.630457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k67nz\" (UniqueName: \"kubernetes.io/projected/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-kube-api-access-k67nz\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.630739 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.630718 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-secret-metrics-server-tls\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.630815 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.630788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-audit-log\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.631168 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.631122 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-audit-log\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.631580 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.631555 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.631710 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.631625 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-metrics-server-audit-profiles\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.632758 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.632724 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-secret-metrics-server-client-certs\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.633350 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.633332 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-client-ca-bundle\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.633691 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.633670 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-secret-metrics-server-tls\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.640666 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.640648 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k67nz\" (UniqueName: \"kubernetes.io/projected/9e1ea8b5-fae2-4abf-9c52-826c0c506d63-kube-api-access-k67nz\") pod \"metrics-server-d699f5d5f-m4nmb\" (UID: \"9e1ea8b5-fae2-4abf-9c52-826c0c506d63\") " pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.752467 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.752441 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:40:53.942691 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.942558 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:53.980733 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:53.980693 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1ea8b5_fae2_4abf_9c52_826c0c506d63.slice/crio-5f649d9481db2534d081c9f9d5f5aac7db35a57b8b5bf01ed3d7c8d0b34fa076 WatchSource:0}: Error finding container 5f649d9481db2534d081c9f9d5f5aac7db35a57b8b5bf01ed3d7c8d0b34fa076: Status 404 returned error can't find the container with id 5f649d9481db2534d081c9f9d5f5aac7db35a57b8b5bf01ed3d7c8d0b34fa076 Jul 16 16:40:53.983042 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:53.982952 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d699f5d5f-m4nmb"] Jul 16 16:40:54.070762 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.070675 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc7568fb6-kdxrq"] Jul 16 16:40:54.086234 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.086166 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:54.152679 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.151371 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l"] Jul 16 16:40:54.157276 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.156716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:54.181771 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.181562 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 16:40:54.181771 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.181666 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2pr8d\"" Jul 16 16:40:54.192676 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.191399 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd49f68c6-rt29n"] Jul 16 16:40:54.195422 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.195372 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.201224 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.200964 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l"] Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.235985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-oauth-config\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z895p\" (UniqueName: \"kubernetes.io/projected/e8ff50bc-d8f8-451c-a864-082461a0348f-kube-api-access-z895p\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-oauth-serving-cert\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-service-ca\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7m2f\" (UniqueName: \"kubernetes.io/projected/f46102dc-30e6-4084-acc3-528d228025c1-kube-api-access-r7m2f\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-serving-cert\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-console-config\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.237202 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.236356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-trusted-ca-bundle\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.248418 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.248391 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf5gl" event={"ID":"4861afaa-f679-4248-b832-c32809715310","Type":"ContainerStarted","Data":"62c395ef3d3928480af075f97ee27aa22db44afbe033866acb2c6517441e1a0c"} Jul 16 16:40:54.252867 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.252843 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" event={"ID":"9e1ea8b5-fae2-4abf-9c52-826c0c506d63","Type":"ContainerStarted","Data":"5f649d9481db2534d081c9f9d5f5aac7db35a57b8b5bf01ed3d7c8d0b34fa076"} Jul 16 16:40:54.256302 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.256278 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc7568fb6-kdxrq" event={"ID":"9516e011-af6a-457f-84c2-ce9465bc5f39","Type":"ContainerStarted","Data":"b28740d49d5bab905b0a0c56219edab726495dfb2f9bc60b4a9d74da6666452d"} Jul 16 16:40:54.259390 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.259211 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" event={"ID":"71fb56ce-3e40-446c-ae99-f336291413bd","Type":"ContainerStarted","Data":"5a297eabc33b1f91e2209ba5f5e953790c649ea6cb75245d6bf71356f338a46b"} Jul 16 16:40:54.262876 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.262617 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-r6hp4" event={"ID":"859b2b61-1446-4a6f-8942-db25062c1339","Type":"ContainerStarted","Data":"83eb86acbd83fd84d6db44d76c5438c72c84ddd1cd00e08b390b1933e13c2f6c"} Jul 16 16:40:54.264696 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.264650 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-r6hp4" Jul 16 16:40:54.269245 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.269224 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7znj" event={"ID":"7f8bf7da-b0ec-414f-a0b1-70b240300874","Type":"ContainerStarted","Data":"d7b2a07c867c190b8e12b4cb287f7dc74c7f13803792541e4a5900d9814d8706"} Jul 16 16:40:54.270082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.270063 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd49f68c6-rt29n"] Jul 16 16:40:54.273188 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.273124 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-r6hp4" Jul 16 16:40:54.276687 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.276602 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerStarted","Data":"b50982aa030fefa08e9efc3b517fab52701057e90f674c2951534e68bc7d4610"} Jul 16 16:40:54.336847 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.336813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z895p\" (UniqueName: \"kubernetes.io/projected/e8ff50bc-d8f8-451c-a864-082461a0348f-kube-api-access-z895p\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.336857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.336915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-oauth-serving-cert\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.336942 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-service-ca\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.336965 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7m2f\" (UniqueName: \"kubernetes.io/projected/f46102dc-30e6-4084-acc3-528d228025c1-kube-api-access-r7m2f\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.336991 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-serving-cert\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.337026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-console-config\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.337184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-trusted-ca-bundle\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.337307 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.337220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-oauth-config\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.338522 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.338482 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-console-config\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.339138 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.339112 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-oauth-serving-cert\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.339260 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:54.339208 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 16 16:40:54.339260 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:54.339261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert podName:f46102dc-30e6-4084-acc3-528d228025c1 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:54.83924438 +0000 UTC m=+117.715472106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-kwc2l" (UID: "f46102dc-30e6-4084-acc3-528d228025c1") : secret "monitoring-plugin-cert" not found Jul 16 16:40:54.339538 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.339496 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-service-ca\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.339958 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.339935 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-trusted-ca-bundle\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.343675 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.343649 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-oauth-config\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.344374 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.344355 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-serving-cert\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.346891 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.346849 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-r6hp4" podStartSLOduration=1.91237883 podStartE2EDuration="22.346832052s" totalImagesPullingTime="20.434453222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:54.345162298 +0000 UTC m=+117.221390061" watchObservedRunningTime="2026-07-16 16:40:54.346832052 +0000 UTC m=+117.223059796" Jul 16 16:40:54.381365 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.378626 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z895p\" (UniqueName: \"kubernetes.io/projected/e8ff50bc-d8f8-451c-a864-082461a0348f-kube-api-access-z895p\") pod \"console-7bd49f68c6-rt29n\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.382136 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.382111 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7m2f\" (UniqueName: \"kubernetes.io/projected/f46102dc-30e6-4084-acc3-528d228025c1-kube-api-access-r7m2f\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:54.512227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.511927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:40:54.665772 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.665706 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:54.843873 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.843265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:54.843873 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:54.843415 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 16 16:40:54.843873 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:40:54.843479 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert podName:f46102dc-30e6-4084-acc3-528d228025c1 nodeName:}" failed. No retries permitted until 2026-07-16 16:40:55.843458884 +0000 UTC m=+118.719686613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-kwc2l" (UID: "f46102dc-30e6-4084-acc3-528d228025c1") : secret "monitoring-plugin-cert" not found Jul 16 16:40:54.883428 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.883133 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fc7568fb6-kdxrq" podStartSLOduration=5.899592109 podStartE2EDuration="18.883109335s" totalImagesPullingTime="12.983517226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:40:54.396176347 +0000 UTC m=+117.272404089" watchObservedRunningTime="2026-07-16 16:40:54.883109335 +0000 UTC m=+117.759337079" Jul 16 16:40:54.886050 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.885108 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cc8dd856-prsmp"] Jul 16 16:40:54.893859 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.893812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:40:54.998726 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:54.998647 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:55.064840 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.064757 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:55.198952 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.198833 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd49f68c6-rt29n"] Jul 16 16:40:55.202443 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:40:55.202413 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ff50bc_d8f8_451c_a864_082461a0348f.slice/crio-8dd69923c634f96e69efd5c8afc61ac4923ba42419b9589284b85bd587d18135 WatchSource:0}: Error finding container 8dd69923c634f96e69efd5c8afc61ac4923ba42419b9589284b85bd587d18135: Status 404 returned error can't find the container with id 8dd69923c634f96e69efd5c8afc61ac4923ba42419b9589284b85bd587d18135 Jul 16 16:40:55.202945 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.202861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:55.283833 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.283357 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd49f68c6-rt29n" event={"ID":"e8ff50bc-d8f8-451c-a864-082461a0348f","Type":"ContainerStarted","Data":"8dd69923c634f96e69efd5c8afc61ac4923ba42419b9589284b85bd587d18135"} Jul 16 16:40:55.369123 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.369054 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:55.372244 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.370661 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:40:55.404712 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.404685 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:40:55.404831 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.404820 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.408982 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.408276 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 16:40:55.408982 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.408737 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 16:40:55.409767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.409381 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 16:40:55.409767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.409416 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 16:40:55.409767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.409485 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 16:40:55.409767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.409656 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h9lrs\"" Jul 16 16:40:55.409767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.409657 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 16:40:55.410699 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.410677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-drp80lo30v30u\"" Jul 16 16:40:55.411644 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.411627 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 16:40:55.412552 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.412527 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 16:40:55.412811 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.412795 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 16:40:55.413703 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.413031 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 16:40:55.413802 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.413732 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 16:40:55.414570 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.413932 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 16:40:55.414831 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.414808 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 16:40:55.417955 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.417933 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 16:40:55.449862 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.449735 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.449862 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.449777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.449862 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.449806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.449868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.449914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.449967 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-config\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.449992 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450032 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450082 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdpt\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-kube-api-access-qxdpt\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450335 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450651 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450651 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450651 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450651 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.450651 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.450465 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551049 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551213 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551213 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551213 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551213 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551180 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551213 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551204 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551370 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-config\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551476 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551888 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551888 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdpt\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-kube-api-access-qxdpt\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551888 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551888 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551888 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.551888 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.551632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.552390 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.552364 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.559856 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.553672 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.559856 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.557235 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.559856 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.558347 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.559856 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.559496 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.562212 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.560545 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.562212 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.561366 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.562212 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.561932 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.562212 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.561978 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-config\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.575596 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.574739 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.575596 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.574776 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.575596 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.575168 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.575596 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.575408 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.575596 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.575561 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.576420 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.576326 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.579280 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.579203 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdpt\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-kube-api-access-qxdpt\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.581373 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.581319 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.582381 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.581942 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.582381 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.582294 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.583399 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.583360 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.720537 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.720471 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:40:55.855149 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.855038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:55.865750 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.865694 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f46102dc-30e6-4084-acc3-528d228025c1-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kwc2l\" (UID: \"f46102dc-30e6-4084-acc3-528d228025c1\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:55.975483 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:55.975246 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:40:56.052274 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:56.052211 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:56.119347 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:56.119286 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:56.552936 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:56.552896 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:56.645764 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:56.645732 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:40:56.651918 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:56.651885 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:40:59.647567 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:40:59.647535 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd49f68c6-rt29n"] Jul 16 16:41:00.182717 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.182425 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:41:00.214302 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.214222 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l"] Jul 16 16:41:00.218899 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:41:00.218846 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46102dc_30e6_4084_acc3_528d228025c1.slice/crio-30503e8f8e5000f043b83a2d6858bc96093de599a3ca1fb3af67d6163c5d949a WatchSource:0}: Error finding container 30503e8f8e5000f043b83a2d6858bc96093de599a3ca1fb3af67d6163c5d949a: Status 404 returned error can't find the container with id 30503e8f8e5000f043b83a2d6858bc96093de599a3ca1fb3af67d6163c5d949a Jul 16 16:41:00.310072 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.309334 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7znj" event={"ID":"7f8bf7da-b0ec-414f-a0b1-70b240300874","Type":"ContainerStarted","Data":"32a126d94950df81ca1bf7f5091687d875320d48710e9fe4435c205c1f624d09"} Jul 16 16:41:00.316384 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.315437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" event={"ID":"9e1ea8b5-fae2-4abf-9c52-826c0c506d63","Type":"ContainerStarted","Data":"ebc4fe73f8fc9f00ea092efeb861ced7ef049717e86056fd06295ead44679837"} Jul 16 16:41:00.318740 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.318318 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd49f68c6-rt29n" event={"ID":"e8ff50bc-d8f8-451c-a864-082461a0348f","Type":"ContainerStarted","Data":"6fbf51140e8805ed8583934ab51c2e7c31431b55bcf07be3e38a0370693e2514"} Jul 16 16:41:00.322444 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.322354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" event={"ID":"71fb56ce-3e40-446c-ae99-f336291413bd","Type":"ContainerStarted","Data":"6ef11773acd47fa7ba16e619fb12c801b5b22e036631a0cbd817f8bbd6713d78"} Jul 16 16:41:00.326624 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.325428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerStarted","Data":"ed7d5b9ffd42e0a508384b297d593ff84cd47d88ea89ccad8d81ccde506615de"} Jul 16 16:41:00.328527 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.327282 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerID="a334ff4981d61c343ff9f45ba3a9d44b09c8689892c47f6ba9c4a40ecc727e5c" exitCode=0 Jul 16 16:41:00.328527 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.327373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"a334ff4981d61c343ff9f45ba3a9d44b09c8689892c47f6ba9c4a40ecc727e5c"} Jul 16 16:41:00.339982 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.339953 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lf5gl" event={"ID":"4861afaa-f679-4248-b832-c32809715310","Type":"ContainerStarted","Data":"3868197fd9089050b445584967ce681291a8a9952928615f8d14dee4192fa8da"} Jul 16 16:41:00.341870 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.341850 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" event={"ID":"f46102dc-30e6-4084-acc3-528d228025c1","Type":"ContainerStarted","Data":"30503e8f8e5000f043b83a2d6858bc96093de599a3ca1fb3af67d6163c5d949a"} Jul 16 16:41:00.400953 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.400898 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd49f68c6-rt29n" podStartSLOduration=6.400876701 podStartE2EDuration="6.400876701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:00.399297968 +0000 UTC m=+123.275525712" watchObservedRunningTime="2026-07-16 16:41:00.400876701 +0000 UTC m=+123.277104427" Jul 16 16:41:00.449450 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:00.448836 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" podStartSLOduration=1.433989586 podStartE2EDuration="7.448814413s" totalImagesPullingTime="6.014824827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:00.424259565 +0000 UTC m=+123.300487309" watchObservedRunningTime="2026-07-16 16:41:00.448814413 +0000 UTC m=+123.325042157" Jul 16 16:41:01.351780 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.351744 2566 generic.go:356] "Generic (PLEG): container finished" podID="7f8bf7da-b0ec-414f-a0b1-70b240300874" containerID="32a126d94950df81ca1bf7f5091687d875320d48710e9fe4435c205c1f624d09" exitCode=0 Jul 16 16:41:01.352195 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.351930 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7znj" event={"ID":"7f8bf7da-b0ec-414f-a0b1-70b240300874","Type":"ContainerDied","Data":"32a126d94950df81ca1bf7f5091687d875320d48710e9fe4435c205c1f624d09"} Jul 16 16:41:01.356692 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.356663 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" event={"ID":"71fb56ce-3e40-446c-ae99-f336291413bd","Type":"ContainerStarted","Data":"36df65b59ebcac1c28d7185c1afb56a2eeb6e6072ca14a45b5440ad3c37f8207"} Jul 16 16:41:01.356820 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.356722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" event={"ID":"71fb56ce-3e40-446c-ae99-f336291413bd","Type":"ContainerStarted","Data":"5e8f91c3a0b895731b76a24a513dbdf624099413732d6cc406ede3b21bfd4cb6"} Jul 16 16:41:01.359409 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.359385 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" exitCode=0 Jul 16 16:41:01.359966 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.359935 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63"} Jul 16 16:41:01.374910 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.374871 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lf5gl" podStartSLOduration=33.552692964 podStartE2EDuration="1m0.374857495s" totalImagesPullingTime="26.822164531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:40:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:00.449436101 +0000 UTC m=+123.325663844" watchObservedRunningTime="2026-07-16 16:41:01.374857495 +0000 UTC m=+124.251085216" Jul 16 16:41:01.398917 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.398873 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-2ttqw" podStartSLOduration=5.895351586 podStartE2EDuration="12.398860831s" totalImagesPullingTime="6.503509245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:01.396686647 +0000 UTC m=+124.272914413" watchObservedRunningTime="2026-07-16 16:41:01.398860831 +0000 UTC m=+124.275088573" Jul 16 16:41:01.517242 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.517159 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:01.617148 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:01.617075 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:02.365778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:02.365710 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7znj" event={"ID":"7f8bf7da-b0ec-414f-a0b1-70b240300874","Type":"ContainerStarted","Data":"05dc1f87f8cd9f2fbb574a6962d40f5f78e1ec5ef362b0df94c52bc4ea6706a4"} Jul 16 16:41:02.365778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:02.365768 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z7znj" event={"ID":"7f8bf7da-b0ec-414f-a0b1-70b240300874","Type":"ContainerStarted","Data":"456457b33a54d076b5cae7d27516507bd5c3081061718941bc2f1320dbf6b6c5"} Jul 16 16:41:02.395806 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:02.395760 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z7znj" podStartSLOduration=9.085960318 podStartE2EDuration="13.395745037s" totalImagesPullingTime="4.194135755s" totalInitContainerRuntime="115.648964ms" isStatefulPod=true podCreationTimestamp="2026-07-16 16:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:02.393546205 +0000 UTC m=+125.269773967" watchObservedRunningTime="2026-07-16 16:41:02.395745037 +0000 UTC m=+125.271972779" Jul 16 16:41:03.376546 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:03.376499 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerStarted","Data":"09135dc97606e2977f71421cc71848a7e9ae4d1a4ef9c4eead2610c298dbbf88"} Jul 16 16:41:03.381580 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:03.381393 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" event={"ID":"f46102dc-30e6-4084-acc3-528d228025c1","Type":"ContainerStarted","Data":"146b9f30c97a2cac4f2a83da83da0c440f7b746caba1dce7337bb503d5ca289c"} Jul 16 16:41:03.381780 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:03.381759 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:41:03.389543 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:03.389524 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" Jul 16 16:41:03.401390 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:03.401351 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kwc2l" podStartSLOduration=6.792258323 podStartE2EDuration="9.401337304s" totalImagesPullingTime="2.609078981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:03.400526253 +0000 UTC m=+126.276753992" watchObservedRunningTime="2026-07-16 16:41:03.401337304 +0000 UTC m=+126.277565046" Jul 16 16:41:04.389349 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:04.389310 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerStarted","Data":"fccf41d8661917ffac100b4b473c5ec306b23923ca81a8b91650bb80c249db7f"} Jul 16 16:41:04.389816 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:04.389389 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerStarted","Data":"6a08c2ef10433041eca4587fdf35244f1d447b9b08cb4fe80f40dea4e4d49bee"} Jul 16 16:41:04.389816 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:04.389428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerStarted","Data":"3548a797e2bbd5fe3ce17d942792159e6758a6d4b4d99ad1c7c9edf776ceb160"} Jul 16 16:41:04.389816 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:04.389463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerStarted","Data":"ddcb2a1c99b602b6fa06b365eb3b8cd00a81df13fcd1d4a2719a757aeff5f2c5"} Jul 16 16:41:04.512488 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:04.512455 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:41:05.153380 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:05.153350 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:05.252697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:05.252666 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:06.400867 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.400804 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerStarted","Data":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} Jul 16 16:41:06.401273 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.400922 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerStarted","Data":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} Jul 16 16:41:06.404727 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.404696 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerStarted","Data":"d9902bda4fadbd6920f3f2759f71e57a95165e292cdcb3930a5a98c040ada117"} Jul 16 16:41:06.437888 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.437836 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.647488505 podStartE2EDuration="16.437816348s" totalImagesPullingTime="11.775349998s" totalInitContainerRuntime="14.977845ms" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:06.436109311 +0000 UTC m=+129.312337052" watchObservedRunningTime="2026-07-16 16:41:06.437816348 +0000 UTC m=+129.314044092" Jul 16 16:41:06.464858 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.464767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:41:06.467420 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.467395 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68db2a89-b8a8-48e1-86f8-cf3a82a73c0c-metrics-certs\") pod \"network-metrics-daemon-xmhth\" (UID: \"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c\") " pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:41:06.562520 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.562433 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:06.645245 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.645222 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mb2b9\"" Jul 16 16:41:06.652726 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.652708 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmhth" Jul 16 16:41:06.663163 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.663131 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:06.834318 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:06.834298 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmhth"] Jul 16 16:41:06.837095 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:41:06.837068 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68db2a89_b8a8_48e1_86f8_cf3a82a73c0c.slice/crio-a623727aafd9c21c417f6274180c25b00d2e4a41cd86b0eda63dbbb121cd11e7 WatchSource:0}: Error finding container a623727aafd9c21c417f6274180c25b00d2e4a41cd86b0eda63dbbb121cd11e7: Status 404 returned error can't find the container with id a623727aafd9c21c417f6274180c25b00d2e4a41cd86b0eda63dbbb121cd11e7 Jul 16 16:41:07.410414 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:07.410379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmhth" event={"ID":"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c","Type":"ContainerStarted","Data":"a623727aafd9c21c417f6274180c25b00d2e4a41cd86b0eda63dbbb121cd11e7"} Jul 16 16:41:08.418002 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:08.417973 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerStarted","Data":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} Jul 16 16:41:08.418284 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:08.418038 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerStarted","Data":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} Jul 16 16:41:08.418284 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:08.418069 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerStarted","Data":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} Jul 16 16:41:09.426314 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:09.426281 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmhth" event={"ID":"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c","Type":"ContainerStarted","Data":"6dd2dcff181c5f7d29f3110e0db345746cd8cd217ed85dfcc355fa18853c8317"} Jul 16 16:41:09.426716 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:09.426346 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmhth" event={"ID":"68db2a89-b8a8-48e1-86f8-cf3a82a73c0c","Type":"ContainerStarted","Data":"b80cae78aef10b2ad01c906b9c26a71f4c6f8b61da58638dd0c923576c1696a2"} Jul 16 16:41:09.429454 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:09.429431 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerStarted","Data":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} Jul 16 16:41:09.448667 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:09.448623 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xmhth" podStartSLOduration=130.222129508 podStartE2EDuration="2m12.448609816s" totalImagesPullingTime="2.226480308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:09.44714577 +0000 UTC m=+132.323373514" watchObservedRunningTime="2026-07-16 16:41:09.448609816 +0000 UTC m=+132.324837558" Jul 16 16:41:09.486035 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:09.485991 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.132920562 podStartE2EDuration="14.485975026s" totalImagesPullingTime="6.31727613s" totalInitContainerRuntime="35.778334ms" isStatefulPod=false podCreationTimestamp="2026-07-16 16:40:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:41:09.480001171 +0000 UTC m=+132.356228950" watchObservedRunningTime="2026-07-16 16:41:09.485975026 +0000 UTC m=+132.362202770" Jul 16 16:41:09.553099 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:09.553075 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:09.627458 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:09.627437 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:10.372673 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:10.372646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:10.721064 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:10.721034 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:41:11.159132 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:11.159105 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:11.259796 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:11.259775 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:11.321810 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:11.321790 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:11.544117 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:11.544045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:11.599454 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:11.599430 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:13.752783 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:13.752752 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:41:13.753200 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:13.752834 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:41:19.945154 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:19.945096 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" podUID="65acb107-ee0c-43eb-b42f-c58751e36dd9" containerName="registry" containerID="cri-o://e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae" gracePeriod=30 Jul 16 16:41:20.209648 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.209601 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:41:20.266478 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266455 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-bound-sa-token\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.266612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266496 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65acb107-ee0c-43eb-b42f-c58751e36dd9-ca-trust-extracted\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.266612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266538 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-certificates\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.266612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266592 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-trusted-ca\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.266612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266610 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.266813 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266644 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w7q6\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-kube-api-access-8w7q6\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.266813 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266668 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-image-registry-private-configuration\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.266813 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266698 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-installation-pull-secrets\") pod \"65acb107-ee0c-43eb-b42f-c58751e36dd9\" (UID: \"65acb107-ee0c-43eb-b42f-c58751e36dd9\") " Jul 16 16:41:20.267033 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.266974 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:20.267272 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.267240 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:20.269032 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.268997 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:41:20.269130 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.269048 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:41:20.269130 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.269114 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-kube-api-access-8w7q6" (OuterVolumeSpecName: "kube-api-access-8w7q6") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "kube-api-access-8w7q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:41:20.269238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.269137 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:41:20.269238 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.269214 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:41:20.282385 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.282362 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65acb107-ee0c-43eb-b42f-c58751e36dd9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "65acb107-ee0c-43eb-b42f-c58751e36dd9" (UID: "65acb107-ee0c-43eb-b42f-c58751e36dd9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:41:20.310618 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.310574 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fc7568fb6-kdxrq" podUID="9516e011-af6a-457f-84c2-ce9465bc5f39" containerName="console" containerID="cri-o://b28740d49d5bab905b0a0c56219edab726495dfb2f9bc60b4a9d74da6666452d" gracePeriod=15 Jul 16 16:41:20.367424 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367403 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-bound-sa-token\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.367424 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367423 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65acb107-ee0c-43eb-b42f-c58751e36dd9-ca-trust-extracted\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.367562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367432 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-certificates\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.367562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367441 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65acb107-ee0c-43eb-b42f-c58751e36dd9-trusted-ca\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.367562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367449 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-registry-tls\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.367562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367456 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w7q6\" (UniqueName: \"kubernetes.io/projected/65acb107-ee0c-43eb-b42f-c58751e36dd9-kube-api-access-8w7q6\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.367562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367465 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-image-registry-private-configuration\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.367562 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.367475 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65acb107-ee0c-43eb-b42f-c58751e36dd9-installation-pull-secrets\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.478547 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.478461 2566 generic.go:356] "Generic (PLEG): container finished" podID="9516e011-af6a-457f-84c2-ce9465bc5f39" containerID="b28740d49d5bab905b0a0c56219edab726495dfb2f9bc60b4a9d74da6666452d" exitCode=0 Jul 16 16:41:20.478547 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.478535 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc7568fb6-kdxrq" event={"ID":"9516e011-af6a-457f-84c2-ce9465bc5f39","Type":"ContainerDied","Data":"b28740d49d5bab905b0a0c56219edab726495dfb2f9bc60b4a9d74da6666452d"} Jul 16 16:41:20.479826 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.479798 2566 generic.go:356] "Generic (PLEG): container finished" podID="65acb107-ee0c-43eb-b42f-c58751e36dd9" containerID="e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae" exitCode=0 Jul 16 16:41:20.479932 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.479878 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" event={"ID":"65acb107-ee0c-43eb-b42f-c58751e36dd9","Type":"ContainerDied","Data":"e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae"} Jul 16 16:41:20.479932 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.479918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" event={"ID":"65acb107-ee0c-43eb-b42f-c58751e36dd9","Type":"ContainerDied","Data":"f392df8e25f730bc06a02322a95d181814371408094b98b3d4a2b74a32a7e929"} Jul 16 16:41:20.480031 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.479943 2566 scope.go:117] "RemoveContainer" containerID="e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae" Jul 16 16:41:20.480084 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.480034 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cc8dd856-prsmp" Jul 16 16:41:20.489184 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.489167 2566 scope.go:117] "RemoveContainer" containerID="e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae" Jul 16 16:41:20.489461 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:41:20.489438 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae\": container with ID starting with e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae not found: ID does not exist" containerID="e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae" Jul 16 16:41:20.489581 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.489471 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae"} err="failed to get container status \"e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae\": rpc error: code = NotFound desc = could not find container \"e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae\": container with ID starting with e5402b4bfda2395769ea690d0bc8e78d0c73c0233ed0179fafcbcac237dd64ae not found: ID does not exist" Jul 16 16:41:20.503022 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.502996 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cc8dd856-prsmp"] Jul 16 16:41:20.505577 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.505556 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54cc8dd856-prsmp"] Jul 16 16:41:20.573479 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.573461 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:41:20.670340 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670315 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-trusted-ca-bundle\") pod \"9516e011-af6a-457f-84c2-ce9465bc5f39\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " Jul 16 16:41:20.670340 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670341 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-console-config\") pod \"9516e011-af6a-457f-84c2-ce9465bc5f39\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " Jul 16 16:41:20.670529 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670367 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrw6\" (UniqueName: \"kubernetes.io/projected/9516e011-af6a-457f-84c2-ce9465bc5f39-kube-api-access-2jrw6\") pod \"9516e011-af6a-457f-84c2-ce9465bc5f39\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " Jul 16 16:41:20.670529 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670395 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-oauth-serving-cert\") pod \"9516e011-af6a-457f-84c2-ce9465bc5f39\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " Jul 16 16:41:20.670529 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670428 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-service-ca\") pod \"9516e011-af6a-457f-84c2-ce9465bc5f39\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " Jul 16 16:41:20.670529 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670451 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-oauth-config\") pod \"9516e011-af6a-457f-84c2-ce9465bc5f39\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " Jul 16 16:41:20.670729 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670544 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-serving-cert\") pod \"9516e011-af6a-457f-84c2-ce9465bc5f39\" (UID: \"9516e011-af6a-457f-84c2-ce9465bc5f39\") " Jul 16 16:41:20.670834 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670810 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9516e011-af6a-457f-84c2-ce9465bc5f39" (UID: "9516e011-af6a-457f-84c2-ce9465bc5f39"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:20.670919 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670833 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-console-config" (OuterVolumeSpecName: "console-config") pod "9516e011-af6a-457f-84c2-ce9465bc5f39" (UID: "9516e011-af6a-457f-84c2-ce9465bc5f39"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:20.670919 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670863 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9516e011-af6a-457f-84c2-ce9465bc5f39" (UID: "9516e011-af6a-457f-84c2-ce9465bc5f39"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:20.670919 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.670879 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-service-ca" (OuterVolumeSpecName: "service-ca") pod "9516e011-af6a-457f-84c2-ce9465bc5f39" (UID: "9516e011-af6a-457f-84c2-ce9465bc5f39"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:20.672653 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.672632 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9516e011-af6a-457f-84c2-ce9465bc5f39-kube-api-access-2jrw6" (OuterVolumeSpecName: "kube-api-access-2jrw6") pod "9516e011-af6a-457f-84c2-ce9465bc5f39" (UID: "9516e011-af6a-457f-84c2-ce9465bc5f39"). InnerVolumeSpecName "kube-api-access-2jrw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:41:20.672720 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.672655 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9516e011-af6a-457f-84c2-ce9465bc5f39" (UID: "9516e011-af6a-457f-84c2-ce9465bc5f39"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:41:20.672720 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.672669 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9516e011-af6a-457f-84c2-ce9465bc5f39" (UID: "9516e011-af6a-457f-84c2-ce9465bc5f39"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:41:20.771192 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.771145 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-service-ca\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.771192 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.771164 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-oauth-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.771192 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.771174 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9516e011-af6a-457f-84c2-ce9465bc5f39-console-serving-cert\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.771354 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.771231 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-trusted-ca-bundle\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.771354 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.771249 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-console-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.771354 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.771263 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrw6\" (UniqueName: \"kubernetes.io/projected/9516e011-af6a-457f-84c2-ce9465bc5f39-kube-api-access-2jrw6\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:20.771354 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:20.771275 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9516e011-af6a-457f-84c2-ce9465bc5f39-oauth-serving-cert\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:21.490342 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:21.490313 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc7568fb6-kdxrq" Jul 16 16:41:21.490916 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:21.490321 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc7568fb6-kdxrq" event={"ID":"9516e011-af6a-457f-84c2-ce9465bc5f39","Type":"ContainerDied","Data":"fcbb1802a3c43d9b50c5fc3457d6cfee2f8ee3bc1892e5a08a97a94db27e8db4"} Jul 16 16:41:21.490916 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:21.490464 2566 scope.go:117] "RemoveContainer" containerID="b28740d49d5bab905b0a0c56219edab726495dfb2f9bc60b4a9d74da6666452d" Jul 16 16:41:21.512890 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:21.512866 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc7568fb6-kdxrq"] Jul 16 16:41:21.520107 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:21.520085 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fc7568fb6-kdxrq"] Jul 16 16:41:21.820419 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:21.820347 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65acb107-ee0c-43eb-b42f-c58751e36dd9" path="/var/lib/kubelet/pods/65acb107-ee0c-43eb-b42f-c58751e36dd9/volumes" Jul 16 16:41:21.820764 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:21.820749 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9516e011-af6a-457f-84c2-ce9465bc5f39" path="/var/lib/kubelet/pods/9516e011-af6a-457f-84c2-ce9465bc5f39/volumes" Jul 16 16:41:25.351354 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.351319 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bd49f68c6-rt29n" podUID="e8ff50bc-d8f8-451c-a864-082461a0348f" containerName="console" containerID="cri-o://6fbf51140e8805ed8583934ab51c2e7c31431b55bcf07be3e38a0370693e2514" gracePeriod=15 Jul 16 16:41:25.509315 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.509283 2566 generic.go:356] "Generic (PLEG): container finished" podID="e8ff50bc-d8f8-451c-a864-082461a0348f" containerID="6fbf51140e8805ed8583934ab51c2e7c31431b55bcf07be3e38a0370693e2514" exitCode=0 Jul 16 16:41:25.509421 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.509373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd49f68c6-rt29n" event={"ID":"e8ff50bc-d8f8-451c-a864-082461a0348f","Type":"ContainerDied","Data":"6fbf51140e8805ed8583934ab51c2e7c31431b55bcf07be3e38a0370693e2514"} Jul 16 16:41:25.640857 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.640837 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:41:25.706133 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706111 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-trusted-ca-bundle\") pod \"e8ff50bc-d8f8-451c-a864-082461a0348f\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " Jul 16 16:41:25.706249 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706142 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-console-config\") pod \"e8ff50bc-d8f8-451c-a864-082461a0348f\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " Jul 16 16:41:25.706249 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706188 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-service-ca\") pod \"e8ff50bc-d8f8-451c-a864-082461a0348f\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " Jul 16 16:41:25.706317 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706290 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-oauth-config\") pod \"e8ff50bc-d8f8-451c-a864-082461a0348f\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " Jul 16 16:41:25.706349 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706332 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-oauth-serving-cert\") pod \"e8ff50bc-d8f8-451c-a864-082461a0348f\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " Jul 16 16:41:25.706392 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706383 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z895p\" (UniqueName: \"kubernetes.io/projected/e8ff50bc-d8f8-451c-a864-082461a0348f-kube-api-access-z895p\") pod \"e8ff50bc-d8f8-451c-a864-082461a0348f\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " Jul 16 16:41:25.706434 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706409 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-serving-cert\") pod \"e8ff50bc-d8f8-451c-a864-082461a0348f\" (UID: \"e8ff50bc-d8f8-451c-a864-082461a0348f\") " Jul 16 16:41:25.706598 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706552 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8ff50bc-d8f8-451c-a864-082461a0348f" (UID: "e8ff50bc-d8f8-451c-a864-082461a0348f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:25.706598 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706586 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8ff50bc-d8f8-451c-a864-082461a0348f" (UID: "e8ff50bc-d8f8-451c-a864-082461a0348f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:25.706792 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706621 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-console-config" (OuterVolumeSpecName: "console-config") pod "e8ff50bc-d8f8-451c-a864-082461a0348f" (UID: "e8ff50bc-d8f8-451c-a864-082461a0348f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:25.706853 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706828 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8ff50bc-d8f8-451c-a864-082461a0348f" (UID: "e8ff50bc-d8f8-451c-a864-082461a0348f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:41:25.706899 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706866 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-trusted-ca-bundle\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:25.706899 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706889 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-console-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:25.706958 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.706903 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-service-ca\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:25.708456 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.708434 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8ff50bc-d8f8-451c-a864-082461a0348f" (UID: "e8ff50bc-d8f8-451c-a864-082461a0348f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:41:25.708547 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.708463 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8ff50bc-d8f8-451c-a864-082461a0348f" (UID: "e8ff50bc-d8f8-451c-a864-082461a0348f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:41:25.708547 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.708529 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ff50bc-d8f8-451c-a864-082461a0348f-kube-api-access-z895p" (OuterVolumeSpecName: "kube-api-access-z895p") pod "e8ff50bc-d8f8-451c-a864-082461a0348f" (UID: "e8ff50bc-d8f8-451c-a864-082461a0348f"). InnerVolumeSpecName "kube-api-access-z895p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:41:25.807431 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.807410 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-oauth-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:25.807431 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.807429 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff50bc-d8f8-451c-a864-082461a0348f-oauth-serving-cert\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:25.807561 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.807438 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z895p\" (UniqueName: \"kubernetes.io/projected/e8ff50bc-d8f8-451c-a864-082461a0348f-kube-api-access-z895p\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:25.807561 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:25.807448 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8ff50bc-d8f8-451c-a864-082461a0348f-console-serving-cert\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:41:26.514490 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:26.514454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd49f68c6-rt29n" event={"ID":"e8ff50bc-d8f8-451c-a864-082461a0348f","Type":"ContainerDied","Data":"8dd69923c634f96e69efd5c8afc61ac4923ba42419b9589284b85bd587d18135"} Jul 16 16:41:26.514490 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:26.514490 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd49f68c6-rt29n" Jul 16 16:41:26.514962 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:26.514576 2566 scope.go:117] "RemoveContainer" containerID="6fbf51140e8805ed8583934ab51c2e7c31431b55bcf07be3e38a0370693e2514" Jul 16 16:41:26.532818 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:26.532796 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd49f68c6-rt29n"] Jul 16 16:41:26.538974 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:26.538953 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd49f68c6-rt29n"] Jul 16 16:41:26.555712 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:26.555690 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:26.622315 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:26.622292 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:41:27.819467 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:27.819436 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ff50bc-d8f8-451c-a864-082461a0348f" path="/var/lib/kubelet/pods/e8ff50bc-d8f8-451c-a864-082461a0348f/volumes" Jul 16 16:41:33.758676 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:33.758644 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:41:33.762612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:33.762564 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d699f5d5f-m4nmb" Jul 16 16:41:55.721691 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:55.721593 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:41:55.741539 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:55.741494 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:41:56.658549 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:41:56.658517 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:05.248372 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:05.248317 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:05.321977 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:05.321940 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:09.545771 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.545728 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:42:09.546203 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.546072 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="alertmanager" containerID="cri-o://09135dc97606e2977f71421cc71848a7e9ae4d1a4ef9c4eead2610c298dbbf88" gracePeriod=120 Jul 16 16:42:09.546203 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.546152 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-web" containerID="cri-o://3548a797e2bbd5fe3ce17d942792159e6758a6d4b4d99ad1c7c9edf776ceb160" gracePeriod=120 Jul 16 16:42:09.546203 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.546185 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy" containerID="cri-o://6a08c2ef10433041eca4587fdf35244f1d447b9b08cb4fe80f40dea4e4d49bee" gracePeriod=120 Jul 16 16:42:09.546360 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.546222 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="prom-label-proxy" containerID="cri-o://d9902bda4fadbd6920f3f2759f71e57a95165e292cdcb3930a5a98c040ada117" gracePeriod=120 Jul 16 16:42:09.546360 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.546251 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="config-reloader" containerID="cri-o://ddcb2a1c99b602b6fa06b365eb3b8cd00a81df13fcd1d4a2719a757aeff5f2c5" gracePeriod=120 Jul 16 16:42:09.546360 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.546152 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-metric" containerID="cri-o://fccf41d8661917ffac100b4b473c5ec306b23923ca81a8b91650bb80c249db7f" gracePeriod=120 Jul 16 16:42:09.698092 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698067 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerID="d9902bda4fadbd6920f3f2759f71e57a95165e292cdcb3930a5a98c040ada117" exitCode=0 Jul 16 16:42:09.698092 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698090 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerID="6a08c2ef10433041eca4587fdf35244f1d447b9b08cb4fe80f40dea4e4d49bee" exitCode=0 Jul 16 16:42:09.698234 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698099 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerID="ddcb2a1c99b602b6fa06b365eb3b8cd00a81df13fcd1d4a2719a757aeff5f2c5" exitCode=0 Jul 16 16:42:09.698234 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698107 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerID="09135dc97606e2977f71421cc71848a7e9ae4d1a4ef9c4eead2610c298dbbf88" exitCode=0 Jul 16 16:42:09.698234 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698143 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"d9902bda4fadbd6920f3f2759f71e57a95165e292cdcb3930a5a98c040ada117"} Jul 16 16:42:09.698234 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698220 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"6a08c2ef10433041eca4587fdf35244f1d447b9b08cb4fe80f40dea4e4d49bee"} Jul 16 16:42:09.698361 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698247 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"ddcb2a1c99b602b6fa06b365eb3b8cd00a81df13fcd1d4a2719a757aeff5f2c5"} Jul 16 16:42:09.698361 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:09.698271 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"09135dc97606e2977f71421cc71848a7e9ae4d1a4ef9c4eead2610c298dbbf88"} Jul 16 16:42:10.705812 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.705785 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerID="fccf41d8661917ffac100b4b473c5ec306b23923ca81a8b91650bb80c249db7f" exitCode=0 Jul 16 16:42:10.705812 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.705808 2566 generic.go:356] "Generic (PLEG): container finished" podID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerID="3548a797e2bbd5fe3ce17d942792159e6758a6d4b4d99ad1c7c9edf776ceb160" exitCode=0 Jul 16 16:42:10.706199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.705865 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"fccf41d8661917ffac100b4b473c5ec306b23923ca81a8b91650bb80c249db7f"} Jul 16 16:42:10.706199 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.705957 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"3548a797e2bbd5fe3ce17d942792159e6758a6d4b4d99ad1c7c9edf776ceb160"} Jul 16 16:42:10.780651 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.780627 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:10.836627 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836600 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-cluster-tls-config\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.836748 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836630 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.836748 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836650 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-tls-assets\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.836748 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836675 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-volume\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.836748 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836691 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w254x\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-kube-api-access-w254x\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.836748 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836718 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-main-db\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836761 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-out\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836797 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-web\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836824 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836871 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-web-config\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836905 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836938 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.836971 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-metrics-client-ca\") pod \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\" (UID: \"9fa4e7ec-54e3-45b9-a2ef-59e33f704941\") " Jul 16 16:42:10.837629 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.837545 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:10.838493 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.838464 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:42:10.838708 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.838682 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:10.840909 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.840839 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:10.841162 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.841044 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-kube-api-access-w254x" (OuterVolumeSpecName: "kube-api-access-w254x") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "kube-api-access-w254x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:42:10.841800 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.841764 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-volume" (OuterVolumeSpecName: "config-volume") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:10.842197 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.842069 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-out" (OuterVolumeSpecName: "config-out") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:42:10.842197 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.842172 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:10.842612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.842585 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:10.842612 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.842586 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:42:10.842876 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.842831 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:10.845248 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.845228 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:10.853092 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.853073 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-web-config" (OuterVolumeSpecName: "web-config") pod "9fa4e7ec-54e3-45b9-a2ef-59e33f704941" (UID: "9fa4e7ec-54e3-45b9-a2ef-59e33f704941"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:10.937745 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937724 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-out\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937745 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937746 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937755 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937764 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-web-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937773 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937781 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937790 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-metrics-client-ca\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937799 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-cluster-tls-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937806 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-secret-alertmanager-main-tls\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937814 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-tls-assets\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937822 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-config-volume\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937829 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w254x\" (UniqueName: \"kubernetes.io/projected/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-kube-api-access-w254x\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:10.937864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:10.937836 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fa4e7ec-54e3-45b9-a2ef-59e33f704941-alertmanager-main-db\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:11.713667 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.713638 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fa4e7ec-54e3-45b9-a2ef-59e33f704941","Type":"ContainerDied","Data":"b50982aa030fefa08e9efc3b517fab52701057e90f674c2951534e68bc7d4610"} Jul 16 16:42:11.714005 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.713722 2566 scope.go:117] "RemoveContainer" containerID="d9902bda4fadbd6920f3f2759f71e57a95165e292cdcb3930a5a98c040ada117" Jul 16 16:42:11.714005 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.713650 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.722029 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.721869 2566 scope.go:117] "RemoveContainer" containerID="fccf41d8661917ffac100b4b473c5ec306b23923ca81a8b91650bb80c249db7f" Jul 16 16:42:11.731542 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.731514 2566 scope.go:117] "RemoveContainer" containerID="6a08c2ef10433041eca4587fdf35244f1d447b9b08cb4fe80f40dea4e4d49bee" Jul 16 16:42:11.738111 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.738093 2566 scope.go:117] "RemoveContainer" containerID="3548a797e2bbd5fe3ce17d942792159e6758a6d4b4d99ad1c7c9edf776ceb160" Jul 16 16:42:11.744905 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.744889 2566 scope.go:117] "RemoveContainer" containerID="ddcb2a1c99b602b6fa06b365eb3b8cd00a81df13fcd1d4a2719a757aeff5f2c5" Jul 16 16:42:11.751694 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.751677 2566 scope.go:117] "RemoveContainer" containerID="09135dc97606e2977f71421cc71848a7e9ae4d1a4ef9c4eead2610c298dbbf88" Jul 16 16:42:11.759161 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.759144 2566 scope.go:117] "RemoveContainer" containerID="a334ff4981d61c343ff9f45ba3a9d44b09c8689892c47f6ba9c4a40ecc727e5c" Jul 16 16:42:11.759876 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.759858 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:42:11.765776 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.765755 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:42:11.814380 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814359 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:42:11.814683 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814669 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="init-config-reloader" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814685 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="init-config-reloader" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814698 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814703 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814710 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="prom-label-proxy" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814716 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="prom-label-proxy" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814723 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="config-reloader" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814728 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="config-reloader" Jul 16 16:42:11.814734 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814737 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9516e011-af6a-457f-84c2-ce9465bc5f39" containerName="console" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814742 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9516e011-af6a-457f-84c2-ce9465bc5f39" containerName="console" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814752 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="alertmanager" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814757 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="alertmanager" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814763 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-metric" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814767 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-metric" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814775 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-web" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814780 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-web" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814787 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65acb107-ee0c-43eb-b42f-c58751e36dd9" containerName="registry" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814792 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="65acb107-ee0c-43eb-b42f-c58751e36dd9" containerName="registry" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814798 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ff50bc-d8f8-451c-a864-082461a0348f" containerName="console" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814802 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ff50bc-d8f8-451c-a864-082461a0348f" containerName="console" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814849 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ff50bc-d8f8-451c-a864-082461a0348f" containerName="console" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814856 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9516e011-af6a-457f-84c2-ce9465bc5f39" containerName="console" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814863 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="alertmanager" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814868 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="config-reloader" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814874 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814878 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="65acb107-ee0c-43eb-b42f-c58751e36dd9" containerName="registry" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814883 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-web" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814888 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="kube-rbac-proxy-metric" Jul 16 16:42:11.814949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.814893 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" containerName="prom-label-proxy" Jul 16 16:42:11.818626 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.818608 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.823406 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.823384 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa4e7ec-54e3-45b9-a2ef-59e33f704941" path="/var/lib/kubelet/pods/9fa4e7ec-54e3-45b9-a2ef-59e33f704941/volumes" Jul 16 16:42:11.825770 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.825746 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 16:42:11.825845 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.825746 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 16:42:11.825845 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.825746 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 16:42:11.826378 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.826361 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 16:42:11.826444 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.826429 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 16:42:11.826492 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.826477 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 16:42:11.826611 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.826597 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 16:42:11.826840 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.826825 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r2xlz\"" Jul 16 16:42:11.826917 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.826866 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 16:42:11.833300 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.833282 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 16:42:11.843869 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.843852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3230fe-015d-483e-bc17-fa6e5747988a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.843941 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.843882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.843941 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.843900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5dg9\" (UniqueName: \"kubernetes.io/projected/2e3230fe-015d-483e-bc17-fa6e5747988a-kube-api-access-x5dg9\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.843941 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.843917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3230fe-015d-483e-bc17-fa6e5747988a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.843941 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.843933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844064 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.843971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3230fe-015d-483e-bc17-fa6e5747988a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844064 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.844037 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3230fe-015d-483e-bc17-fa6e5747988a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844064 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.844060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.844089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.844108 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844153 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.844146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-web-config\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844235 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.844167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3230fe-015d-483e-bc17-fa6e5747988a-config-out\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.844235 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.844222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.851214 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.851193 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:42:11.944693 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.944785 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3230fe-015d-483e-bc17-fa6e5747988a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.944785 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.944883 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944830 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5dg9\" (UniqueName: \"kubernetes.io/projected/2e3230fe-015d-483e-bc17-fa6e5747988a-kube-api-access-x5dg9\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.944883 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3230fe-015d-483e-bc17-fa6e5747988a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.944974 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.944974 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3230fe-015d-483e-bc17-fa6e5747988a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.944974 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3230fe-015d-483e-bc17-fa6e5747988a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.945116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.944977 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.945116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.945024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.945116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.945057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.945116 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.945084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-web-config\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.945548 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.945526 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3230fe-015d-483e-bc17-fa6e5747988a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.945652 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.945598 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3230fe-015d-483e-bc17-fa6e5747988a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.945913 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.945888 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3230fe-015d-483e-bc17-fa6e5747988a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.946610 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.946277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3230fe-015d-483e-bc17-fa6e5747988a-config-out\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948099 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948072 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948273 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948247 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948348 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948323 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3230fe-015d-483e-bc17-fa6e5747988a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948407 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948472 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948453 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948665 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948651 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-web-config\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948706 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948661 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948792 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948766 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3230fe-015d-483e-bc17-fa6e5747988a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.948916 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.948898 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3230fe-015d-483e-bc17-fa6e5747988a-config-out\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:11.954954 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:11.954935 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5dg9\" (UniqueName: \"kubernetes.io/projected/2e3230fe-015d-483e-bc17-fa6e5747988a-kube-api-access-x5dg9\") pod \"alertmanager-main-0\" (UID: \"2e3230fe-015d-483e-bc17-fa6e5747988a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:12.128076 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:12.128058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:42:12.275868 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:12.275756 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:42:12.278353 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:42:12.278325 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3230fe_015d_483e_bc17_fa6e5747988a.slice/crio-b8062284048a5e3925d27168a648228b3c7c0ac537da08fa1fdaad5215fc6274 WatchSource:0}: Error finding container b8062284048a5e3925d27168a648228b3c7c0ac537da08fa1fdaad5215fc6274: Status 404 returned error can't find the container with id b8062284048a5e3925d27168a648228b3c7c0ac537da08fa1fdaad5215fc6274 Jul 16 16:42:12.719909 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:12.719875 2566 generic.go:356] "Generic (PLEG): container finished" podID="2e3230fe-015d-483e-bc17-fa6e5747988a" containerID="a68186f779a19d32be06e143a5e40e4ce046f237939d26283becd1fadd03decd" exitCode=0 Jul 16 16:42:12.720285 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:12.719965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerDied","Data":"a68186f779a19d32be06e143a5e40e4ce046f237939d26283becd1fadd03decd"} Jul 16 16:42:12.720285 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:12.720035 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerStarted","Data":"b8062284048a5e3925d27168a648228b3c7c0ac537da08fa1fdaad5215fc6274"} Jul 16 16:42:13.727816 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.727782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerStarted","Data":"4d4a1832e5535707fbefb6c4e33b44a3c696f77fe644fce8a154f618d27b5ab9"} Jul 16 16:42:13.728128 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.727874 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerStarted","Data":"1fbeb16aec1b3489711f05243b02a67c363e79d70e3b7007503f850bbb9f926c"} Jul 16 16:42:13.728128 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.727900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerStarted","Data":"b430c63893868e1eff869421218f22d57607c6d73beab4e355636d30b121bda9"} Jul 16 16:42:13.728128 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.727924 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerStarted","Data":"f3d8089e46e346137b8f1563fcbdce43c82d645f4716499fdcb178e94142978b"} Jul 16 16:42:13.728128 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.727947 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerStarted","Data":"79372881d65ea192eb89796fecfaff008c48b441e2ad6cbc020c96ee4ba5de61"} Jul 16 16:42:13.728128 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.727970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3230fe-015d-483e-bc17-fa6e5747988a","Type":"ContainerStarted","Data":"dc0570c1b5145537d9d5b9091a5a433e27690b7c074a320dcd94b0a498921b68"} Jul 16 16:42:13.740227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.740202 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:42:13.740713 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.740533 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="thanos-sidecar" containerID="cri-o://ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" gracePeriod=600 Jul 16 16:42:13.740713 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.740548 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="prometheus" containerID="cri-o://e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" gracePeriod=600 Jul 16 16:42:13.740713 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.740536 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy" containerID="cri-o://ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" gracePeriod=600 Jul 16 16:42:13.740713 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.740582 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-web" containerID="cri-o://0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" gracePeriod=600 Jul 16 16:42:13.740713 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.740587 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" gracePeriod=600 Jul 16 16:42:13.740952 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.740595 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="config-reloader" containerID="cri-o://11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" gracePeriod=600 Jul 16 16:42:13.765472 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.765423 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.75050563 podStartE2EDuration="2.76540582s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.90019ms" isStatefulPod=false podCreationTimestamp="2026-07-16 16:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:42:13.763720636 +0000 UTC m=+196.639948391" watchObservedRunningTime="2026-07-16 16:42:13.76540582 +0000 UTC m=+196.641633563" Jul 16 16:42:13.967564 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:13.967542 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.063456 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063394 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063456 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063438 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-tls-assets\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063456 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063454 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-grpc-tls\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063672 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063469 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-web-config\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063672 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063485 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-config\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063672 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063616 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-serving-certs-ca-bundle\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063672 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063662 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-db\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063870 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063692 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-kubelet-serving-ca-bundle\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063870 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063743 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-2\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063870 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063776 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-metrics-client-certs\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063870 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063806 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063870 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063832 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-1\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.063870 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063858 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-trusted-ca-bundle\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063881 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-thanos-prometheus-http-client-file\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063914 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-metrics-client-ca\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063942 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-kube-rbac-proxy\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.063972 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-0\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064026 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-tls\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064050 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxdpt\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-kube-api-access-qxdpt\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064082 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-config-out\") pod \"d4c6691e-d8f1-40ef-8229-887e7b58db02\" (UID: \"d4c6691e-d8f1-40ef-8229-887e7b58db02\") " Jul 16 16:42:14.064550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064239 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:14.064550 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064360 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.065548 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064706 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:14.065548 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064746 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:14.065548 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.064969 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:14.066043 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.066015 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:14.066235 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.066210 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:14.066324 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.066304 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:42:14.066993 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.066964 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:42:14.067281 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.067255 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-config" (OuterVolumeSpecName: "config") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.067582 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.067541 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.067725 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.067688 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.067882 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.067862 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:42:14.068350 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.068296 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.068350 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.068325 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.068552 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.068356 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-config-out" (OuterVolumeSpecName: "config-out") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:42:14.068552 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.068407 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.068676 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.068560 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-kube-api-access-qxdpt" (OuterVolumeSpecName: "kube-api-access-qxdpt") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "kube-api-access-qxdpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:42:14.068801 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.068775 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.069709 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.069681 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.076526 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.076493 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-web-config" (OuterVolumeSpecName: "web-config") pod "d4c6691e-d8f1-40ef-8229-887e7b58db02" (UID: "d4c6691e-d8f1-40ef-8229-887e7b58db02"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:42:14.165620 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165588 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-grpc-tls\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165620 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165618 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-web-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165620 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165627 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-config\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165635 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-db\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165644 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165652 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165661 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-metrics-client-certs\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165669 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165677 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165685 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165693 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165701 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-configmap-metrics-client-ca\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165709 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-kube-rbac-proxy\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165716 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4c6691e-d8f1-40ef-8229-887e7b58db02-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165727 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165734 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxdpt\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-kube-api-access-qxdpt\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165741 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4c6691e-d8f1-40ef-8229-887e7b58db02-config-out\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165750 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4c6691e-d8f1-40ef-8229-887e7b58db02-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.165761 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.165758 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4c6691e-d8f1-40ef-8229-887e7b58db02-tls-assets\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:42:14.735214 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735180 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" exitCode=0 Jul 16 16:42:14.735214 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735212 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" exitCode=0 Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735221 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" exitCode=0 Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735229 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" exitCode=0 Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735239 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" exitCode=0 Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735247 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" exitCode=0 Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735287 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735343 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735400 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735423 2566 scope.go:117] "RemoveContainer" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735427 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} Jul 16 16:42:14.735583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.735527 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4c6691e-d8f1-40ef-8229-887e7b58db02","Type":"ContainerDied","Data":"ed7d5b9ffd42e0a508384b297d593ff84cd47d88ea89ccad8d81ccde506615de"} Jul 16 16:42:14.744047 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.743883 2566 scope.go:117] "RemoveContainer" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.751301 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.751284 2566 scope.go:117] "RemoveContainer" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.759824 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.759632 2566 scope.go:117] "RemoveContainer" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.763724 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.763701 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:42:14.767842 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.767822 2566 scope.go:117] "RemoveContainer" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.770564 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.770493 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:42:14.775064 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.775046 2566 scope.go:117] "RemoveContainer" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.782474 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.782456 2566 scope.go:117] "RemoveContainer" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.788719 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.788701 2566 scope.go:117] "RemoveContainer" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.788968 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:42:14.788951 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": container with ID starting with 6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887 not found: ID does not exist" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.789013 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.788980 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} err="failed to get container status \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": rpc error: code = NotFound desc = could not find container \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": container with ID starting with 6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887 not found: ID does not exist" Jul 16 16:42:14.789013 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.788997 2566 scope.go:117] "RemoveContainer" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.789256 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:42:14.789239 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": container with ID starting with ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2 not found: ID does not exist" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.789295 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.789263 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} err="failed to get container status \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": rpc error: code = NotFound desc = could not find container \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": container with ID starting with ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2 not found: ID does not exist" Jul 16 16:42:14.789295 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.789282 2566 scope.go:117] "RemoveContainer" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.789500 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:42:14.789484 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": container with ID starting with 0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b not found: ID does not exist" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.789559 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.789523 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} err="failed to get container status \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": rpc error: code = NotFound desc = could not find container \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": container with ID starting with 0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b not found: ID does not exist" Jul 16 16:42:14.789559 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.789536 2566 scope.go:117] "RemoveContainer" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.789796 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:42:14.789779 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": container with ID starting with ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1 not found: ID does not exist" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.789850 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.789801 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} err="failed to get container status \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": rpc error: code = NotFound desc = could not find container \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": container with ID starting with ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1 not found: ID does not exist" Jul 16 16:42:14.789850 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.789818 2566 scope.go:117] "RemoveContainer" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.790085 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:42:14.790059 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": container with ID starting with 11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e not found: ID does not exist" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.790166 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790084 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} err="failed to get container status \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": rpc error: code = NotFound desc = could not find container \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": container with ID starting with 11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e not found: ID does not exist" Jul 16 16:42:14.790166 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790106 2566 scope.go:117] "RemoveContainer" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.790339 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:42:14.790321 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": container with ID starting with e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc not found: ID does not exist" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.790376 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790344 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} err="failed to get container status \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": rpc error: code = NotFound desc = could not find container \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": container with ID starting with e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc not found: ID does not exist" Jul 16 16:42:14.790376 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790357 2566 scope.go:117] "RemoveContainer" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.790591 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:42:14.790574 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": container with ID starting with 31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63 not found: ID does not exist" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.790647 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790594 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63"} err="failed to get container status \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": rpc error: code = NotFound desc = could not find container \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": container with ID starting with 31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63 not found: ID does not exist" Jul 16 16:42:14.790647 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790607 2566 scope.go:117] "RemoveContainer" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.790869 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790849 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} err="failed to get container status \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": rpc error: code = NotFound desc = could not find container \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": container with ID starting with 6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887 not found: ID does not exist" Jul 16 16:42:14.790921 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.790868 2566 scope.go:117] "RemoveContainer" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.791107 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791087 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} err="failed to get container status \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": rpc error: code = NotFound desc = could not find container \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": container with ID starting with ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2 not found: ID does not exist" Jul 16 16:42:14.791107 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791105 2566 scope.go:117] "RemoveContainer" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.791355 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791331 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} err="failed to get container status \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": rpc error: code = NotFound desc = could not find container \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": container with ID starting with 0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b not found: ID does not exist" Jul 16 16:42:14.791442 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791359 2566 scope.go:117] "RemoveContainer" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.791779 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791627 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} err="failed to get container status \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": rpc error: code = NotFound desc = could not find container \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": container with ID starting with ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1 not found: ID does not exist" Jul 16 16:42:14.791779 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791655 2566 scope.go:117] "RemoveContainer" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.791941 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791900 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} err="failed to get container status \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": rpc error: code = NotFound desc = could not find container \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": container with ID starting with 11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e not found: ID does not exist" Jul 16 16:42:14.791941 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.791918 2566 scope.go:117] "RemoveContainer" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.792184 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792164 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} err="failed to get container status \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": rpc error: code = NotFound desc = could not find container \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": container with ID starting with e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc not found: ID does not exist" Jul 16 16:42:14.792222 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792184 2566 scope.go:117] "RemoveContainer" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.792452 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792434 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63"} err="failed to get container status \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": rpc error: code = NotFound desc = could not find container \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": container with ID starting with 31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63 not found: ID does not exist" Jul 16 16:42:14.792491 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792452 2566 scope.go:117] "RemoveContainer" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.792698 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792681 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} err="failed to get container status \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": rpc error: code = NotFound desc = could not find container \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": container with ID starting with 6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887 not found: ID does not exist" Jul 16 16:42:14.792740 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792698 2566 scope.go:117] "RemoveContainer" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.792928 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792910 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} err="failed to get container status \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": rpc error: code = NotFound desc = could not find container \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": container with ID starting with ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2 not found: ID does not exist" Jul 16 16:42:14.792977 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.792929 2566 scope.go:117] "RemoveContainer" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.793136 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793116 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} err="failed to get container status \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": rpc error: code = NotFound desc = could not find container \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": container with ID starting with 0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b not found: ID does not exist" Jul 16 16:42:14.793175 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793138 2566 scope.go:117] "RemoveContainer" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.793321 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793301 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} err="failed to get container status \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": rpc error: code = NotFound desc = could not find container \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": container with ID starting with ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1 not found: ID does not exist" Jul 16 16:42:14.793354 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793323 2566 scope.go:117] "RemoveContainer" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.793525 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793492 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} err="failed to get container status \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": rpc error: code = NotFound desc = could not find container \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": container with ID starting with 11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e not found: ID does not exist" Jul 16 16:42:14.793559 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793526 2566 scope.go:117] "RemoveContainer" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.793757 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793739 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} err="failed to get container status \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": rpc error: code = NotFound desc = could not find container \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": container with ID starting with e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc not found: ID does not exist" Jul 16 16:42:14.793794 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793759 2566 scope.go:117] "RemoveContainer" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.793997 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.793980 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63"} err="failed to get container status \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": rpc error: code = NotFound desc = could not find container \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": container with ID starting with 31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63 not found: ID does not exist" Jul 16 16:42:14.794034 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794007 2566 scope.go:117] "RemoveContainer" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.794232 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794213 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} err="failed to get container status \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": rpc error: code = NotFound desc = could not find container \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": container with ID starting with 6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887 not found: ID does not exist" Jul 16 16:42:14.794273 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794231 2566 scope.go:117] "RemoveContainer" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.794445 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794427 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} err="failed to get container status \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": rpc error: code = NotFound desc = could not find container \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": container with ID starting with ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2 not found: ID does not exist" Jul 16 16:42:14.794536 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794447 2566 scope.go:117] "RemoveContainer" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.794699 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794681 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} err="failed to get container status \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": rpc error: code = NotFound desc = could not find container \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": container with ID starting with 0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b not found: ID does not exist" Jul 16 16:42:14.794760 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794700 2566 scope.go:117] "RemoveContainer" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.794914 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794897 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} err="failed to get container status \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": rpc error: code = NotFound desc = could not find container \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": container with ID starting with ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1 not found: ID does not exist" Jul 16 16:42:14.794973 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.794915 2566 scope.go:117] "RemoveContainer" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.795111 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795095 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} err="failed to get container status \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": rpc error: code = NotFound desc = could not find container \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": container with ID starting with 11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e not found: ID does not exist" Jul 16 16:42:14.795178 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795112 2566 scope.go:117] "RemoveContainer" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.795343 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795325 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} err="failed to get container status \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": rpc error: code = NotFound desc = could not find container \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": container with ID starting with e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc not found: ID does not exist" Jul 16 16:42:14.795394 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795344 2566 scope.go:117] "RemoveContainer" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.795664 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795645 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63"} err="failed to get container status \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": rpc error: code = NotFound desc = could not find container \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": container with ID starting with 31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63 not found: ID does not exist" Jul 16 16:42:14.795749 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795663 2566 scope.go:117] "RemoveContainer" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.795914 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795886 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} err="failed to get container status \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": rpc error: code = NotFound desc = could not find container \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": container with ID starting with 6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887 not found: ID does not exist" Jul 16 16:42:14.795980 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.795914 2566 scope.go:117] "RemoveContainer" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.796119 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796104 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} err="failed to get container status \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": rpc error: code = NotFound desc = could not find container \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": container with ID starting with ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2 not found: ID does not exist" Jul 16 16:42:14.796164 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796120 2566 scope.go:117] "RemoveContainer" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.796318 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796302 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} err="failed to get container status \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": rpc error: code = NotFound desc = could not find container \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": container with ID starting with 0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b not found: ID does not exist" Jul 16 16:42:14.796358 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796317 2566 scope.go:117] "RemoveContainer" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.796553 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796535 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} err="failed to get container status \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": rpc error: code = NotFound desc = could not find container \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": container with ID starting with ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1 not found: ID does not exist" Jul 16 16:42:14.796622 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796556 2566 scope.go:117] "RemoveContainer" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.796795 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796776 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} err="failed to get container status \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": rpc error: code = NotFound desc = could not find container \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": container with ID starting with 11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e not found: ID does not exist" Jul 16 16:42:14.796845 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796795 2566 scope.go:117] "RemoveContainer" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.796991 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796977 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} err="failed to get container status \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": rpc error: code = NotFound desc = could not find container \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": container with ID starting with e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc not found: ID does not exist" Jul 16 16:42:14.797030 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.796991 2566 scope.go:117] "RemoveContainer" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.797185 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797171 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63"} err="failed to get container status \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": rpc error: code = NotFound desc = could not find container \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": container with ID starting with 31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63 not found: ID does not exist" Jul 16 16:42:14.797185 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797184 2566 scope.go:117] "RemoveContainer" containerID="6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887" Jul 16 16:42:14.797351 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797337 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887"} err="failed to get container status \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": rpc error: code = NotFound desc = could not find container \"6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887\": container with ID starting with 6da104a597ebf2a920452afc5ac9a8ed0ca17729e24356ab8be04de64c51b887 not found: ID does not exist" Jul 16 16:42:14.797351 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797349 2566 scope.go:117] "RemoveContainer" containerID="ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2" Jul 16 16:42:14.797537 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797522 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2"} err="failed to get container status \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": rpc error: code = NotFound desc = could not find container \"ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2\": container with ID starting with ccc40be72eb70011ef0f3591ad839e6086a7aa5e662e8af6c1ff68d09421dda2 not found: ID does not exist" Jul 16 16:42:14.797537 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797536 2566 scope.go:117] "RemoveContainer" containerID="0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b" Jul 16 16:42:14.797726 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797706 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b"} err="failed to get container status \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": rpc error: code = NotFound desc = could not find container \"0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b\": container with ID starting with 0219c30bd9a74d6e1e3411479cf494dc420bfd2d74c525e8b26ff89e9cd3f22b not found: ID does not exist" Jul 16 16:42:14.797798 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797731 2566 scope.go:117] "RemoveContainer" containerID="ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1" Jul 16 16:42:14.797954 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797940 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1"} err="failed to get container status \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": rpc error: code = NotFound desc = could not find container \"ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1\": container with ID starting with ce6f9e4b8ac90dc2eef48e005342dac560191048c6ce407b7761802461033de1 not found: ID does not exist" Jul 16 16:42:14.797954 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.797953 2566 scope.go:117] "RemoveContainer" containerID="11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e" Jul 16 16:42:14.798158 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.798141 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e"} err="failed to get container status \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": rpc error: code = NotFound desc = could not find container \"11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e\": container with ID starting with 11a2a40b6def9e2bde491552f428ea132e601a4dbabc8eb3ea886f7b677dae1e not found: ID does not exist" Jul 16 16:42:14.798224 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.798160 2566 scope.go:117] "RemoveContainer" containerID="e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc" Jul 16 16:42:14.798357 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.798341 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc"} err="failed to get container status \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": rpc error: code = NotFound desc = could not find container \"e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc\": container with ID starting with e6d5dc4e58939b65192f9c03b477b03fd0add0c0b65a167b534e559c2c1e90fc not found: ID does not exist" Jul 16 16:42:14.798403 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.798356 2566 scope.go:117] "RemoveContainer" containerID="31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63" Jul 16 16:42:14.798540 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.798500 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63"} err="failed to get container status \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": rpc error: code = NotFound desc = could not find container \"31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63\": container with ID starting with 31995f1f03802311f0b1f24c0ee45a1bafedd062a43f50d55dd034f11832ff63 not found: ID does not exist" Jul 16 16:42:14.801854 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.801832 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:42:14.802100 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802089 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="prometheus" Jul 16 16:42:14.802141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802102 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="prometheus" Jul 16 16:42:14.802141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802115 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="thanos-sidecar" Jul 16 16:42:14.802141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802120 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="thanos-sidecar" Jul 16 16:42:14.802141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802127 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-web" Jul 16 16:42:14.802141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802133 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-web" Jul 16 16:42:14.802141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802142 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="init-config-reloader" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802148 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="init-config-reloader" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802156 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802161 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802168 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-thanos" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802174 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-thanos" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802184 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="config-reloader" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802189 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="config-reloader" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802231 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="prometheus" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802240 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-web" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802247 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="config-reloader" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802254 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="thanos-sidecar" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802259 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy" Jul 16 16:42:14.802298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.802265 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" containerName="kube-rbac-proxy-thanos" Jul 16 16:42:14.805685 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.805666 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.811437 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.811418 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h9lrs\"" Jul 16 16:42:14.811437 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.811426 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 16:42:14.811767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.811738 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-drp80lo30v30u\"" Jul 16 16:42:14.811767 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.811762 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 16:42:14.812098 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812060 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 16:42:14.812204 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812130 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 16:42:14.812204 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812138 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 16:42:14.812308 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812261 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 16:42:14.812308 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812274 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 16:42:14.812420 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812404 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 16:42:14.812570 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812553 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 16:42:14.812980 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.812958 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 16:42:14.813313 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.813299 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 16:42:14.813398 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.813319 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 16:42:14.815028 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.815010 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 16:42:14.819622 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.819601 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 16:42:14.824949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.824928 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:42:14.870166 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/690f16e0-88ea-47f2-a64b-a5287a31abcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870166 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870166 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870309 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870309 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870309 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870309 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/690f16e0-88ea-47f2-a64b-a5287a31abcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870481 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870481 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870481 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsc5p\" (UniqueName: \"kubernetes.io/projected/690f16e0-88ea-47f2-a64b-a5287a31abcb-kube-api-access-xsc5p\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870481 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870481 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-config\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870582 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870697 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.870916 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.870708 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971647 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971735 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971654 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/690f16e0-88ea-47f2-a64b-a5287a31abcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971735 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971852 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971852 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971952 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971858 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971952 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971952 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971914 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/690f16e0-88ea-47f2-a64b-a5287a31abcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.971952 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971942 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972138 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971965 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972138 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.971993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsc5p\" (UniqueName: \"kubernetes.io/projected/690f16e0-88ea-47f2-a64b-a5287a31abcb-kube-api-access-xsc5p\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972138 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972031 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972138 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972063 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-config\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972138 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972138 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972176 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.972684 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.972428 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.973414 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.974479 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.974753 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.974953 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/690f16e0-88ea-47f2-a64b-a5287a31abcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.974979 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.975118 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.975120 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.975382 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.975466 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.975391 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.976150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.975943 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.976150 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.976101 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/690f16e0-88ea-47f2-a64b-a5287a31abcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.976250 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.976230 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/690f16e0-88ea-47f2-a64b-a5287a31abcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.976865 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.976840 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.977459 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.977431 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.977565 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.977488 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.978031 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.978008 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.978215 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.978196 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.978380 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.978362 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/690f16e0-88ea-47f2-a64b-a5287a31abcb-config\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:14.983319 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:14.983297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsc5p\" (UniqueName: \"kubernetes.io/projected/690f16e0-88ea-47f2-a64b-a5287a31abcb-kube-api-access-xsc5p\") pod \"prometheus-k8s-0\" (UID: \"690f16e0-88ea-47f2-a64b-a5287a31abcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:15.120489 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:15.120443 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:15.255255 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:15.255232 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 16:42:15.257529 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:42:15.257485 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690f16e0_88ea_47f2_a64b_a5287a31abcb.slice/crio-eb98babe403bb28bc4ba1a8dede50629982a39cb1822cef82386757567214c46 WatchSource:0}: Error finding container eb98babe403bb28bc4ba1a8dede50629982a39cb1822cef82386757567214c46: Status 404 returned error can't find the container with id eb98babe403bb28bc4ba1a8dede50629982a39cb1822cef82386757567214c46 Jul 16 16:42:15.742243 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:15.742209 2566 generic.go:356] "Generic (PLEG): container finished" podID="690f16e0-88ea-47f2-a64b-a5287a31abcb" containerID="9887739eca6f62a2e6a6b5e8a4d9d8b090d4ea219da66d0d9582cc608a6d6ac8" exitCode=0 Jul 16 16:42:15.742606 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:15.742297 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerDied","Data":"9887739eca6f62a2e6a6b5e8a4d9d8b090d4ea219da66d0d9582cc608a6d6ac8"} Jul 16 16:42:15.742606 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:15.742370 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerStarted","Data":"eb98babe403bb28bc4ba1a8dede50629982a39cb1822cef82386757567214c46"} Jul 16 16:42:15.821439 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:15.821415 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c6691e-d8f1-40ef-8229-887e7b58db02" path="/var/lib/kubelet/pods/d4c6691e-d8f1-40ef-8229-887e7b58db02/volumes" Jul 16 16:42:16.751422 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:16.751379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerStarted","Data":"a58ee93a9938df1d7b61aaaddbbd724cf59b4fe8f82ec0bdb97a53d5ee197b8d"} Jul 16 16:42:16.751809 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:16.751524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerStarted","Data":"a80202838c21255904508283f8ae2c21b69d2dff8603d03eb422992806f80b85"} Jul 16 16:42:16.751809 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:16.751572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerStarted","Data":"526591b8a6ef5c5076cfe5877093a133f711a71e28c1ccf3ebd3aec910c6c07c"} Jul 16 16:42:16.751809 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:16.751611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerStarted","Data":"5189ca43d5d5f4639480e0bfc8ba43d2ba02008a7cccdbb6c9bfb539cf9ab26b"} Jul 16 16:42:16.751809 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:16.751654 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerStarted","Data":"f945d98aaa8ee96c47e3c6050d8d065355f39f81fcae6e7b88642af27ece1ba2"} Jul 16 16:42:16.751809 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:16.751690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"690f16e0-88ea-47f2-a64b-a5287a31abcb","Type":"ContainerStarted","Data":"4fa0f269a9d4366777ea660bbe5948a20e8591d6316ddc48ef37ed15e415853b"} Jul 16 16:42:16.790374 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:16.790319 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.772081902 podStartE2EDuration="2.790299116s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.217214ms" isStatefulPod=false podCreationTimestamp="2026-07-16 16:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:42:16.787679894 +0000 UTC m=+199.663907690" watchObservedRunningTime="2026-07-16 16:42:16.790299116 +0000 UTC m=+199.666526884" Jul 16 16:42:17.162371 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:17.162340 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:17.262736 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:17.262704 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:19.077921 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:19.077892 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:19.140825 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:19.140794 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:20.121218 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:20.121188 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:42:26.555471 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:26.555428 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:26.655092 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:26.655066 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:30.465819 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:30.465787 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:30.560141 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:30.560116 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:30.662044 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:30.662021 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:57.468945 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:57.468906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:42:57.539296 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:42:57.539184 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:43:15.121218 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:15.121176 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:43:15.137944 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:15.137918 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:43:16.003665 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:16.003637 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 16:43:23.196911 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:23.196843 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:43:43.367117 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:43.367090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:43:43.463733 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:43.463711 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:43:43.565269 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:43.565245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:43:51.990664 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:51.990631 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:43:57.632892 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:57.632865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/0.log" Jul 16 16:43:57.637316 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:57.637281 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 16:43:57.647424 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:43:57.647401 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/0.log" Jul 16 16:44:05.821219 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:05.821176 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:05.919830 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:05.919799 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:12.804464 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:12.804432 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:13.083459 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:13.083381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:13.290176 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:13.290126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:13.378524 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:13.378483 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:13.961336 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:13.961311 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:14.235298 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:14.235206 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:14.347706 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:14.347681 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:14.463849 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:14.463824 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:14.605892 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:14.605832 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:14.807313 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:14.807291 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:14.904447 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:14.904428 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:33.666335 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:33.666304 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:35.069058 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:35.069028 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:35.610081 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:35.610016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:44:35.687945 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:44:35.687887 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:01.705462 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:01.705382 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:01.812182 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:01.812157 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:12.526829 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:12.526798 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:12.643832 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:12.643798 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:15.236646 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:15.236614 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:15.337878 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:15.337829 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:15.455308 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:15.455255 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:15.779118 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:15.779078 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:15.877874 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:15.877842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:53.014170 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:53.014137 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:53.110623 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:53.110593 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:53.450448 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:53.450424 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:53.558056 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:53.558039 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:45:53.922367 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:45:53.922345 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:02.806335 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:02.806289 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:02.931061 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:02.931026 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:14.149132 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:14.149101 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:14.251377 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:14.251349 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:14.366069 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:14.366046 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:14.448488 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:14.448429 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:25.980628 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:25.980414 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mjcts/must-gather-k9dxj"] Jul 16 16:46:25.984821 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:25.984791 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:25.988084 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:25.988061 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mjcts\"/\"openshift-service-ca.crt\"" Jul 16 16:46:25.989322 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:25.989308 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mjcts\"/\"kube-root-ca.crt\"" Jul 16 16:46:25.989416 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:25.989398 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mjcts\"/\"default-dockercfg-rll9w\"" Jul 16 16:46:26.000923 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.000901 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mjcts/must-gather-k9dxj"] Jul 16 16:46:26.009631 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.009612 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:26.027143 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.027123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97v96\" (UniqueName: \"kubernetes.io/projected/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-kube-api-access-97v96\") pod \"must-gather-k9dxj\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:26.027228 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.027203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-must-gather-output\") pod \"must-gather-k9dxj\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:26.114440 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.114414 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:26.128583 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.128565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-must-gather-output\") pod \"must-gather-k9dxj\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:26.128660 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.128601 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97v96\" (UniqueName: \"kubernetes.io/projected/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-kube-api-access-97v96\") pod \"must-gather-k9dxj\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:26.128894 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.128877 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-must-gather-output\") pod \"must-gather-k9dxj\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:26.142077 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.142058 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97v96\" (UniqueName: \"kubernetes.io/projected/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-kube-api-access-97v96\") pod \"must-gather-k9dxj\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:26.293918 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.293869 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:26.424465 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.424409 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mjcts/must-gather-k9dxj"] Jul 16 16:46:26.426732 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:46:26.426704 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0bab2d9_1524_4ec5_ae69_5c998d7be5ab.slice/crio-68c4f6756f3473af22dbeeeddf7b3e85d1fc3b15e3a3d96a8ffb9a3d6ceedcc3 WatchSource:0}: Error finding container 68c4f6756f3473af22dbeeeddf7b3e85d1fc3b15e3a3d96a8ffb9a3d6ceedcc3: Status 404 returned error can't find the container with id 68c4f6756f3473af22dbeeeddf7b3e85d1fc3b15e3a3d96a8ffb9a3d6ceedcc3 Jul 16 16:46:26.428310 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.428290 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:46:26.695339 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:26.695307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjcts/must-gather-k9dxj" event={"ID":"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab","Type":"ContainerStarted","Data":"68c4f6756f3473af22dbeeeddf7b3e85d1fc3b15e3a3d96a8ffb9a3d6ceedcc3"} Jul 16 16:46:32.727227 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:32.727195 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjcts/must-gather-k9dxj" event={"ID":"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab","Type":"ContainerStarted","Data":"3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9"} Jul 16 16:46:32.727803 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:32.727240 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjcts/must-gather-k9dxj" event={"ID":"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab","Type":"ContainerStarted","Data":"a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d"} Jul 16 16:46:32.745780 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:32.745685 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mjcts/must-gather-k9dxj" podStartSLOduration=1.949028845 podStartE2EDuration="7.745668789s" totalImagesPullingTime="5.796639944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:46:32.745353589 +0000 UTC m=+455.621581332" watchObservedRunningTime="2026-07-16 16:46:32.745668789 +0000 UTC m=+455.621896532" Jul 16 16:46:44.776865 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:44.776834 2566 generic.go:356] "Generic (PLEG): container finished" podID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerID="a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d" exitCode=0 Jul 16 16:46:44.777247 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:44.776909 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjcts/must-gather-k9dxj" event={"ID":"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab","Type":"ContainerDied","Data":"a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d"} Jul 16 16:46:44.777247 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:44.777191 2566 scope.go:117] "RemoveContainer" containerID="a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d" Jul 16 16:46:45.352593 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.352567 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mjcts_must-gather-k9dxj_a0bab2d9-1524-4ec5-ae69-5c998d7be5ab/gather/0.log" Jul 16 16:46:45.761478 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.761452 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:45.928684 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.928659 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wp5fk/must-gather-rzgtc"] Jul 16 16:46:45.930827 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.930804 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:45.934129 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.934102 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wp5fk\"/\"default-dockercfg-tkfrp\"" Jul 16 16:46:45.934213 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.934166 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wp5fk\"/\"openshift-service-ca.crt\"" Jul 16 16:46:45.935437 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.935420 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wp5fk\"/\"kube-root-ca.crt\"" Jul 16 16:46:45.938714 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.938696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:45.943521 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.943487 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp5fk/must-gather-rzgtc"] Jul 16 16:46:45.999377 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.999355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a393166f-aba8-4ddd-a224-0df2dab95258-must-gather-output\") pod \"must-gather-rzgtc\" (UID: \"a393166f-aba8-4ddd-a224-0df2dab95258\") " pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:45.999482 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:45.999472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x4lt\" (UniqueName: \"kubernetes.io/projected/a393166f-aba8-4ddd-a224-0df2dab95258-kube-api-access-4x4lt\") pod \"must-gather-rzgtc\" (UID: \"a393166f-aba8-4ddd-a224-0df2dab95258\") " pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:46.040801 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.040725 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:46.100309 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.100274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x4lt\" (UniqueName: \"kubernetes.io/projected/a393166f-aba8-4ddd-a224-0df2dab95258-kube-api-access-4x4lt\") pod \"must-gather-rzgtc\" (UID: \"a393166f-aba8-4ddd-a224-0df2dab95258\") " pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:46.100309 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.100319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a393166f-aba8-4ddd-a224-0df2dab95258-must-gather-output\") pod \"must-gather-rzgtc\" (UID: \"a393166f-aba8-4ddd-a224-0df2dab95258\") " pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:46.100656 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.100640 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a393166f-aba8-4ddd-a224-0df2dab95258-must-gather-output\") pod \"must-gather-rzgtc\" (UID: \"a393166f-aba8-4ddd-a224-0df2dab95258\") " pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:46.110132 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.110106 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x4lt\" (UniqueName: \"kubernetes.io/projected/a393166f-aba8-4ddd-a224-0df2dab95258-kube-api-access-4x4lt\") pod \"must-gather-rzgtc\" (UID: \"a393166f-aba8-4ddd-a224-0df2dab95258\") " pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:46.239394 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.239373 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp5fk/must-gather-rzgtc" Jul 16 16:46:46.364126 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.364104 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp5fk/must-gather-rzgtc"] Jul 16 16:46:46.365876 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:46:46.365854 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda393166f_aba8_4ddd_a224_0df2dab95258.slice/crio-ee4bdceb236fb1dba8b0253858b0c5d50592cc4296c950c6e4a3db84f982bb81 WatchSource:0}: Error finding container ee4bdceb236fb1dba8b0253858b0c5d50592cc4296c950c6e4a3db84f982bb81: Status 404 returned error can't find the container with id ee4bdceb236fb1dba8b0253858b0c5d50592cc4296c950c6e4a3db84f982bb81 Jul 16 16:46:46.786142 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:46.786114 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp5fk/must-gather-rzgtc" event={"ID":"a393166f-aba8-4ddd-a224-0df2dab95258","Type":"ContainerStarted","Data":"ee4bdceb236fb1dba8b0253858b0c5d50592cc4296c950c6e4a3db84f982bb81"} Jul 16 16:46:48.795737 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:48.795196 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp5fk/must-gather-rzgtc" event={"ID":"a393166f-aba8-4ddd-a224-0df2dab95258","Type":"ContainerStarted","Data":"646da12d552cbfa04f2288aa538865a72029ea6455f85041491b3164d1ed7e31"} Jul 16 16:46:48.795737 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:48.795252 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp5fk/must-gather-rzgtc" event={"ID":"a393166f-aba8-4ddd-a224-0df2dab95258","Type":"ContainerStarted","Data":"79c94900ad732320478704904f799a59ddb2bb272a4532e40a4c0b4db25c1b19"} Jul 16 16:46:48.817752 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:48.817695 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wp5fk/must-gather-rzgtc" podStartSLOduration=1.901612295 podStartE2EDuration="3.817675835s" totalImagesPullingTime="1.91606354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:46:48.81508508 +0000 UTC m=+471.691312823" watchObservedRunningTime="2026-07-16 16:46:48.817675835 +0000 UTC m=+471.693903579" Jul 16 16:46:49.874490 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:49.874460 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kmj9t_97c50344-aced-4b14-8860-661ae2c20d59/global-pull-secret-syncer/0.log" Jul 16 16:46:49.979288 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:49.979262 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" Jul 16 16:46:50.102982 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:50.102952 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-195.ec2.internal_5c16a73d284a64f53cba0169247e9921/haproxy/0.log" Jul 16 16:46:50.735991 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:50.735955 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-mjcts/must-gather-k9dxj"] Jul 16 16:46:50.736165 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:50.736125 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-mjcts/must-gather-k9dxj" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerName="copy" containerID="cri-o://3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9" gracePeriod=2 Jul 16 16:46:50.738915 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:46:50.738885 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k9dxj\" is forbidden: User \"system:node:ip-10-0-141-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mjcts\": no relationship found between node 'ip-10-0-141-195.ec2.internal' and this object" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:50.740391 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:50.740171 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-mjcts/must-gather-k9dxj"] Jul 16 16:46:50.992891 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:50.992829 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mjcts_must-gather-k9dxj_a0bab2d9-1524-4ec5-ae69-5c998d7be5ab/copy/0.log" Jul 16 16:46:51.010519 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.009719 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:51.012828 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:46:51.012569 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k9dxj\" is forbidden: User \"system:node:ip-10-0-141-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mjcts\": no relationship found between node 'ip-10-0-141-195.ec2.internal' and this object" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:51.142627 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.142586 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97v96\" (UniqueName: \"kubernetes.io/projected/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-kube-api-access-97v96\") pod \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " Jul 16 16:46:51.142825 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.142687 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-must-gather-output\") pod \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\" (UID: \"a0bab2d9-1524-4ec5-ae69-5c998d7be5ab\") " Jul 16 16:46:51.143381 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.143350 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" (UID: "a0bab2d9-1524-4ec5-ae69-5c998d7be5ab"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:46:51.153672 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.153007 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-kube-api-access-97v96" (OuterVolumeSpecName: "kube-api-access-97v96") pod "a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" (UID: "a0bab2d9-1524-4ec5-ae69-5c998d7be5ab"). InnerVolumeSpecName "kube-api-access-97v96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:46:51.243905 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.243813 2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-must-gather-output\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:46:51.243905 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.243856 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97v96\" (UniqueName: \"kubernetes.io/projected/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab-kube-api-access-97v96\") on node \"ip-10-0-141-195.ec2.internal\" DevicePath \"\"" Jul 16 16:46:51.794606 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.794572 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:51.811908 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.811814 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mjcts_must-gather-k9dxj_a0bab2d9-1524-4ec5-ae69-5c998d7be5ab/copy/0.log" Jul 16 16:46:51.812551 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.812422 2566 generic.go:356] "Generic (PLEG): container finished" podID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerID="3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9" exitCode=143 Jul 16 16:46:51.812551 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.812491 2566 scope.go:117] "RemoveContainer" containerID="3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9" Jul 16 16:46:51.812710 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.812631 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:51.816736 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:46:51.816692 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k9dxj\" is forbidden: User \"system:node:ip-10-0-141-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mjcts\": no relationship found between node 'ip-10-0-141-195.ec2.internal' and this object" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" pod="openshift-must-gather-mjcts/must-gather-k9dxj" Jul 16 16:46:51.825901 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.825607 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" path="/var/lib/kubelet/pods/a0bab2d9-1524-4ec5-ae69-5c998d7be5ab/volumes" Jul 16 16:46:51.833673 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.830842 2566 scope.go:117] "RemoveContainer" containerID="a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d" Jul 16 16:46:51.852869 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.852647 2566 scope.go:117] "RemoveContainer" containerID="3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9" Jul 16 16:46:51.853435 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:46:51.853077 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9\": container with ID starting with 3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9 not found: ID does not exist" containerID="3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9" Jul 16 16:46:51.853435 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.853109 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9"} err="failed to get container status \"3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9\": rpc error: code = NotFound desc = could not find container \"3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9\": container with ID starting with 3648ed0682469df77a7e4b99bbf6bcb78395c5393c46bc8b39231ff4fab3e8e9 not found: ID does not exist" Jul 16 16:46:51.853435 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.853134 2566 scope.go:117] "RemoveContainer" containerID="a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d" Jul 16 16:46:51.853435 ip-10-0-141-195 kubenswrapper[2566]: E0716 16:46:51.853364 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d\": container with ID starting with a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d not found: ID does not exist" containerID="a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d" Jul 16 16:46:51.853435 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.853387 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d"} err="failed to get container status \"a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d\": rpc error: code = NotFound desc = could not find container \"a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d\": container with ID starting with a8680f768a1506de8a557423def8766493826021be8e297c16962a1127d0162d not found: ID does not exist" Jul 16 16:46:51.862750 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:51.862615 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5r6xt_13e7bbbe-ca22-427b-a6ce-2d3c134b7194/konnectivity-agent/0.log" limit=1024 Jul 16 16:46:54.120935 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.120864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e3230fe-015d-483e-bc17-fa6e5747988a/alertmanager/0.log" Jul 16 16:46:54.147523 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.147488 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e3230fe-015d-483e-bc17-fa6e5747988a/config-reloader/0.log" Jul 16 16:46:54.173837 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.173809 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e3230fe-015d-483e-bc17-fa6e5747988a/kube-rbac-proxy-web/0.log" Jul 16 16:46:54.201031 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.201003 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e3230fe-015d-483e-bc17-fa6e5747988a/kube-rbac-proxy/0.log" Jul 16 16:46:54.223659 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.223628 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e3230fe-015d-483e-bc17-fa6e5747988a/kube-rbac-proxy-metric/0.log" Jul 16 16:46:54.249427 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.249399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e3230fe-015d-483e-bc17-fa6e5747988a/prom-label-proxy/0.log" Jul 16 16:46:54.291488 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.291442 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2e3230fe-015d-483e-bc17-fa6e5747988a/init-config-reloader/0.log" Jul 16 16:46:54.371000 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.370930 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2ttqw_71fb56ce-3e40-446c-ae99-f336291413bd/kube-state-metrics/0.log" Jul 16 16:46:54.395800 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.395768 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2ttqw_71fb56ce-3e40-446c-ae99-f336291413bd/kube-rbac-proxy-main/0.log" Jul 16 16:46:54.424685 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.424655 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2ttqw_71fb56ce-3e40-446c-ae99-f336291413bd/kube-rbac-proxy-self/0.log" Jul 16 16:46:54.458434 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.458404 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d699f5d5f-m4nmb_9e1ea8b5-fae2-4abf-9c52-826c0c506d63/metrics-server/0.log" Jul 16 16:46:54.490389 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.490348 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-kwc2l_f46102dc-30e6-4084-acc3-528d228025c1/monitoring-plugin/0.log" Jul 16 16:46:54.748833 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.748796 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z7znj_7f8bf7da-b0ec-414f-a0b1-70b240300874/node-exporter/0.log" Jul 16 16:46:54.775417 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.775389 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z7znj_7f8bf7da-b0ec-414f-a0b1-70b240300874/kube-rbac-proxy/0.log" Jul 16 16:46:54.799535 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.799499 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z7znj_7f8bf7da-b0ec-414f-a0b1-70b240300874/init-textfile/0.log" Jul 16 16:46:54.928087 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.928055 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_690f16e0-88ea-47f2-a64b-a5287a31abcb/prometheus/0.log" Jul 16 16:46:54.949792 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.949764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_690f16e0-88ea-47f2-a64b-a5287a31abcb/config-reloader/0.log" Jul 16 16:46:54.975692 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:54.975667 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_690f16e0-88ea-47f2-a64b-a5287a31abcb/thanos-sidecar/0.log" Jul 16 16:46:55.013668 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:55.013577 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_690f16e0-88ea-47f2-a64b-a5287a31abcb/kube-rbac-proxy-web/0.log" Jul 16 16:46:55.050422 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:55.050385 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_690f16e0-88ea-47f2-a64b-a5287a31abcb/kube-rbac-proxy/0.log" Jul 16 16:46:55.084654 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:55.084603 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_690f16e0-88ea-47f2-a64b-a5287a31abcb/kube-rbac-proxy-thanos/0.log" Jul 16 16:46:55.118122 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:55.118069 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_690f16e0-88ea-47f2-a64b-a5287a31abcb/init-config-reloader/0.log" Jul 16 16:46:55.235972 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:55.235901 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-cggs7_ba653f21-6817-4674-a9ef-1f9674ad95bd/prometheus-operator-admission-webhook/0.log" Jul 16 16:46:56.530782 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:56.530752 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-dc2hv_3d5ae5ec-98db-4f79-9156-c4a4116e60ea/networking-console-plugin/0.log" Jul 16 16:46:57.435906 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.435872 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv"] Jul 16 16:46:57.436360 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.436334 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerName="copy" Jul 16 16:46:57.436416 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.436363 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerName="copy" Jul 16 16:46:57.436416 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.436385 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerName="gather" Jul 16 16:46:57.436416 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.436393 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerName="gather" Jul 16 16:46:57.436614 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.436489 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerName="copy" Jul 16 16:46:57.436614 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.436530 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0bab2d9-1524-4ec5-ae69-5c998d7be5ab" containerName="gather" Jul 16 16:46:57.441111 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.441089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.495949 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.495916 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv"] Jul 16 16:46:57.601598 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.601570 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-sys\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.602019 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.601608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgcq6\" (UniqueName: \"kubernetes.io/projected/46e01dba-5694-4557-8ac6-15c521c35c8a-kube-api-access-xgcq6\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.602019 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.601697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-lib-modules\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.602019 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.601721 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-proc\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.602019 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.601785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-podres\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.676997 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.676970 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-r6hp4_859b2b61-1446-4a6f-8942-db25062c1339/download-server/0.log" Jul 16 16:46:57.702770 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.702706 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-proc\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.702864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.702770 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-podres\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.702864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.702832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-sys\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.702935 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.702862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgcq6\" (UniqueName: \"kubernetes.io/projected/46e01dba-5694-4557-8ac6-15c521c35c8a-kube-api-access-xgcq6\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.702935 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.702875 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-sys\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.702935 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.702875 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-podres\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.702935 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.702831 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-proc\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.703072 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.703057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-lib-modules\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.703166 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.703155 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46e01dba-5694-4557-8ac6-15c521c35c8a-lib-modules\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.717312 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.717286 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgcq6\" (UniqueName: \"kubernetes.io/projected/46e01dba-5694-4557-8ac6-15c521c35c8a-kube-api-access-xgcq6\") pod \"perf-node-gather-daemonset-48pcv\" (UID: \"46e01dba-5694-4557-8ac6-15c521c35c8a\") " pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.753864 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.753832 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:57.905887 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:57.905774 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv"] Jul 16 16:46:57.907949 ip-10-0-141-195 kubenswrapper[2566]: W0716 16:46:57.907917 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod46e01dba_5694_4557_8ac6_15c521c35c8a.slice/crio-a5e72806ec94e0c35f6156988981503d1a877e3618b5873e655a2ad3b373febb WatchSource:0}: Error finding container a5e72806ec94e0c35f6156988981503d1a877e3618b5873e655a2ad3b373febb: Status 404 returned error can't find the container with id a5e72806ec94e0c35f6156988981503d1a877e3618b5873e655a2ad3b373febb Jul 16 16:46:58.852368 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:58.852326 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" event={"ID":"46e01dba-5694-4557-8ac6-15c521c35c8a","Type":"ContainerStarted","Data":"de5a912b53bcb0d2a887831ff7d63eb1238f6b71b0b1b09cf309357c4e06f65b"} Jul 16 16:46:58.852833 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:58.852390 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" event={"ID":"46e01dba-5694-4557-8ac6-15c521c35c8a","Type":"ContainerStarted","Data":"a5e72806ec94e0c35f6156988981503d1a877e3618b5873e655a2ad3b373febb"} Jul 16 16:46:58.852833 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:58.852417 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:46:58.874094 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:58.874037 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" podStartSLOduration=1.8740193600000001 podStartE2EDuration="1.87401936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:46:58.871778384 +0000 UTC m=+481.748006123" watchObservedRunningTime="2026-07-16 16:46:58.87401936 +0000 UTC m=+481.750247104" Jul 16 16:46:59.245035 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:59.245008 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6x6r_c86df681-3549-4fab-90e5-1316361b3e37/dns/0.log" Jul 16 16:46:59.268329 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:59.268297 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6x6r_c86df681-3549-4fab-90e5-1316361b3e37/kube-rbac-proxy/0.log" Jul 16 16:46:59.340385 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:59.340360 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gr27j_b94b15c8-a383-4478-bd05-012b50ddb4c9/dns-node-resolver/0.log" Jul 16 16:46:59.794301 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:46:59.794276 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6d69r_498957fb-acdd-4109-84a6-e50e4d40c0a1/node-ca/0.log" Jul 16 16:47:00.964278 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:00.964253 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhq9c_b8e52341-d9ec-45be-a0aa-0b2874c54545/serve-healthcheck-canary/0.log" Jul 16 16:47:01.459216 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:01.459187 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lf5gl_4861afaa-f679-4248-b832-c32809715310/kube-rbac-proxy/0.log" Jul 16 16:47:01.508449 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:01.508420 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lf5gl_4861afaa-f679-4248-b832-c32809715310/exporter/0.log" Jul 16 16:47:01.542449 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:01.542423 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lf5gl_4861afaa-f679-4248-b832-c32809715310/extractor/0.log" Jul 16 16:47:04.864526 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:04.864473 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wp5fk/perf-node-gather-daemonset-48pcv" Jul 16 16:47:06.911605 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:06.911574 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fxf27_b1c574e5-b1ad-4327-badd-1613e78c02b1/migrator/0.log" Jul 16 16:47:06.944617 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:06.944577 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fxf27_b1c574e5-b1ad-4327-badd-1613e78c02b1/graceful-termination/0.log" Jul 16 16:47:08.721937 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.721911 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xzsh6_3e0af0e0-bc91-4fe2-ad71-38f68975f024/kube-multus-additional-cni-plugins/0.log" Jul 16 16:47:08.749988 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.749921 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xzsh6_3e0af0e0-bc91-4fe2-ad71-38f68975f024/egress-router-binary-copy/0.log" Jul 16 16:47:08.774033 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.774011 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xzsh6_3e0af0e0-bc91-4fe2-ad71-38f68975f024/cni-plugins/0.log" Jul 16 16:47:08.798349 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.798324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xzsh6_3e0af0e0-bc91-4fe2-ad71-38f68975f024/bond-cni-plugin/0.log" Jul 16 16:47:08.824715 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.824634 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xzsh6_3e0af0e0-bc91-4fe2-ad71-38f68975f024/routeoverride-cni/0.log" Jul 16 16:47:08.857006 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.856982 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xzsh6_3e0af0e0-bc91-4fe2-ad71-38f68975f024/whereabouts-cni-bincopy/0.log" Jul 16 16:47:08.883159 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.883140 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xzsh6_3e0af0e0-bc91-4fe2-ad71-38f68975f024/whereabouts-cni/0.log" Jul 16 16:47:08.915960 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:08.915935 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fb244_5909f75c-6cdc-4fc3-b1f9-27ffa33d76d9/kube-multus/0.log" Jul 16 16:47:09.097796 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:09.097724 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmhth_68db2a89-b8a8-48e1-86f8-cf3a82a73c0c/network-metrics-daemon/0.log" Jul 16 16:47:09.118364 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:09.118338 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmhth_68db2a89-b8a8-48e1-86f8-cf3a82a73c0c/kube-rbac-proxy/0.log" Jul 16 16:47:10.072375 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.072343 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-controller/0.log" Jul 16 16:47:10.095479 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.095452 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/1.log" Jul 16 16:47:10.095649 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.095553 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovn-acl-logging/0.log" Jul 16 16:47:10.115320 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.115300 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/kube-rbac-proxy-node/0.log" Jul 16 16:47:10.143587 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.143567 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 16:47:10.166192 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.166175 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/northd/0.log" Jul 16 16:47:10.202488 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.202454 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/nbdb/0.log" Jul 16 16:47:10.227054 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.227023 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/sbdb/0.log" Jul 16 16:47:10.270778 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:10.270760 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkf9_5f0ae342-aebb-4dc2-956c-359d800ea9c4/ovnkube-controller/0.log" Jul 16 16:47:11.459254 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:11.459228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qlfdh_68284f0c-6366-4695-9567-e6e1957ed8eb/network-check-target-container/0.log" Jul 16 16:47:12.391925 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:12.391903 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vsfqg_bb2918fc-1a74-4f6a-8eac-48bd9ad7199a/iptables-alerter/0.log" Jul 16 16:47:13.098913 ip-10-0-141-195 kubenswrapper[2566]: I0716 16:47:13.098884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5zhgd_748b6668-c372-4f86-b186-4ea2d6fc3e7f/tuned/0.log"