Jul 28 00:01:49.748895 ip-10-0-136-51 systemd[1]: Starting Kubernetes Kubelet... Jul 28 00:01:50.134993 ip-10-0-136-51 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:50.134993 ip-10-0-136-51 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 00:01:50.134993 ip-10-0-136-51 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:50.134993 ip-10-0-136-51 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 00:01:50.134993 ip-10-0-136-51 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:50.137002 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.136882 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 00:01:50.142547 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142529 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:50.142547 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142545 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:50.142547 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142549 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142552 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142556 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142570 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142573 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142583 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142586 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142591 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142593 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142596 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142599 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142601 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142604 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142607 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142609 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142612 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142615 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142618 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142620 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142623 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:50.142659 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142626 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142628 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142631 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142634 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142637 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142639 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142642 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142644 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142648 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142650 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142653 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142655 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142658 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142660 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142663 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142666 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142669 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142672 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142675 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142677 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:50.143133 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142680 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142683 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142685 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142687 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142690 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142692 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142695 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142697 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142700 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142702 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142705 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142707 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142709 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142712 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142716 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142718 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142721 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142724 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142726 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142729 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:50.143678 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142731 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142733 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142736 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142738 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142741 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142746 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142750 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142753 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142756 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142758 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142761 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142768 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142772 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142775 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142779 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142782 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142786 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142788 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142791 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:50.144294 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142794 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142797 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142799 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142802 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142805 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142807 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142810 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142814 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142817 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142819 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142822 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142825 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142827 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142830 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142833 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142835 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142838 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.142841 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143548 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143555 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:50.145000 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143572 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143577 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143581 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143585 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143590 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143594 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143597 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143599 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143602 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143605 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143607 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143610 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143613 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143616 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143618 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143621 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143624 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143629 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143633 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143637 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:50.145490 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143640 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143643 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143646 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143649 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143651 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143654 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143657 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143661 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143663 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143666 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143669 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143672 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143675 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143677 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143680 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143683 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143686 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143688 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143691 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:50.146006 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143694 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143697 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143701 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143704 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143707 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143710 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143713 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143715 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143718 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143721 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143723 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143726 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143730 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143733 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143736 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143738 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143741 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143744 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143747 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:50.146494 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143749 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143752 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143755 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143757 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.143760 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144057 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144068 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144073 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144078 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144083 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144088 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144093 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144097 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144113 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144118 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144123 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144128 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144139 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144143 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144146 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:50.146999 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144150 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144155 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144159 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144163 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144167 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144171 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144176 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144180 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144184 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144189 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144197 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144202 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144206 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144211 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144215 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144219 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144223 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144227 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.144232 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:50.147504 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145244 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145256 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145263 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145268 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145274 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145277 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145280 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145283 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145285 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145288 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145291 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145293 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145297 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145299 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145302 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145304 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145307 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145310 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145312 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:50.147992 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145315 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145317 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145320 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145322 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145325 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145328 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145331 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145333 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145341 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145344 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145347 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145349 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145352 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145355 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145358 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145360 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145363 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145365 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145368 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145371 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:50.148450 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145373 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145376 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145379 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145381 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145384 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145386 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145389 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145392 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145394 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145397 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145399 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145402 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145405 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145407 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145410 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145413 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145416 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145419 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145422 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145425 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:50.148957 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145428 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145432 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145435 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145438 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145441 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145443 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145446 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145448 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145451 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145453 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145456 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145459 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145461 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145463 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145467 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145469 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145472 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145474 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145476 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145479 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:50.149430 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145482 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145484 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145488 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145490 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145493 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145496 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145499 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145502 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145505 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145508 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145511 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145515 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145519 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145522 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145525 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145527 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145533 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145536 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145538 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.145541 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:50.150080 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145637 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145644 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145651 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145656 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145660 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145664 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145668 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145672 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145676 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145679 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145682 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145686 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145689 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145692 2567 flags.go:64] FLAG: --cgroup-root="" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145695 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145699 2567 flags.go:64] FLAG: --client-ca-file="" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145702 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145706 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145710 2567 flags.go:64] FLAG: --cluster-domain="" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145713 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145716 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145720 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145724 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145728 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 00:01:50.150575 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145731 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145734 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145738 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145741 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145746 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145749 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145752 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145755 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145759 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145762 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145765 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145768 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145771 2567 flags.go:64] FLAG: --enable-server="true" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145774 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145778 2567 flags.go:64] FLAG: --event-burst="100" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145781 2567 flags.go:64] FLAG: --event-qps="50" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145784 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145787 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145790 2567 flags.go:64] FLAG: --eviction-hard="" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145794 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145797 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145800 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145802 2567 flags.go:64] FLAG: --eviction-soft="" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145805 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145809 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 00:01:50.151157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145812 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145815 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145818 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145821 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145824 2567 flags.go:64] FLAG: --feature-gates="" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145828 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145831 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145834 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145837 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145840 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145843 2567 flags.go:64] FLAG: --help="false" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145847 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145850 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145853 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145857 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145860 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145864 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145867 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145870 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145873 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145876 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145879 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145882 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145885 2567 flags.go:64] FLAG: --kube-reserved="" Jul 28 00:01:50.151870 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145888 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145891 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145894 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145896 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145899 2567 flags.go:64] FLAG: --lock-file="" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145902 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145906 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145909 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145924 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145927 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145930 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145933 2567 flags.go:64] FLAG: --logging-format="text" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145937 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145940 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145943 2567 flags.go:64] FLAG: --manifest-url="" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145946 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145951 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145954 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145959 2567 flags.go:64] FLAG: --max-pods="110" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145963 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145966 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145969 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145972 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145975 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145978 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 00:01:50.152891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145981 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145988 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145991 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145994 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145997 2567 flags.go:64] FLAG: --pod-cidr="" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.145999 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146006 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146010 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146013 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146016 2567 flags.go:64] FLAG: --port="10250" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146019 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146022 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0da6aafe068c11388" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146026 2567 flags.go:64] FLAG: --qos-reserved="" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146029 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146031 2567 flags.go:64] FLAG: --register-node="true" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146034 2567 flags.go:64] FLAG: --register-with-taints="" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146038 2567 flags.go:64] FLAG: --registry-burst="10" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146041 2567 flags.go:64] FLAG: --registry-qps="5" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146044 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146048 2567 flags.go:64] FLAG: --reserved-memory="" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146052 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146055 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146058 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146061 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146064 2567 flags.go:64] FLAG: --runonce="false" Jul 28 00:01:50.153966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146067 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146070 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146079 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146082 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146085 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146088 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146091 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146095 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146098 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146101 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146103 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146106 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146109 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146112 2567 flags.go:64] FLAG: --system-cgroups="" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146115 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146121 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146124 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146127 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146131 2567 flags.go:64] FLAG: --tls-min-version="" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146134 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146137 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146140 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146143 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146146 2567 flags.go:64] FLAG: --v="2" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146155 2567 flags.go:64] FLAG: --version="false" Jul 28 00:01:50.154791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146159 2567 flags.go:64] FLAG: --vmodule="" Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146164 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146168 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146282 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146286 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146289 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146292 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146295 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146298 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146302 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146305 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146308 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146311 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146314 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146316 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146319 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146322 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146324 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146327 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146329 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:50.155666 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146332 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146335 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146337 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146339 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146344 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146347 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146350 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146353 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146355 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146358 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146361 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146364 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146367 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146372 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146374 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146378 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146380 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146383 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146385 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:50.156509 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146388 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146390 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146394 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146397 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146401 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146404 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146407 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146410 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146413 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146415 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146418 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146420 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146423 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146426 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146428 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146430 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146433 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146436 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146438 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:50.157061 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146441 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146444 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146446 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146449 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146452 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146454 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146457 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146461 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146464 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146466 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146469 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146471 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146474 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146476 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146479 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146483 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146486 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146489 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146493 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146496 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:50.157878 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146499 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146502 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146504 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146507 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146510 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146513 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146515 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146518 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146520 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146523 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146525 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146528 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146530 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146533 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146535 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146538 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146540 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146543 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146545 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146549 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:50.158705 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146552 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146555 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146557 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.146577 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.146584 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.154235 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.154255 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.155113 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.155128 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155222 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155230 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155235 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155241 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155247 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:50.159200 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155251 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155256 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155261 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155266 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155270 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155275 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155279 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155283 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155287 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155292 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155296 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155301 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155306 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155310 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155315 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155320 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155324 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155329 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155333 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155337 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:50.159780 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155342 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155346 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155350 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155355 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155361 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155366 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155371 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155375 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155380 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155384 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155388 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155392 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155397 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155401 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155405 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155410 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155414 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155418 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155422 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155426 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:50.160293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155430 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155435 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155439 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155452 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155456 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155461 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155465 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155469 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155475 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155481 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155485 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155489 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155494 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155498 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155502 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155506 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155512 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155518 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155522 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:50.160805 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155527 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155531 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155538 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155544 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155549 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155555 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155574 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155579 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155583 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155588 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155591 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155596 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155600 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155604 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155608 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155613 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155618 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155622 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155626 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155630 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:50.161321 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155634 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155639 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155643 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155647 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155651 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155655 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155659 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155663 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155667 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155672 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155676 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155690 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155696 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155701 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155707 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:50.161912 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.155715 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155902 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155911 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155916 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155921 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155925 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155929 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155934 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155938 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155943 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155947 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155951 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155956 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155960 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155964 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155968 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155972 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155977 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155980 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155985 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:50.162293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155989 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155993 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.155998 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156002 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156006 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156010 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156015 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156020 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156024 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156030 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156034 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156038 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156042 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156047 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156051 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156055 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156062 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156068 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156073 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156077 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:50.162827 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156082 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156087 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156091 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156096 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156101 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156105 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156109 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156115 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156120 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156126 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156131 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156135 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156139 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156144 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156148 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156152 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156156 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156161 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156166 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:50.163519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156171 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156175 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156179 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156185 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156189 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156194 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156198 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156203 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156207 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156211 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156215 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156219 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156224 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156228 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156232 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156236 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156241 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156245 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156249 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156253 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:50.164293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156257 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156261 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156265 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156269 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156274 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156278 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156282 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156287 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156291 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156296 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156300 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156305 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156310 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156314 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156318 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156323 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156328 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156333 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156337 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:50.164962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156343 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:50.156348 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.156356 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.156521 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.159337 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.160858 2567 server.go:1019] "Starting client certificate rotation" Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.160970 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.161004 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:01:50.165434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.163753 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:01:50.166305 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.166291 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:01:50.176060 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.176044 2567 log.go:25] "Validated CRI v1 runtime API" Jul 28 00:01:50.178340 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.178324 2567 log.go:25] "Validated CRI v1 image API" Jul 28 00:01:50.179157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.179123 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 00:01:50.182502 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.182477 2567 fs.go:135] Filesystem UUIDs: map[0a9e7ecf-8bf9-4cda-af65-ae33a63936a4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a8748122-723c-495c-9f04-dc0c56ddd8eb:/dev/nvme0n1p3] Jul 28 00:01:50.182578 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.182502 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 00:01:50.188704 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.188591 2567 manager.go:216] Machine: {Timestamp:2026-07-28 00:01:50.187342849 +0000 UTC m=+0.322199071 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099971 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f6e483943e3ee8fb34a4e986ea0d SystemUUID:ec24f6e4-8394-3e3e-e8fb-34a4e986ea0d BootID:1e3b3180-e8e5-4b7c-8537-359e02f97f77 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7b:c1:12:85:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7b:c1:12:85:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:59:90:aa:94:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 00:01:50.188704 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.188692 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 00:01:50.188865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.188776 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 00:01:50.190633 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.190615 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:01:50.191865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.191839 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 00:01:50.191999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.191869 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-51.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 00:01:50.192530 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.192520 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 00:01:50.192596 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.192538 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 00:01:50.192596 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.192554 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:01:50.193182 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.193170 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:01:50.194416 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.194405 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 00:01:50.197060 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197048 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:01:50.197185 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197175 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 00:01:50.197217 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197207 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 28 00:01:50.197268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197221 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 00:01:50.197268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197240 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 00:01:50.197268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197255 2567 kubelet.go:398] "Adding apiserver pod source" Jul 28 00:01:50.197268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197267 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 00:01:50.197631 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197619 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:01:50.197670 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.197638 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:01:50.199888 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.199872 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 00:01:50.201644 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.201629 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 00:01:50.201698 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.201660 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 00:01:50.202655 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202643 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 00:01:50.202691 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202660 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 00:01:50.202691 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202666 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 00:01:50.202691 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202672 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 00:01:50.202691 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202682 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 00:01:50.202691 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202688 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 00:01:50.202829 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202697 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 00:01:50.202829 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202703 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 00:01:50.202829 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202709 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 00:01:50.202829 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202715 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 00:01:50.202829 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202723 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 00:01:50.202829 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.202730 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 00:01:50.203332 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.203323 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 00:01:50.203332 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.203332 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 00:01:50.206633 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.206618 2567 server.go:1268] "Started kubelet" Jul 28 00:01:50.206708 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.206683 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 00:01:50.206752 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.206702 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 00:01:50.206784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.206772 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 00:01:50.207500 ip-10-0-136-51 systemd[1]: Started Kubernetes Kubelet. Jul 28 00:01:50.208010 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.207992 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 00:01:50.208791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.208743 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 28 00:01:50.212066 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.212043 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-51.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 00:01:50.212158 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.212038 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 00:01:50.212158 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.212121 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 00:01:50.212413 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.212392 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbjcd" Jul 28 00:01:50.213265 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.212328 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-51.ec2.internal.18c64b21a6fd1fa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-51.ec2.internal,UID:ip-10-0-136-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-51.ec2.internal,},FirstTimestamp:2026-07-28 00:01:50.206590881 +0000 UTC m=+0.341447104,LastTimestamp:2026-07-28 00:01:50.206590881 +0000 UTC m=+0.341447104,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-51.ec2.internal,}" Jul 28 00:01:50.214145 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.214125 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 00:01:50.215452 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.215431 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 00:01:50.215523 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.215453 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 00:01:50.215646 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.215606 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.216088 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216072 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 00:01:50.216185 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216132 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 00:01:50.216185 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216148 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 00:01:50.216282 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216192 2567 factory.go:55] Registering systemd factory Jul 28 00:01:50.216282 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216207 2567 factory.go:223] Registration of the systemd container factory successfully Jul 28 00:01:50.216417 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216400 2567 factory.go:153] Registering CRI-O factory Jul 28 00:01:50.216502 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216421 2567 factory.go:223] Registration of the crio container factory successfully Jul 28 00:01:50.216502 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216472 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 00:01:50.216502 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216495 2567 factory.go:103] Registering Raw factory Jul 28 00:01:50.216627 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.216509 2567 manager.go:1196] Started watching for new ooms in manager Jul 28 00:01:50.217187 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.217174 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 28 00:01:50.217187 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.217185 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 28 00:01:50.217483 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.217470 2567 manager.go:349] Starting recovery of all containers Jul 28 00:01:50.222699 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.222663 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbjcd" Jul 28 00:01:50.228257 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.228134 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 00:01:50.228257 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.228160 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 00:01:50.228753 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.228736 2567 manager.go:354] Recovery completed Jul 28 00:01:50.233298 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.233183 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:50.235254 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.235234 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:50.235310 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.235271 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:50.235310 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.235283 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:50.235953 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.235941 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 00:01:50.235953 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.235955 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 00:01:50.236048 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.235944 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:50.236048 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.235970 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:01:50.236619 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.236601 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:50.236687 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.236639 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:50.236687 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.236653 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:50.237083 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.237071 2567 policy_none.go:49] "None policy: Start" Jul 28 00:01:50.237129 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.237087 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 00:01:50.237129 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.237098 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 00:01:50.238145 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.238134 2567 policy_none.go:47] "Start" Jul 28 00:01:50.274144 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.274122 2567 manager.go:337] "Starting Device Plugin manager" Jul 28 00:01:50.274261 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.274163 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 00:01:50.274261 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.274177 2567 server.go:87] "Starting device plugin registration server" Jul 28 00:01:50.274463 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.274449 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 00:01:50.274528 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.274464 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 00:01:50.274602 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.274581 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 00:01:50.274784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.274771 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 00:01:50.274784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.274784 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 00:01:50.275358 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.275338 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 00:01:50.275460 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.275384 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.375073 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.375024 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:50.376771 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.376752 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:50.376885 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.376785 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:50.376885 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.376798 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:50.376885 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.376825 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.386501 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.386450 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.386501 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.386472 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-51.ec2.internal\": node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.403132 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.403110 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.423398 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.423351 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 00:01:50.424617 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.424601 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 00:01:50.424700 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.424660 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 00:01:50.424700 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.424691 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 00:01:50.424781 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.424726 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 00:01:50.428034 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.428014 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:50.503719 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.503664 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.525874 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.525835 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal"] Jul 28 00:01:50.525994 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.525943 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:50.527745 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.527725 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:50.527871 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.527762 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:50.527871 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.527776 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:50.529212 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.529198 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:50.529367 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.529352 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.529412 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.529383 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:50.530372 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.530348 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:50.530474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.530378 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:50.530474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.530388 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:50.530474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.530349 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:50.530474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.530457 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:50.530474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.530472 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:50.532048 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.532025 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.532147 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.532055 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:50.533804 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.533785 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:50.533916 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.533831 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:50.533916 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.533845 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:50.559496 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.559470 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-51.ec2.internal\" not found" node="ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.564168 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.564151 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-51.ec2.internal\" not found" node="ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.604008 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.603980 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.619306 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.619277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0bc73864478fe04fd42a7533b7864e77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal\" (UID: \"0bc73864478fe04fd42a7533b7864e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.619374 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.619313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bc73864478fe04fd42a7533b7864e77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal\" (UID: \"0bc73864478fe04fd42a7533b7864e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.619374 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.619332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78e50d64494b0564c66b772f1fad8aca-config\") pod \"kube-apiserver-proxy-ip-10-0-136-51.ec2.internal\" (UID: \"78e50d64494b0564c66b772f1fad8aca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.704800 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.704715 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.720339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.720308 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0bc73864478fe04fd42a7533b7864e77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal\" (UID: \"0bc73864478fe04fd42a7533b7864e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.720408 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.720269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0bc73864478fe04fd42a7533b7864e77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal\" (UID: \"0bc73864478fe04fd42a7533b7864e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.720408 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.720378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bc73864478fe04fd42a7533b7864e77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal\" (UID: \"0bc73864478fe04fd42a7533b7864e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.720408 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.720397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78e50d64494b0564c66b772f1fad8aca-config\") pod \"kube-apiserver-proxy-ip-10-0-136-51.ec2.internal\" (UID: \"78e50d64494b0564c66b772f1fad8aca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.720511 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.720424 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78e50d64494b0564c66b772f1fad8aca-config\") pod \"kube-apiserver-proxy-ip-10-0-136-51.ec2.internal\" (UID: \"78e50d64494b0564c66b772f1fad8aca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.720511 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.720451 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bc73864478fe04fd42a7533b7864e77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal\" (UID: \"0bc73864478fe04fd42a7533b7864e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.811400 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.811369 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:50.863850 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.863820 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.868039 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:50.867795 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" Jul 28 00:01:50.911531 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:50.911492 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:51.016260 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:51.016192 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:51.116571 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:51.116534 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:51.162149 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.162117 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 00:01:51.162670 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.162308 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 00:01:51.217020 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:51.216992 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-51.ec2.internal\" not found" Jul 28 00:01:51.227993 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.227959 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 23:56:50 +0000 UTC" deadline="2028-03-08 19:38:59.322391749 +0000 UTC" Jul 28 00:01:51.227993 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.227988 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14155h37m8.094407149s" Jul 28 00:01:51.301689 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.301613 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:51.305324 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.305304 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:51.315625 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.315602 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" Jul 28 00:01:51.329651 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.329626 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:01:51.331732 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.331716 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" Jul 28 00:01:51.341098 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.341074 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:01:51.454071 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:51.454036 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc73864478fe04fd42a7533b7864e77.slice/crio-59155472ee719de6697e47e78123d50dab334b96fab2fd4f18ac60b0380c5e1b WatchSource:0}: Error finding container 59155472ee719de6697e47e78123d50dab334b96fab2fd4f18ac60b0380c5e1b: Status 404 returned error can't find the container with id 59155472ee719de6697e47e78123d50dab334b96fab2fd4f18ac60b0380c5e1b Jul 28 00:01:51.460279 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.460261 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:01:51.553111 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:51.553039 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e50d64494b0564c66b772f1fad8aca.slice/crio-849a12ad59ffcd55fcbe1d7a890baf436df8ae7acd986cbe353e1b056eac6c2e WatchSource:0}: Error finding container 849a12ad59ffcd55fcbe1d7a890baf436df8ae7acd986cbe353e1b056eac6c2e: Status 404 returned error can't find the container with id 849a12ad59ffcd55fcbe1d7a890baf436df8ae7acd986cbe353e1b056eac6c2e Jul 28 00:01:51.810859 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:51.810776 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:52.200286 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.200203 2567 apiserver.go:52] "Watching apiserver" Jul 28 00:01:52.205794 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.205767 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 00:01:52.208526 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.208500 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal","openshift-multus/multus-additional-cni-plugins-p7qcr","openshift-ovn-kubernetes/ovnkube-node-zv5w7","kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal","openshift-cluster-node-tuning-operator/tuned-26mrl","openshift-image-registry/node-ca-2ddmz","openshift-multus/multus-b94w4","openshift-multus/network-metrics-daemon-j2dff","openshift-network-diagnostics/network-check-target-bwgk9","openshift-network-operator/iptables-alerter-74666","kube-system/global-pull-secret-syncer-r5qw7","kube-system/konnectivity-agent-jwvtx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg","openshift-dns/node-resolver-lzfrd"] Jul 28 00:01:52.210102 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.210079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.211404 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.211377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.212526 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.212286 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 00:01:52.212526 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.212338 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 00:01:52.212526 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.212486 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 00:01:52.212784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.212595 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p8tbp\"" Jul 28 00:01:52.212784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.212655 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 00:01:52.212784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.212690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.213372 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.213351 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 00:01:52.214653 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.213751 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 00:01:52.214653 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.214047 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 00:01:52.214653 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.214055 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 00:01:52.214653 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.214318 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wgrw5\"" Jul 28 00:01:52.214858 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.214742 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 00:01:52.215033 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.215003 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:52.215157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.215119 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 00:01:52.215239 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.215219 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zwn7v\"" Jul 28 00:01:52.216386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.216359 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.217710 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.216589 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 00:01:52.217710 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.216768 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 00:01:52.217710 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.217474 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:52.218034 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.218015 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.218394 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.218362 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 00:01:52.218873 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.218855 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wzld6\"" Jul 28 00:01:52.219048 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.218856 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 00:01:52.220102 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.220001 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 00:01:52.220826 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.220744 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 00:01:52.220826 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.220745 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jpvkh\"" Jul 28 00:01:52.221205 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.221161 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:52.221672 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.221607 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:01:52.223257 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.223229 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:52.223357 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.223307 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:01:52.224737 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.224719 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.226060 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.226040 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.226155 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.226109 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:01:52.226863 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.226844 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 00:01:52.226962 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.226853 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:52.227223 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.227209 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:52.227279 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.227250 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-swc62\"" Jul 28 00:01:52.227350 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.227332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.228530 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-kubelet\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.228624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-slash\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.228624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-var-lib-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.228800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysctl-d\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.228800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-run\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.228800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-socket-dir-parent\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.228800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.228800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-host\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-cni-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-cni-bin\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-etc-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-cni-netd\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228928 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.228965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-log-socket\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-conf-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229006 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.229062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc8dw\" (UniqueName: \"kubernetes.io/projected/d0242b9b-d5ab-4159-862f-47092ed8dcf0-kube-api-access-zc8dw\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-sys\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-os-release\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-node-log\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-env-overrides\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-daemon-config\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-etc-kubernetes\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-system-cni-dir\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229287 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvtj7\" (UniqueName: \"kubernetes.io/projected/6d7ff173-2ce5-4228-9308-f3449f173cd2-kube-api-access-rvtj7\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229304 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2c56v\"" Jul 28 00:01:52.229337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysconfig\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.229684 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.229684 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229394 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.229684 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49ac63aa-4e02-43ad-bc96-fdda6c904b89-cni-binary-copy\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.229684 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229445 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 00:01:52.229684 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-cni-multus\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.229684 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229687 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-run-netns\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229720 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-lib-modules\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-tuned\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.229868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovnkube-script-lib\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-host\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-serviceca\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovnkube-config\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.229977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-k8s-cni-cncf-io\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-kubelet\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-cni-bin\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh6mf\" (UniqueName: \"kubernetes.io/projected/cc64fc4a-5161-43ef-8190-c0965bd55f7e-kube-api-access-fh6mf\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-modprobe-d\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysctl-conf\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.230100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230092 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-systemd\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230142 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-netns\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-hostroot\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-cnibin\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230225 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-systemd\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-var-lib-kubelet\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6qpj\" (UniqueName: \"kubernetes.io/projected/69c9043d-d28b-49c6-b0a0-24e19084eb05-kube-api-access-x6qpj\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtr9c\" (UniqueName: \"kubernetes.io/projected/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-kube-api-access-mtr9c\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-system-cni-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-cnibin\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-os-release\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230409 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-systemd-units\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-kubernetes\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.230499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230480 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c9043d-d28b-49c6-b0a0-24e19084eb05-tmp\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.231006 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-multus-certs\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.231006 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqs8c\" (UniqueName: \"kubernetes.io/projected/49ac63aa-4e02-43ad-bc96-fdda6c904b89-kube-api-access-jqs8c\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.231006 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-ovn\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.231006 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230651 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.231006 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230894 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 00:01:52.231006 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.230995 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 00:01:52.231916 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.231792 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qjs2g\"" Jul 28 00:01:52.231916 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.231830 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 00:01:52.232528 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.232509 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 00:01:52.232625 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.232527 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 00:01:52.232849 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.232832 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dsnn7\"" Jul 28 00:01:52.233501 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.233477 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:01:52.253895 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.253871 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-46f44" Jul 28 00:01:52.254446 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.254424 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:52.262000 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.261979 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-46f44" Jul 28 00:01:52.317303 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.317268 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 00:01:52.330825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.330790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.330998 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.330832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-tuned\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.330998 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.330865 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69b5949c-2f73-4461-967a-fc8b6fa05aad-host-slash\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.331126 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331126 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331073 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovnkube-script-lib\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331126 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331081 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331126 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-host\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.331126 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-serviceca\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.331474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovnkube-config\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-k8s-cni-cncf-io\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.331474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-kubelet\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.331474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331214 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 00:01:52.331474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331222 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-host\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.331474 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331284 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-k8s-cni-cncf-io\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331500 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331591 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-kubelet\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331224 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7dp\" (UniqueName: \"kubernetes.io/projected/6da37048-4804-482f-8619-d2b0289be3fd-kube-api-access-5b7dp\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331669 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-serviceca\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331680 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovnkube-script-lib\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-cni-bin\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331710 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-cni-bin\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh6mf\" (UniqueName: \"kubernetes.io/projected/cc64fc4a-5161-43ef-8190-c0965bd55f7e-kube-api-access-fh6mf\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-modprobe-d\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysctl-conf\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.331825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-systemd\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331831 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovnkube-config\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-netns\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331867 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-netns\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-hostroot\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-cnibin\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331932 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-modprobe-d\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-systemd\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-var-lib-kubelet\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331987 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-systemd\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.331989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysctl-conf\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332031 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-hostroot\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332048 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-systemd\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332050 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-cnibin\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332067 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-var-lib-kubelet\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332005 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6qpj\" (UniqueName: \"kubernetes.io/projected/69c9043d-d28b-49c6-b0a0-24e19084eb05-kube-api-access-x6qpj\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtr9c\" (UniqueName: \"kubernetes.io/projected/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-kube-api-access-mtr9c\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332122 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-system-cni-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.332467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-cnibin\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332182 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-system-cni-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-os-release\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-systemd-units\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332240 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-cnibin\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-kubernetes\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c9043d-d28b-49c6-b0a0-24e19084eb05-tmp\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332284 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-systemd-units\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332278 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-os-release\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332310 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-multus-certs\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332325 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-kubernetes\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332364 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-run-multus-certs\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqs8c\" (UniqueName: \"kubernetes.io/projected/49ac63aa-4e02-43ad-bc96-fdda6c904b89-kube-api-access-jqs8c\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4bfv\" (UniqueName: \"kubernetes.io/projected/69b5949c-2f73-4461-967a-fc8b6fa05aad-kube-api-access-v4bfv\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-socket-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-sys-fs\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-ovn\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332748 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-run-ovn\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.333918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332747 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np24m\" (UniqueName: \"kubernetes.io/projected/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-kube-api-access-np24m\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-kubelet\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-slash\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-var-lib-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysctl-d\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332790 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332918 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-slash\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332898 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-kubelet\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-run\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-socket-dir-parent\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332984 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-var-lib-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.332997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333013 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysctl-d\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-host\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333031 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-run\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-cni-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.334478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333073 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-cni-bin\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69b5949c-2f73-4461-967a-fc8b6fa05aad-iptables-alerter-script\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333129 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-socket-dir-parent\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333147 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-device-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333201 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-host\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333218 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-cni-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333248 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-cni-bin\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333275 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-etc-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333347 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-cni-netd\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-log-socket\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333422 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-etc-openvswitch\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333423 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-conf-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333462 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-conf-dir\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333484 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc8dw\" (UniqueName: \"kubernetes.io/projected/d0242b9b-d5ab-4159-862f-47092ed8dcf0-kube-api-access-zc8dw\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-sys\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.335339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333507 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-cni-netd\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6b5d11f-bc1c-4035-8f55-f77392b23b49-dbus\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333619 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-os-release\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-node-log\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-env-overrides\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-daemon-config\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-etc-kubernetes\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7-agent-certs\") pod \"konnectivity-agent-jwvtx\" (UID: \"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7\") " pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7-konnectivity-ca\") pod \"konnectivity-agent-jwvtx\" (UID: \"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7\") " pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-system-cni-dir\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvtj7\" (UniqueName: \"kubernetes.io/projected/6d7ff173-2ce5-4228-9308-f3449f173cd2-kube-api-access-rvtj7\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333888 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-os-release\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333899 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysconfig\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333932 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-registration-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333960 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-sysconfig\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.336068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-hosts-file\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.333996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-tmp-dir\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334008 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49ac63aa-4e02-43ad-bc96-fdda6c904b89-cni-binary-copy\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-cni-multus\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334162 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-run-netns\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334202 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-log-socket\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-lib-modules\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6b5d11f-bc1c-4035-8f55-f77392b23b49-kubelet-config\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334013 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-node-log\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334585 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49ac63aa-4e02-43ad-bc96-fdda6c904b89-multus-daemon-config\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.336709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334670 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-etc-kubernetes\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334752 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-system-cni-dir\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334768 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-lib-modules\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334818 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49ac63aa-4e02-43ad-bc96-fdda6c904b89-host-var-lib-cni-multus\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334874 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc64fc4a-5161-43ef-8190-c0965bd55f7e-env-overrides\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69c9043d-d28b-49c6-b0a0-24e19084eb05-sys\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334949 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d7ff173-2ce5-4228-9308-f3449f173cd2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.334993 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc64fc4a-5161-43ef-8190-c0965bd55f7e-host-run-netns\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.334994 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.335088 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs podName:d0242b9b-d5ab-4159-862f-47092ed8dcf0 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:52.835062378 +0000 UTC m=+2.969918611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs") pod "network-metrics-daemon-j2dff" (UID: "d0242b9b-d5ab-4159-862f-47092ed8dcf0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.335448 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d7ff173-2ce5-4228-9308-f3449f173cd2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.335487 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69c9043d-d28b-49c6-b0a0-24e19084eb05-etc-tuned\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.335494 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49ac63aa-4e02-43ad-bc96-fdda6c904b89-cni-binary-copy\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.335519 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c9043d-d28b-49c6-b0a0-24e19084eb05-tmp\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.337287 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.336682 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc64fc4a-5161-43ef-8190-c0965bd55f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.339800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.339778 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh6mf\" (UniqueName: \"kubernetes.io/projected/cc64fc4a-5161-43ef-8190-c0965bd55f7e-kube-api-access-fh6mf\") pod \"ovnkube-node-zv5w7\" (UID: \"cc64fc4a-5161-43ef-8190-c0965bd55f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.339933 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.339877 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtr9c\" (UniqueName: \"kubernetes.io/projected/8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5-kube-api-access-mtr9c\") pod \"node-ca-2ddmz\" (UID: \"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5\") " pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.340401 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.340382 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6qpj\" (UniqueName: \"kubernetes.io/projected/69c9043d-d28b-49c6-b0a0-24e19084eb05-kube-api-access-x6qpj\") pod \"tuned-26mrl\" (UID: \"69c9043d-d28b-49c6-b0a0-24e19084eb05\") " pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.340520 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.340486 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqs8c\" (UniqueName: \"kubernetes.io/projected/49ac63aa-4e02-43ad-bc96-fdda6c904b89-kube-api-access-jqs8c\") pod \"multus-b94w4\" (UID: \"49ac63aa-4e02-43ad-bc96-fdda6c904b89\") " pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.342972 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.342947 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvtj7\" (UniqueName: \"kubernetes.io/projected/6d7ff173-2ce5-4228-9308-f3449f173cd2-kube-api-access-rvtj7\") pod \"multus-additional-cni-plugins-p7qcr\" (UID: \"6d7ff173-2ce5-4228-9308-f3449f173cd2\") " pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.346550 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.346527 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc8dw\" (UniqueName: \"kubernetes.io/projected/d0242b9b-d5ab-4159-862f-47092ed8dcf0-kube-api-access-zc8dw\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:52.429763 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.429695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" event={"ID":"78e50d64494b0564c66b772f1fad8aca","Type":"ContainerStarted","Data":"849a12ad59ffcd55fcbe1d7a890baf436df8ae7acd986cbe353e1b056eac6c2e"} Jul 28 00:01:52.430948 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.430922 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" event={"ID":"0bc73864478fe04fd42a7533b7864e77","Type":"ContainerStarted","Data":"59155472ee719de6697e47e78123d50dab334b96fab2fd4f18ac60b0380c5e1b"} Jul 28 00:01:52.435336 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7-agent-certs\") pod \"konnectivity-agent-jwvtx\" (UID: \"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7\") " pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.435439 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7-konnectivity-ca\") pod \"konnectivity-agent-jwvtx\" (UID: \"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7\") " pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.435439 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435439 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-registration-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435643 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-hosts-file\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.435643 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435469 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435643 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-tmp-dir\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.435643 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.435643 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6b5d11f-bc1c-4035-8f55-f77392b23b49-kubelet-config\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.435643 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435643 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69b5949c-2f73-4461-967a-fc8b6fa05aad-host-slash\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7dp\" (UniqueName: \"kubernetes.io/projected/6da37048-4804-482f-8619-d2b0289be3fd-kube-api-access-5b7dp\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4bfv\" (UniqueName: \"kubernetes.io/projected/69b5949c-2f73-4461-967a-fc8b6fa05aad-kube-api-access-v4bfv\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435742 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-socket-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-sys-fs\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np24m\" (UniqueName: \"kubernetes.io/projected/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-kube-api-access-np24m\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69b5949c-2f73-4461-967a-fc8b6fa05aad-iptables-alerter-script\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435833 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-tmp-dir\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435845 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69b5949c-2f73-4461-967a-fc8b6fa05aad-host-slash\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-device-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-device-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6b5d11f-bc1c-4035-8f55-f77392b23b49-dbus\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435910 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-registration-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435955 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-hosts-file\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.435990 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7-konnectivity-ca\") pod \"konnectivity-agent-jwvtx\" (UID: \"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7\") " pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.435999 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.436007 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:52.436852 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.436015 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-sys-fs\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.436852 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.436061 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret podName:b6b5d11f-bc1c-4035-8f55-f77392b23b49 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:52.936046807 +0000 UTC m=+3.070903018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret") pod "global-pull-secret-syncer-r5qw7" (UID: "b6b5d11f-bc1c-4035-8f55-f77392b23b49") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:52.436852 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.436101 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6b5d11f-bc1c-4035-8f55-f77392b23b49-kubelet-config\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.436852 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.436119 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-socket-dir\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.436852 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.436306 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6da37048-4804-482f-8619-d2b0289be3fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.436852 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.436380 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6b5d11f-bc1c-4035-8f55-f77392b23b49-dbus\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.436852 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.436685 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69b5949c-2f73-4461-967a-fc8b6fa05aad-iptables-alerter-script\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.438610 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.438589 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7-agent-certs\") pod \"konnectivity-agent-jwvtx\" (UID: \"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7\") " pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.444760 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.444738 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:52.444760 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.444760 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:52.444941 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.444773 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jdz8v for pod openshift-network-diagnostics/network-check-target-bwgk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:52.444941 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.444849 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v podName:a963251a-13a8-4a39-9be9-c366e44a9126 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:52.944829841 +0000 UTC m=+3.079686068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jdz8v" (UniqueName: "kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v") pod "network-check-target-bwgk9" (UID: "a963251a-13a8-4a39-9be9-c366e44a9126") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:52.447401 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.447373 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7dp\" (UniqueName: \"kubernetes.io/projected/6da37048-4804-482f-8619-d2b0289be3fd-kube-api-access-5b7dp\") pod \"aws-ebs-csi-driver-node-tllcg\" (UID: \"6da37048-4804-482f-8619-d2b0289be3fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.447709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.447692 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np24m\" (UniqueName: \"kubernetes.io/projected/bdc6849a-ca3c-44c8-bdeb-740d76098d9f-kube-api-access-np24m\") pod \"node-resolver-lzfrd\" (UID: \"bdc6849a-ca3c-44c8-bdeb-740d76098d9f\") " pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.447806 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.447786 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4bfv\" (UniqueName: \"kubernetes.io/projected/69b5949c-2f73-4461-967a-fc8b6fa05aad-kube-api-access-v4bfv\") pod \"iptables-alerter-74666\" (UID: \"69b5949c-2f73-4461-967a-fc8b6fa05aad\") " pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.523785 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.523697 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" Jul 28 00:01:52.532826 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.532800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:01:52.542050 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.542027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26mrl" Jul 28 00:01:52.548992 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.548971 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2ddmz" Jul 28 00:01:52.555751 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.555723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b94w4" Jul 28 00:01:52.563726 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.563702 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-74666" Jul 28 00:01:52.570420 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.570397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:01:52.578439 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.578414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" Jul 28 00:01:52.583886 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.583864 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzfrd" Jul 28 00:01:52.750962 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.750928 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ac63aa_4e02_43ad_bc96_fdda6c904b89.slice/crio-0222f81d0e5508fe553025ca21b4df1c0d53b0ab2ff37d95d011054c42cd6a70 WatchSource:0}: Error finding container 0222f81d0e5508fe553025ca21b4df1c0d53b0ab2ff37d95d011054c42cd6a70: Status 404 returned error can't find the container with id 0222f81d0e5508fe553025ca21b4df1c0d53b0ab2ff37d95d011054c42cd6a70 Jul 28 00:01:52.755262 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.755236 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b5949c_2f73_4461_967a_fc8b6fa05aad.slice/crio-131ca1c1f8904eb1dd65dab07dfb57cf1da83aed00b503a62615697a4de47446 WatchSource:0}: Error finding container 131ca1c1f8904eb1dd65dab07dfb57cf1da83aed00b503a62615697a4de47446: Status 404 returned error can't find the container with id 131ca1c1f8904eb1dd65dab07dfb57cf1da83aed00b503a62615697a4de47446 Jul 28 00:01:52.756088 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.756062 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da37048_4804_482f_8619_d2b0289be3fd.slice/crio-6c67bb007d2c18fdf28ba750250fef9b0cc266e5457a2599812ac7c764b8a102 WatchSource:0}: Error finding container 6c67bb007d2c18fdf28ba750250fef9b0cc266e5457a2599812ac7c764b8a102: Status 404 returned error can't find the container with id 6c67bb007d2c18fdf28ba750250fef9b0cc266e5457a2599812ac7c764b8a102 Jul 28 00:01:52.756880 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.756840 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7b8be4_11ad_41f8_a79d_6c93dcbe41b7.slice/crio-0f268e48e9522ca6fa0f8c8c87d63e54b7f69a080d623aa6a21b3cbd0d2e3fd4 WatchSource:0}: Error finding container 0f268e48e9522ca6fa0f8c8c87d63e54b7f69a080d623aa6a21b3cbd0d2e3fd4: Status 404 returned error can't find the container with id 0f268e48e9522ca6fa0f8c8c87d63e54b7f69a080d623aa6a21b3cbd0d2e3fd4 Jul 28 00:01:52.758112 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.758091 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc6849a_ca3c_44c8_bdeb_740d76098d9f.slice/crio-df9ea96ccf3c5afaf2d23712bdec98ea6c284abf1911a642372d673acd0472cd WatchSource:0}: Error finding container df9ea96ccf3c5afaf2d23712bdec98ea6c284abf1911a642372d673acd0472cd: Status 404 returned error can't find the container with id df9ea96ccf3c5afaf2d23712bdec98ea6c284abf1911a642372d673acd0472cd Jul 28 00:01:52.758492 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.758468 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7ff173_2ce5_4228_9308_f3449f173cd2.slice/crio-02d926d95b6166161c5f02aa2fe13e94b9753b164dcb790a15fd651ae58dec3e WatchSource:0}: Error finding container 02d926d95b6166161c5f02aa2fe13e94b9753b164dcb790a15fd651ae58dec3e: Status 404 returned error can't find the container with id 02d926d95b6166161c5f02aa2fe13e94b9753b164dcb790a15fd651ae58dec3e Jul 28 00:01:52.759519 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.759474 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8095d4ac_6e1f_40f6_b3e4_1f5e004e5dc5.slice/crio-81656f88f96e3104495e9bb94008b203723cdd392f1795cfcb72e21ac90bc336 WatchSource:0}: Error finding container 81656f88f96e3104495e9bb94008b203723cdd392f1795cfcb72e21ac90bc336: Status 404 returned error can't find the container with id 81656f88f96e3104495e9bb94008b203723cdd392f1795cfcb72e21ac90bc336 Jul 28 00:01:52.762039 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:01:52.761947 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc64fc4a_5161_43ef_8190_c0965bd55f7e.slice/crio-0e1f7fd06402f9227da7355500801022bdb1f62a93e9fdc5d8fc39096b93bdd7 WatchSource:0}: Error finding container 0e1f7fd06402f9227da7355500801022bdb1f62a93e9fdc5d8fc39096b93bdd7: Status 404 returned error can't find the container with id 0e1f7fd06402f9227da7355500801022bdb1f62a93e9fdc5d8fc39096b93bdd7 Jul 28 00:01:52.839830 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.839794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:52.840019 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.839971 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:52.840084 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.840059 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs podName:d0242b9b-d5ab-4159-862f-47092ed8dcf0 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:53.840035698 +0000 UTC m=+3.974891930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs") pod "network-metrics-daemon-j2dff" (UID: "d0242b9b-d5ab-4159-862f-47092ed8dcf0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:52.940157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:52.940130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:52.940283 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.940256 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:52.940333 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:52.940310 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret podName:b6b5d11f-bc1c-4035-8f55-f77392b23b49 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:53.940296662 +0000 UTC m=+4.075152872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret") pod "global-pull-secret-syncer-r5qw7" (UID: "b6b5d11f-bc1c-4035-8f55-f77392b23b49") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:53.041381 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.041114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:53.041381 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.041297 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:53.041381 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.041319 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:53.041381 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.041329 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jdz8v for pod openshift-network-diagnostics/network-check-target-bwgk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:53.041381 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.041385 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v podName:a963251a-13a8-4a39-9be9-c366e44a9126 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:54.041367624 +0000 UTC m=+4.176223834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdz8v" (UniqueName: "kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v") pod "network-check-target-bwgk9" (UID: "a963251a-13a8-4a39-9be9-c366e44a9126") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:53.264785 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.264704 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:52 +0000 UTC" deadline="2028-02-19 01:21:17.324277305 +0000 UTC" Jul 28 00:01:53.264785 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.264769 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13705h19m24.059513119s" Jul 28 00:01:53.426407 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.426300 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:53.426578 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.426480 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:01:53.435325 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.435285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerStarted","Data":"02d926d95b6166161c5f02aa2fe13e94b9753b164dcb790a15fd651ae58dec3e"} Jul 28 00:01:53.438052 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.438020 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jwvtx" event={"ID":"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7","Type":"ContainerStarted","Data":"0f268e48e9522ca6fa0f8c8c87d63e54b7f69a080d623aa6a21b3cbd0d2e3fd4"} Jul 28 00:01:53.439618 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.439589 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" event={"ID":"6da37048-4804-482f-8619-d2b0289be3fd","Type":"ContainerStarted","Data":"6c67bb007d2c18fdf28ba750250fef9b0cc266e5457a2599812ac7c764b8a102"} Jul 28 00:01:53.441320 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.441295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b94w4" event={"ID":"49ac63aa-4e02-43ad-bc96-fdda6c904b89","Type":"ContainerStarted","Data":"0222f81d0e5508fe553025ca21b4df1c0d53b0ab2ff37d95d011054c42cd6a70"} Jul 28 00:01:53.442834 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.442801 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26mrl" event={"ID":"69c9043d-d28b-49c6-b0a0-24e19084eb05","Type":"ContainerStarted","Data":"db39506c25604ad5dcd3ea6815821229dcfd9e267b51d961719acfa0f8781169"} Jul 28 00:01:53.446370 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.445687 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bc73864478fe04fd42a7533b7864e77" containerID="97503ea7b1172df93d3316e1cd9d9eaeac52ec8069dd371c9db34539e02eda88" exitCode=0 Jul 28 00:01:53.446370 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.445816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" event={"ID":"0bc73864478fe04fd42a7533b7864e77","Type":"ContainerDied","Data":"97503ea7b1172df93d3316e1cd9d9eaeac52ec8069dd371c9db34539e02eda88"} Jul 28 00:01:53.448147 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.448121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2ddmz" event={"ID":"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5","Type":"ContainerStarted","Data":"81656f88f96e3104495e9bb94008b203723cdd392f1795cfcb72e21ac90bc336"} Jul 28 00:01:53.451455 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.451429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"0e1f7fd06402f9227da7355500801022bdb1f62a93e9fdc5d8fc39096b93bdd7"} Jul 28 00:01:53.454036 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.453973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzfrd" event={"ID":"bdc6849a-ca3c-44c8-bdeb-740d76098d9f","Type":"ContainerStarted","Data":"df9ea96ccf3c5afaf2d23712bdec98ea6c284abf1911a642372d673acd0472cd"} Jul 28 00:01:53.458823 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.458760 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-74666" event={"ID":"69b5949c-2f73-4461-967a-fc8b6fa05aad","Type":"ContainerStarted","Data":"131ca1c1f8904eb1dd65dab07dfb57cf1da83aed00b503a62615697a4de47446"} Jul 28 00:01:53.849889 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.849789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:53.850117 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.849970 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:53.850117 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.850038 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs podName:d0242b9b-d5ab-4159-862f-47092ed8dcf0 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:55.850016915 +0000 UTC m=+5.984873127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs") pod "network-metrics-daemon-j2dff" (UID: "d0242b9b-d5ab-4159-862f-47092ed8dcf0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:53.950699 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:53.950659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:53.950890 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.950833 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:53.950970 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:53.950901 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret podName:b6b5d11f-bc1c-4035-8f55-f77392b23b49 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:55.950881513 +0000 UTC m=+6.085737728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret") pod "global-pull-secret-syncer-r5qw7" (UID: "b6b5d11f-bc1c-4035-8f55-f77392b23b49") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:54.051906 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:54.051866 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:54.052154 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:54.052135 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:54.052231 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:54.052168 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:54.052231 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:54.052184 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jdz8v for pod openshift-network-diagnostics/network-check-target-bwgk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:54.052342 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:54.052252 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v podName:a963251a-13a8-4a39-9be9-c366e44a9126 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:56.052231394 +0000 UTC m=+6.187087623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdz8v" (UniqueName: "kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v") pod "network-check-target-bwgk9" (UID: "a963251a-13a8-4a39-9be9-c366e44a9126") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:54.265873 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:54.265766 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:52 +0000 UTC" deadline="2028-01-08 18:22:11.420116448 +0000 UTC" Jul 28 00:01:54.265873 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:54.265813 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12714h20m17.154309212s" Jul 28 00:01:54.428414 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:54.428353 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:54.428594 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:54.428483 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:01:54.428939 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:54.428915 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:54.429057 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:54.429028 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:01:54.482499 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:54.482458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" event={"ID":"0bc73864478fe04fd42a7533b7864e77","Type":"ContainerStarted","Data":"1d631c9a1c51d0f6d248a90533af867563496f9a293fad610c62828f317d51bc"} Jul 28 00:01:55.425227 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:55.425188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:55.425753 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:55.425360 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:01:55.868696 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:55.868571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:55.868885 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:55.868828 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:55.868951 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:55.868901 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs podName:d0242b9b-d5ab-4159-862f-47092ed8dcf0 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:59.868878469 +0000 UTC m=+10.003734696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs") pod "network-metrics-daemon-j2dff" (UID: "d0242b9b-d5ab-4159-862f-47092ed8dcf0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:55.969270 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:55.969226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:55.969470 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:55.969411 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:55.969541 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:55.969487 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret podName:b6b5d11f-bc1c-4035-8f55-f77392b23b49 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:59.969466596 +0000 UTC m=+10.104322811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret") pod "global-pull-secret-syncer-r5qw7" (UID: "b6b5d11f-bc1c-4035-8f55-f77392b23b49") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:56.070221 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:56.070126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:56.070434 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:56.070410 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:56.070506 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:56.070443 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:56.070506 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:56.070461 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jdz8v for pod openshift-network-diagnostics/network-check-target-bwgk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:56.070612 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:56.070534 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v podName:a963251a-13a8-4a39-9be9-c366e44a9126 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:00.070511979 +0000 UTC m=+10.205368193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdz8v" (UniqueName: "kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v") pod "network-check-target-bwgk9" (UID: "a963251a-13a8-4a39-9be9-c366e44a9126") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:56.426744 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:56.426709 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:56.427252 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:56.426853 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:01:56.427374 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:56.427353 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:56.427495 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:56.427470 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:01:57.425477 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:57.425441 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:57.425698 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:57.425626 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:01:58.427781 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:58.427081 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:01:58.427781 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:58.427222 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:01:58.427781 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:58.427607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:01:58.427781 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:58.427720 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:01:59.426409 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:59.425868 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:59.426409 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:59.426014 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:01:59.900519 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:01:59.900411 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:01:59.900947 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:59.900595 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:59.900947 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:01:59.900676 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs podName:d0242b9b-d5ab-4159-862f-47092ed8dcf0 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:07.900654503 +0000 UTC m=+18.035510714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs") pod "network-metrics-daemon-j2dff" (UID: "d0242b9b-d5ab-4159-862f-47092ed8dcf0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:02:00.001770 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:00.001731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:00.001942 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.001871 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:02:00.001942 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.001936 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret podName:b6b5d11f-bc1c-4035-8f55-f77392b23b49 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:08.001915568 +0000 UTC m=+18.136771781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret") pod "global-pull-secret-syncer-r5qw7" (UID: "b6b5d11f-bc1c-4035-8f55-f77392b23b49") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:02:00.103092 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:00.103054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:00.103330 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.103297 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:02:00.103453 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.103339 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:02:00.103453 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.103358 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jdz8v for pod openshift-network-diagnostics/network-check-target-bwgk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:02:00.103453 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.103440 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v podName:a963251a-13a8-4a39-9be9-c366e44a9126 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:08.10341815 +0000 UTC m=+18.238274362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdz8v" (UniqueName: "kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v") pod "network-check-target-bwgk9" (UID: "a963251a-13a8-4a39-9be9-c366e44a9126") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:02:00.426752 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:00.426721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:00.426918 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.426883 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:00.426978 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:00.426960 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:00.427119 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:00.427077 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:01.425426 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:01.425388 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:01.425893 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:01.425549 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:02.425248 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:02.425166 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:02.425402 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:02.425293 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:02.425402 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:02.425355 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:02.425858 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:02.425464 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:03.425214 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:03.425177 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:03.425400 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:03.425344 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:04.424906 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:04.424883 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:04.425143 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:04.424887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:04.425143 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:04.425020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:04.425143 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:04.425073 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:05.425514 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:05.425473 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:05.425994 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:05.425628 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:06.428967 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:06.428934 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:06.429374 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:06.429062 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:06.429374 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:06.429111 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:06.429374 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:06.429213 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:07.425381 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:07.425349 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:07.425649 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:07.425497 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:07.967305 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:07.967266 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:07.967797 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:07.967419 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:02:07.967797 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:07.967491 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs podName:d0242b9b-d5ab-4159-862f-47092ed8dcf0 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:23.967470343 +0000 UTC m=+34.102326556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs") pod "network-metrics-daemon-j2dff" (UID: "d0242b9b-d5ab-4159-862f-47092ed8dcf0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:02:08.068152 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:08.068115 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:08.068326 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.068292 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:02:08.068370 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.068359 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret podName:b6b5d11f-bc1c-4035-8f55-f77392b23b49 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:24.06834239 +0000 UTC m=+34.203198603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret") pod "global-pull-secret-syncer-r5qw7" (UID: "b6b5d11f-bc1c-4035-8f55-f77392b23b49") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:02:08.169129 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:08.169085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:08.169273 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.169256 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:02:08.169309 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.169278 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:02:08.169309 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.169289 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jdz8v for pod openshift-network-diagnostics/network-check-target-bwgk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:02:08.169401 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.169341 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v podName:a963251a-13a8-4a39-9be9-c366e44a9126 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:24.169325372 +0000 UTC m=+34.304181584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdz8v" (UniqueName: "kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v") pod "network-check-target-bwgk9" (UID: "a963251a-13a8-4a39-9be9-c366e44a9126") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:02:08.424994 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:08.424910 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:08.424994 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:08.424961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:08.425207 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.425045 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:08.425207 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:08.425145 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:09.425132 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:09.425097 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:09.425628 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:09.425241 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:10.426151 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:10.426109 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:10.426631 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:10.426231 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:10.426631 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:10.426293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:10.426631 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:10.426423 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:11.425402 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:11.425359 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:11.425598 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:11.425521 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:12.425544 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:12.425509 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:12.425544 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:12.425531 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:12.426131 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:12.425652 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:12.426131 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:12.425768 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:13.425193 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.424890 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:13.425375 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:13.425267 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:13.531818 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.531780 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26mrl" event={"ID":"69c9043d-d28b-49c6-b0a0-24e19084eb05","Type":"ContainerStarted","Data":"2771d0a49ffc5712a919f4157f7a35559923f37b37050c56613811a12b1a4969"} Jul 28 00:02:13.533552 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.533521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2ddmz" event={"ID":"8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5","Type":"ContainerStarted","Data":"dc693c9cc7ecb21afaf2b0c64ad684061173ddef43167268596af6cc5e710c64"} Jul 28 00:02:13.537077 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.537050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"8278a06f6f4211a442f515108b192c4624a548ee7d8d69b939b45160d160574d"} Jul 28 00:02:13.537181 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.537122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"afc278850ba5316a6759595f9f542a08cf8bf8041e3960b386b63e41d85a56ab"} Jul 28 00:02:13.537181 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.537174 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"f657f5e1e2b59a6dc1c1ccd7e7816ecc30b8ada52eafc2637b9175b46a5bf3ae"} Jul 28 00:02:13.537291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.537222 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"fa54eeef319f9775cb6f6725e3b50454793e92a67eab06a0f73f8c3b51e12297"} Jul 28 00:02:13.537291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.537270 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"6bade27d65e2a9d360ac70802c821a54e47913fdd4e5ccf7a60096eb54986df8"} Jul 28 00:02:13.537385 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.537317 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"6bee1e35b19b1fc2e627b43a693c66b33ca3250fbf1c71677ffb47cdcfc0d5d4"} Jul 28 00:02:13.538707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.538682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzfrd" event={"ID":"bdc6849a-ca3c-44c8-bdeb-740d76098d9f","Type":"ContainerStarted","Data":"f211cead9639f9bbec74dff360dbb54ecc710526072937c310425f2afa7e4fef"} Jul 28 00:02:13.540305 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.540280 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" event={"ID":"78e50d64494b0564c66b772f1fad8aca","Type":"ContainerStarted","Data":"9bf6837747edcee210f6c575b5ff5e048161f7513df6c45ab34df093dd26ee19"} Jul 28 00:02:13.542250 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.542224 2567 generic.go:356] "Generic (PLEG): container finished" podID="6d7ff173-2ce5-4228-9308-f3449f173cd2" containerID="c369ffb65ea2f294c6d400890229d8fd075cf4707b180c26afee2651b30f3d52" exitCode=0 Jul 28 00:02:13.542489 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.542468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerDied","Data":"c369ffb65ea2f294c6d400890229d8fd075cf4707b180c26afee2651b30f3d52"} Jul 28 00:02:13.545042 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.545005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jwvtx" event={"ID":"ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7","Type":"ContainerStarted","Data":"b3314ed64831bd453009870c79677fe7efe5d6892aa6f985afb1dfadce23b555"} Jul 28 00:02:13.547057 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.547024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" event={"ID":"6da37048-4804-482f-8619-d2b0289be3fd","Type":"ContainerStarted","Data":"11071f0a3259e80bb2fb3815cbed5db5f8c7b5fec3af972f87d7a70874d3139c"} Jul 28 00:02:13.547434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.547391 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-51.ec2.internal" podStartSLOduration=22.547377221 podStartE2EDuration="22.547377221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:54.499786979 +0000 UTC m=+4.634643215" watchObservedRunningTime="2026-07-28 00:02:13.547377221 +0000 UTC m=+23.682233451" Jul 28 00:02:13.548685 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.548664 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b94w4" event={"ID":"49ac63aa-4e02-43ad-bc96-fdda6c904b89","Type":"ContainerStarted","Data":"06c6b7e4db87c6934dd1438653286ebdd2ce9ad0340850399a217b309d3ab3dc"} Jul 28 00:02:13.558596 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.558540 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26mrl" podStartSLOduration=2.82128689 podStartE2EDuration="22.558522265s" totalImagesPullingTime="19.737235375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:13.546982521 +0000 UTC m=+23.681838751" watchObservedRunningTime="2026-07-28 00:02:13.558522265 +0000 UTC m=+23.693378499" Jul 28 00:02:13.573349 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.573298 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-51.ec2.internal" podStartSLOduration=22.573280342 podStartE2EDuration="22.573280342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:13.558693502 +0000 UTC m=+23.693549733" watchObservedRunningTime="2026-07-28 00:02:13.573280342 +0000 UTC m=+23.708136573" Jul 28 00:02:13.573467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.573410 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2ddmz" podStartSLOduration=2.866977984 podStartE2EDuration="22.57340621s" totalImagesPullingTime="19.706428226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:13.573048221 +0000 UTC m=+23.707904453" watchObservedRunningTime="2026-07-28 00:02:13.57340621 +0000 UTC m=+23.708262442" Jul 28 00:02:13.599018 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.598964 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jwvtx" podStartSLOduration=2.892397576 podStartE2EDuration="22.598945667s" totalImagesPullingTime="19.706548091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:13.585072952 +0000 UTC m=+23.719929194" watchObservedRunningTime="2026-07-28 00:02:13.598945667 +0000 UTC m=+23.733801899" Jul 28 00:02:13.599194 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.599155 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lzfrd" podStartSLOduration=2.891061965 podStartE2EDuration="22.599143532s" totalImagesPullingTime="19.708081567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:13.598505359 +0000 UTC m=+23.733361589" watchObservedRunningTime="2026-07-28 00:02:13.599143532 +0000 UTC m=+23.733999763" Jul 28 00:02:13.636826 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.636777 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b94w4" podStartSLOduration=2.848025683 podStartE2EDuration="22.636732161s" totalImagesPullingTime="19.788706478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:13.636405502 +0000 UTC m=+23.771261733" watchObservedRunningTime="2026-07-28 00:02:13.636732161 +0000 UTC m=+23.771588393" Jul 28 00:02:13.661674 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.661640 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:13.741935 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.741905 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:13.945007 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:13.944971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:14.010508 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.010468 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:14.289755 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.289726 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 00:02:14.295797 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.295698 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T00:02:14.289747606Z","UUID":"5d8d68c2-f6f9-4833-94f2-da4e922a5465","Handler":null,"Name":"","Endpoint":""} Jul 28 00:02:14.297332 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.297311 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 00:02:14.297389 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.297351 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 00:02:14.428198 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.428114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:14.428413 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:14.428230 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:14.428413 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.428282 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:14.428413 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:14.428389 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:14.552485 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.552446 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-74666" event={"ID":"69b5949c-2f73-4461-967a-fc8b6fa05aad","Type":"ContainerStarted","Data":"39c741f2a3d48b3aae6c1c7b9152b901df51314b74975f10c71fa0b48298794a"} Jul 28 00:02:14.554682 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.554645 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" event={"ID":"6da37048-4804-482f-8619-d2b0289be3fd","Type":"ContainerStarted","Data":"78c4eeb17c8ed852a6cb560bb743486c5e53961d5d65af46a28bb49fa260d8bc"} Jul 28 00:02:14.566047 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.565992 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-74666" podStartSLOduration=3.8351907389999997 podStartE2EDuration="23.565970714s" totalImagesPullingTime="19.730779975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:14.565426735 +0000 UTC m=+24.700282968" watchObservedRunningTime="2026-07-28 00:02:14.565970714 +0000 UTC m=+24.700826946" Jul 28 00:02:14.784941 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.784861 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:14.838714 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:14.838613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:15.425546 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:15.425518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:15.425711 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:15.425679 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:15.560260 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:15.560229 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" event={"ID":"6da37048-4804-482f-8619-d2b0289be3fd","Type":"ContainerStarted","Data":"c6052a5e157bc0ad2845e5c2bf67ceed9233da07b68ea1736c61adfbae11358b"} Jul 28 00:02:15.564276 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:15.564199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"400258968fecb9c54d8d210876dbd964cab9e045e9d85a5ba7068577de2722b2"} Jul 28 00:02:15.579229 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:15.579180 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tllcg" podStartSLOduration=5.996727543 podStartE2EDuration="24.579162297s" totalImagesPullingTime="18.582434754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:15.578783953 +0000 UTC m=+25.713640187" watchObservedRunningTime="2026-07-28 00:02:15.579162297 +0000 UTC m=+25.714018528" Jul 28 00:02:15.663265 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:15.663226 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:15.763540 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:15.763473 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:16.396604 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:16.396379 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:16.425362 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:16.425326 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:16.425548 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:16.425326 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:16.425548 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:16.425470 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:16.425548 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:16.425528 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:16.489674 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:16.489636 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:17.425744 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:17.425712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:17.426202 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:17.425841 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:17.814614 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:17.814586 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:18.037442 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.037226 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:02:18.038157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.038135 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:02:18.425849 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.425770 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:18.426554 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:18.425873 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:18.426554 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.425928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:18.426554 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:18.426010 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:18.574414 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.574383 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" event={"ID":"cc64fc4a-5161-43ef-8190-c0965bd55f7e","Type":"ContainerStarted","Data":"f22a951de5527eee3f6088987132ba578aa744cfafe6ef88fd91cf2d2b7e1b95"} Jul 28 00:02:18.574670 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.574647 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:02:18.576277 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.576250 2567 generic.go:356] "Generic (PLEG): container finished" podID="6d7ff173-2ce5-4228-9308-f3449f173cd2" containerID="4021047457b8423b5d18a7df59e0d2c455881945acc3827620ffbf155d1ebc87" exitCode=0 Jul 28 00:02:18.576367 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.576324 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerDied","Data":"4021047457b8423b5d18a7df59e0d2c455881945acc3827620ffbf155d1ebc87"} Jul 28 00:02:18.576610 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.576593 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:02:18.577460 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.577034 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jwvtx" Jul 28 00:02:18.590352 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.590323 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:02:18.603657 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.603616 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" podStartSLOduration=7.847729209 podStartE2EDuration="27.603602395s" totalImagesPullingTime="19.755873186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:18.602613243 +0000 UTC m=+28.737469475" watchObservedRunningTime="2026-07-28 00:02:18.603602395 +0000 UTC m=+28.738458626" Jul 28 00:02:18.665160 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.665130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:18.848125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:18.848041 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:02:19.425392 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:19.425358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:19.425699 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:19.425492 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:19.580052 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:19.580024 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:02:19.597189 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:19.597145 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:02:19.757443 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:19.757414 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:19.858697 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:19.858666 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:20.077794 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.077707 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5qw7"] Jul 28 00:02:20.077963 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.077842 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:20.077963 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:20.077949 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:20.080933 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.080909 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2dff"] Jul 28 00:02:20.081053 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.081005 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:20.081118 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:20.081103 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:20.093390 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.093361 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bwgk9"] Jul 28 00:02:20.093513 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.093465 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:20.093558 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:20.093541 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:20.278972 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.278934 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:20.368789 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.368704 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:20.468528 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.468489 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:20.583462 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.583424 2567 generic.go:356] "Generic (PLEG): container finished" podID="6d7ff173-2ce5-4228-9308-f3449f173cd2" containerID="47f4ff71cdd3e31c05422074235098ecabeffac6c40452571a46249904503c0f" exitCode=0 Jul 28 00:02:20.583841 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.583510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerDied","Data":"47f4ff71cdd3e31c05422074235098ecabeffac6c40452571a46249904503c0f"} Jul 28 00:02:20.589582 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.589536 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:20.653128 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:20.653032 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:21.020262 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:21.020185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:21.120539 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:21.120502 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:21.297516 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:21.297412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:21.412632 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:21.412598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:21.425573 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:21.425536 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:21.425709 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:21.425542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:21.425709 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:21.425642 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:21.425794 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:21.425724 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:21.509058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:21.509024 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:22.425864 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:22.425837 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:22.426459 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:22.425951 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:22.590769 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:22.590737 2567 generic.go:356] "Generic (PLEG): container finished" podID="6d7ff173-2ce5-4228-9308-f3449f173cd2" containerID="d176d504fda314006ce5dacae6b15eea8e3bc5294e7c8e6c9857931d91859207" exitCode=0 Jul 28 00:02:22.590928 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:22.590775 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerDied","Data":"d176d504fda314006ce5dacae6b15eea8e3bc5294e7c8e6c9857931d91859207"} Jul 28 00:02:22.937666 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:22.937633 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:22.990520 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:22.990467 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:23.425282 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:23.425199 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:23.425434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:23.425199 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:23.425434 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:23.425328 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:23.425434 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:23.425374 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:23.626268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:23.626235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:23.894599 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:23.894545 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:23.984525 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:23.984439 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:23.984696 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:23.984589 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:02:23.984696 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:23.984648 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs podName:d0242b9b-d5ab-4159-862f-47092ed8dcf0 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:55.984631954 +0000 UTC m=+66.119488166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs") pod "network-metrics-daemon-j2dff" (UID: "d0242b9b-d5ab-4159-862f-47092ed8dcf0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:02:24.019368 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:24.019341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzfrd_bdc6849a-ca3c-44c8-bdeb-740d76098d9f/dns-node-resolver/0.log" Jul 28 00:02:24.084819 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:24.084783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:24.084989 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:24.084890 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:02:24.084989 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:24.084943 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret podName:b6b5d11f-bc1c-4035-8f55-f77392b23b49 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:56.084928806 +0000 UTC m=+66.219785014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret") pod "global-pull-secret-syncer-r5qw7" (UID: "b6b5d11f-bc1c-4035-8f55-f77392b23b49") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:02:24.185604 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:24.185552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:24.185798 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:24.185714 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:02:24.185798 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:24.185739 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:02:24.185798 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:24.185751 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jdz8v for pod openshift-network-diagnostics/network-check-target-bwgk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:02:24.185949 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:24.185815 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v podName:a963251a-13a8-4a39-9be9-c366e44a9126 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:56.185795679 +0000 UTC m=+66.320651902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdz8v" (UniqueName: "kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v") pod "network-check-target-bwgk9" (UID: "a963251a-13a8-4a39-9be9-c366e44a9126") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:02:24.318657 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:24.318549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:24.432260 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:24.432231 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:24.432411 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:24.432333 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:24.817781 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:24.817696 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2ddmz_8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5/node-ca/0.log" Jul 28 00:02:25.424966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:25.424931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:25.425170 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:25.424931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:25.425170 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:25.425088 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:25.425288 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:25.425169 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:26.428745 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:26.428713 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:26.429183 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:26.428840 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:26.763656 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:26.763548 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:27.425114 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:27.425080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:27.425288 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:27.425080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:27.425288 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:27.425221 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:27.425394 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:27.425283 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:28.425947 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:28.425909 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:28.426351 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:28.426043 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:28.607409 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:28.607375 2567 generic.go:356] "Generic (PLEG): container finished" podID="6d7ff173-2ce5-4228-9308-f3449f173cd2" containerID="d513e75d63583f37b9d139a421ceeea16c59a16f3ac0d6887d19fc9a0d2f8349" exitCode=0 Jul 28 00:02:28.607594 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:28.607421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerDied","Data":"d513e75d63583f37b9d139a421ceeea16c59a16f3ac0d6887d19fc9a0d2f8349"} Jul 28 00:02:29.425964 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.425924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:29.426382 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:29.426030 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:29.426382 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.426092 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:29.426382 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:29.426226 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:29.589110 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.589080 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:29.612903 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.612872 2567 generic.go:356] "Generic (PLEG): container finished" podID="6d7ff173-2ce5-4228-9308-f3449f173cd2" containerID="124dbadb58c0a325692de003bf10e60006ffadb7e4ccd86a3f21d4f52dca5ae2" exitCode=0 Jul 28 00:02:29.613068 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.612939 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerDied","Data":"124dbadb58c0a325692de003bf10e60006ffadb7e4ccd86a3f21d4f52dca5ae2"} Jul 28 00:02:29.754888 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.754839 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:29.807936 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.807897 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:29.922529 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.922494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:29.984800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:29.984706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:30.426235 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:30.426143 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:30.426235 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:30.426230 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:30.617580 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:30.617538 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" event={"ID":"6d7ff173-2ce5-4228-9308-f3449f173cd2","Type":"ContainerStarted","Data":"b50718e63845e33d30e3dec9c7feffe046450e804da21e65f865eccf90571635"} Jul 28 00:02:30.639093 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:30.639042 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p7qcr" podStartSLOduration=11.508681276 podStartE2EDuration="39.639024756s" totalImagesPullingTime="28.13034348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:30.638488933 +0000 UTC m=+40.773345164" watchObservedRunningTime="2026-07-28 00:02:30.639024756 +0000 UTC m=+40.773880989" Jul 28 00:02:30.679425 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:30.679326 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:30.885486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:30.885453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:31.286684 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:31.286648 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:31.425329 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:31.425291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:31.425518 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:31.425392 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:31.425518 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:31.425461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:31.425660 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:31.425601 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:31.878592 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:31.878538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:32.420881 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:32.420849 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:32.427591 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:32.427553 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:32.427727 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:32.427683 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:32.566026 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:32.565996 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:33.083559 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.083523 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:33.284934 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.284906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:33.384911 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.384828 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:33.425648 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.425614 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:33.425648 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.425633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:33.425862 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:33.425750 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:33.425921 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:33.425858 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:33.484952 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.484924 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:33.892147 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.892100 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:33.952201 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:33.952171 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:34.289508 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:34.289420 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:34.425637 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:34.425602 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:34.425785 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:34.425715 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:34.500761 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:34.498598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:34.599096 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:34.599015 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:34.884058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:34.883979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:35.254434 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:35.254405 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:35.425283 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:35.425245 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:35.425711 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:35.425249 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:35.425711 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:35.425351 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:35.425711 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:35.425442 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:35.490197 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:35.490166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:36.082916 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:36.082876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:36.183669 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:36.183628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:36.287462 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:36.287432 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:36.425169 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:36.425135 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:36.425368 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:36.425278 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:36.479960 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:36.479924 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:36.880257 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:36.880170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:37.425239 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:37.425204 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:37.425239 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:37.425207 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:37.425805 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:37.425326 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:37.425805 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:37.425477 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:37.480409 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:37.480364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:38.079327 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:38.079293 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:38.283973 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:38.283942 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:38.425142 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:38.425114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:38.425338 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:38.425217 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:38.488263 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:38.488234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:38.884058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:38.883959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:39.425704 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:39.425666 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:39.425704 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:39.425713 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:39.425918 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:39.425788 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:39.425954 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:39.425917 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:39.680916 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:39.680833 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:40.001627 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:40.001540 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:40.105757 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:40.105718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:40.280746 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:40.280658 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:40.426229 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:40.426190 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:40.426390 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:40.426283 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:40.596903 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:40.596821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:40.696760 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:40.696721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:41.425163 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:41.425127 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:41.425336 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:41.425127 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:41.425336 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:41.425240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:41.425336 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:41.425322 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:42.425828 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:42.425785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:42.426219 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:42.425909 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:43.425950 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:43.425910 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:43.426498 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:43.426014 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:43.426498 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:43.426078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:43.426498 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:43.426209 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:44.425778 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:44.425745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:44.425950 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:44.425848 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5qw7" podUID="b6b5d11f-bc1c-4035-8f55-f77392b23b49" Jul 28 00:02:45.424919 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:45.424887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:45.424919 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:45.424924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:45.425406 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:45.425023 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2dff" podUID="d0242b9b-d5ab-4159-862f-47092ed8dcf0" Jul 28 00:02:45.425406 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:45.425125 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwgk9" podUID="a963251a-13a8-4a39-9be9-c366e44a9126" Jul 28 00:02:46.066801 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.066761 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:46.170077 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.170044 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:46.235896 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.235873 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-51.ec2.internal" event="NodeReady" Jul 28 00:02:46.236104 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.236007 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 00:02:46.274858 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.274680 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:46.294839 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.294805 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9xsd4"] Jul 28 00:02:46.296599 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.296583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.298764 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.298744 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 00:02:46.298876 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.298855 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 00:02:46.298940 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.298881 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trh8s\"" Jul 28 00:02:46.301787 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.301769 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-knw6h"] Jul 28 00:02:46.303645 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.303443 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.306420 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.306402 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 00:02:46.306516 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.306413 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 00:02:46.306516 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.306418 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 00:02:46.306647 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.306427 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-98st5\"" Jul 28 00:02:46.306647 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.306464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 00:02:46.308266 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.308248 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9xsd4"] Jul 28 00:02:46.317138 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.317116 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-knw6h"] Jul 28 00:02:46.369921 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.369884 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:46.396495 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.396460 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lzgzc"] Jul 28 00:02:46.398205 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.398186 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.400233 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.400214 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 00:02:46.400325 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.400214 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8pfvf\"" Jul 28 00:02:46.400372 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.400358 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 00:02:46.400723 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.400708 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 00:02:46.408213 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.408190 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzgzc"] Jul 28 00:02:46.425490 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.425468 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:46.427469 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.427451 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:02:46.455495 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db260c69-727c-4c59-9d40-f0dcd01b50f4-config-volume\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.455629 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/383c3203-354c-42ea-a3ac-d108a4a0183d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.455629 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db260c69-727c-4c59-9d40-f0dcd01b50f4-tmp-dir\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.455629 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td8q7\" (UniqueName: \"kubernetes.io/projected/db260c69-727c-4c59-9d40-f0dcd01b50f4-kube-api-access-td8q7\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.455629 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbff\" (UniqueName: \"kubernetes.io/projected/383c3203-354c-42ea-a3ac-d108a4a0183d-kube-api-access-ldbff\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.455629 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db260c69-727c-4c59-9d40-f0dcd01b50f4-metrics-tls\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.455629 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/383c3203-354c-42ea-a3ac-d108a4a0183d-crio-socket\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.455849 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/383c3203-354c-42ea-a3ac-d108a4a0183d-data-volume\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.455849 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.455741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/383c3203-354c-42ea-a3ac-d108a4a0183d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.479827 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.479797 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:46.556769 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db260c69-727c-4c59-9d40-f0dcd01b50f4-config-volume\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.556769 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/383c3203-354c-42ea-a3ac-d108a4a0183d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.556769 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db260c69-727c-4c59-9d40-f0dcd01b50f4-tmp-dir\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.556941 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td8q7\" (UniqueName: \"kubernetes.io/projected/db260c69-727c-4c59-9d40-f0dcd01b50f4-kube-api-access-td8q7\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.556941 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbff\" (UniqueName: \"kubernetes.io/projected/383c3203-354c-42ea-a3ac-d108a4a0183d-kube-api-access-ldbff\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.556941 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db260c69-727c-4c59-9d40-f0dcd01b50f4-metrics-tls\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.556941 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz8kg\" (UniqueName: \"kubernetes.io/projected/c79f27f6-86a3-4be5-baf6-d0be5b31959b-kube-api-access-pz8kg\") pod \"ingress-canary-lzgzc\" (UID: \"c79f27f6-86a3-4be5-baf6-d0be5b31959b\") " pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.557125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.556977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/383c3203-354c-42ea-a3ac-d108a4a0183d-crio-socket\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.557125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/383c3203-354c-42ea-a3ac-d108a4a0183d-data-volume\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.557125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557079 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/383c3203-354c-42ea-a3ac-d108a4a0183d-crio-socket\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.557125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c79f27f6-86a3-4be5-baf6-d0be5b31959b-cert\") pod \"ingress-canary-lzgzc\" (UID: \"c79f27f6-86a3-4be5-baf6-d0be5b31959b\") " pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.557300 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/383c3203-354c-42ea-a3ac-d108a4a0183d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.557395 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557375 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db260c69-727c-4c59-9d40-f0dcd01b50f4-config-volume\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.557471 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557456 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/383c3203-354c-42ea-a3ac-d108a4a0183d-data-volume\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.557604 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557552 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/383c3203-354c-42ea-a3ac-d108a4a0183d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.557737 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.557721 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db260c69-727c-4c59-9d40-f0dcd01b50f4-tmp-dir\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.560850 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.560831 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db260c69-727c-4c59-9d40-f0dcd01b50f4-metrics-tls\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.560948 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.560837 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/383c3203-354c-42ea-a3ac-d108a4a0183d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.568033 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.568013 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td8q7\" (UniqueName: \"kubernetes.io/projected/db260c69-727c-4c59-9d40-f0dcd01b50f4-kube-api-access-td8q7\") pod \"dns-default-9xsd4\" (UID: \"db260c69-727c-4c59-9d40-f0dcd01b50f4\") " pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.568184 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.568167 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbff\" (UniqueName: \"kubernetes.io/projected/383c3203-354c-42ea-a3ac-d108a4a0183d-kube-api-access-ldbff\") pod \"insights-runtime-extractor-knw6h\" (UID: \"383c3203-354c-42ea-a3ac-d108a4a0183d\") " pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.581077 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.581056 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:46.605937 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.605911 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:46.616691 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.616668 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-knw6h" Jul 28 00:02:46.658119 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.658075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz8kg\" (UniqueName: \"kubernetes.io/projected/c79f27f6-86a3-4be5-baf6-d0be5b31959b-kube-api-access-pz8kg\") pod \"ingress-canary-lzgzc\" (UID: \"c79f27f6-86a3-4be5-baf6-d0be5b31959b\") " pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.658319 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.658181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c79f27f6-86a3-4be5-baf6-d0be5b31959b-cert\") pod \"ingress-canary-lzgzc\" (UID: \"c79f27f6-86a3-4be5-baf6-d0be5b31959b\") " pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.662010 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.661981 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c79f27f6-86a3-4be5-baf6-d0be5b31959b-cert\") pod \"ingress-canary-lzgzc\" (UID: \"c79f27f6-86a3-4be5-baf6-d0be5b31959b\") " pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.667694 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.667668 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz8kg\" (UniqueName: \"kubernetes.io/projected/c79f27f6-86a3-4be5-baf6-d0be5b31959b-kube-api-access-pz8kg\") pod \"ingress-canary-lzgzc\" (UID: \"c79f27f6-86a3-4be5-baf6-d0be5b31959b\") " pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.706007 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.705973 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzgzc" Jul 28 00:02:46.760811 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.760782 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9xsd4"] Jul 28 00:02:46.766209 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:46.766181 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb260c69_727c_4c59_9d40_f0dcd01b50f4.slice/crio-5fbc841e0b4106d1093e3276b1d91e8f79f1b2da071880cee4e2b7c6d07e4e8d WatchSource:0}: Error finding container 5fbc841e0b4106d1093e3276b1d91e8f79f1b2da071880cee4e2b7c6d07e4e8d: Status 404 returned error can't find the container with id 5fbc841e0b4106d1093e3276b1d91e8f79f1b2da071880cee4e2b7c6d07e4e8d Jul 28 00:02:46.779038 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.779012 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-knw6h"] Jul 28 00:02:46.783861 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:46.783837 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383c3203_354c_42ea_a3ac_d108a4a0183d.slice/crio-1e996b173f9e125578f68b65771de0b53d8b4dd08ef21f8187274120d149b527 WatchSource:0}: Error finding container 1e996b173f9e125578f68b65771de0b53d8b4dd08ef21f8187274120d149b527: Status 404 returned error can't find the container with id 1e996b173f9e125578f68b65771de0b53d8b4dd08ef21f8187274120d149b527 Jul 28 00:02:46.838263 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:46.838184 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzgzc"] Jul 28 00:02:46.840652 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:46.840623 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79f27f6_86a3_4be5_baf6_d0be5b31959b.slice/crio-d80c445d0741517454d1c95959b519751e02868993f6088f51abb2c4f6523f0c WatchSource:0}: Error finding container d80c445d0741517454d1c95959b519751e02868993f6088f51abb2c4f6523f0c: Status 404 returned error can't find the container with id d80c445d0741517454d1c95959b519751e02868993f6088f51abb2c4f6523f0c Jul 28 00:02:47.425819 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.425780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:47.426250 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.425997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:47.429043 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.429014 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:02:47.429174 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.429042 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:02:47.429174 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.429059 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wccf\"" Jul 28 00:02:47.429174 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.429133 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:02:47.429337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.429209 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxxgg\"" Jul 28 00:02:47.658628 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.658530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzgzc" event={"ID":"c79f27f6-86a3-4be5-baf6-d0be5b31959b","Type":"ContainerStarted","Data":"d80c445d0741517454d1c95959b519751e02868993f6088f51abb2c4f6523f0c"} Jul 28 00:02:47.660103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.660073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knw6h" event={"ID":"383c3203-354c-42ea-a3ac-d108a4a0183d","Type":"ContainerStarted","Data":"1e996b173f9e125578f68b65771de0b53d8b4dd08ef21f8187274120d149b527"} Jul 28 00:02:47.661435 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:47.661408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xsd4" event={"ID":"db260c69-727c-4c59-9d40-f0dcd01b50f4","Type":"ContainerStarted","Data":"5fbc841e0b4106d1093e3276b1d91e8f79f1b2da071880cee4e2b7c6d07e4e8d"} Jul 28 00:02:48.775647 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:48.775604 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:49.048281 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:49.048194 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:51.442334 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.442295 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:51.540337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.540299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:51.591788 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.591756 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj"] Jul 28 00:02:51.607002 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.606859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:51.711335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.711255 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj"] Jul 28 00:02:51.711527 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.711381 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zv5w7" Jul 28 00:02:51.711527 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.711513 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" Jul 28 00:02:51.713978 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.713942 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 00:02:51.713978 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.713976 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zhvvk\"" Jul 28 00:02:51.746299 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.746265 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:51.800375 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.800335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab20b503-6313-4f55-acd9-809991d07cc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9qkrj\" (UID: \"ab20b503-6313-4f55-acd9-809991d07cc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" Jul 28 00:02:51.832605 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.832550 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:51.893446 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.893395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:51.901327 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.901303 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab20b503-6313-4f55-acd9-809991d07cc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9qkrj\" (UID: \"ab20b503-6313-4f55-acd9-809991d07cc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" Jul 28 00:02:51.903609 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:51.903580 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ab20b503-6313-4f55-acd9-809991d07cc6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9qkrj\" (UID: \"ab20b503-6313-4f55-acd9-809991d07cc6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" Jul 28 00:02:52.023253 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:52.023170 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" Jul 28 00:02:53.166339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.166258 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj"] Jul 28 00:02:53.174815 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:53.174786 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab20b503_6313_4f55_acd9_809991d07cc6.slice/crio-f00fcbe2298fb376fb07992e0fc036fb7a27e2579f6a6312c1bcec671185fd68 WatchSource:0}: Error finding container f00fcbe2298fb376fb07992e0fc036fb7a27e2579f6a6312c1bcec671185fd68: Status 404 returned error can't find the container with id f00fcbe2298fb376fb07992e0fc036fb7a27e2579f6a6312c1bcec671185fd68 Jul 28 00:02:53.678740 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.678704 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xsd4" event={"ID":"db260c69-727c-4c59-9d40-f0dcd01b50f4","Type":"ContainerStarted","Data":"07e95d795b4a80e221691194d70f7835163cfdd67e27c0a417b9a2cd7f166631"} Jul 28 00:02:53.678969 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.678769 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xsd4" event={"ID":"db260c69-727c-4c59-9d40-f0dcd01b50f4","Type":"ContainerStarted","Data":"0ae7fd10e5ffd2d42ed25667d315eddacfb0ff0aef936ac5d8e1f9658886dacc"} Jul 28 00:02:53.678969 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.678829 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9xsd4" Jul 28 00:02:53.679795 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.679775 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" event={"ID":"ab20b503-6313-4f55-acd9-809991d07cc6","Type":"ContainerStarted","Data":"f00fcbe2298fb376fb07992e0fc036fb7a27e2579f6a6312c1bcec671185fd68"} Jul 28 00:02:53.681058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.681036 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzgzc" event={"ID":"c79f27f6-86a3-4be5-baf6-d0be5b31959b","Type":"ContainerStarted","Data":"f20e4a0661dca6bd5f7cd2f47876ab5856bf554914017ce2f0a9881b71ccce9f"} Jul 28 00:02:53.682463 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.682442 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knw6h" event={"ID":"383c3203-354c-42ea-a3ac-d108a4a0183d","Type":"ContainerStarted","Data":"309736141b01f9651e378daf1ec7732f318c6fbc33bab1e7bbdd0c5ac984fa2b"} Jul 28 00:02:53.694493 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.694445 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9xsd4" podStartSLOduration=1.43650803 podStartE2EDuration="7.694429136s" totalImagesPullingTime="6.257921106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:53.694163986 +0000 UTC m=+63.829020216" watchObservedRunningTime="2026-07-28 00:02:53.694429136 +0000 UTC m=+63.829285367" Jul 28 00:02:53.708298 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:53.708249 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lzgzc" podStartSLOduration=1.5251128409999999 podStartE2EDuration="7.70823485s" totalImagesPullingTime="6.183122009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:53.707475795 +0000 UTC m=+63.842332055" watchObservedRunningTime="2026-07-28 00:02:53.70823485 +0000 UTC m=+63.843091125" Jul 28 00:02:54.687963 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:54.687929 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" event={"ID":"ab20b503-6313-4f55-acd9-809991d07cc6","Type":"ContainerStarted","Data":"f9aa1541da7e5287e7617f4b491c0ef715e6ce3a4b5ae1d55a536aa84d932053"} Jul 28 00:02:54.688424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:54.688196 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" Jul 28 00:02:54.693531 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:54.693505 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" Jul 28 00:02:54.701862 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:54.701806 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9qkrj" podStartSLOduration=2.303646972 podStartE2EDuration="3.701786254s" totalImagesPullingTime="1.398139282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:54.701593881 +0000 UTC m=+64.836450111" watchObservedRunningTime="2026-07-28 00:02:54.701786254 +0000 UTC m=+64.836642487" Jul 28 00:02:55.628116 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.628080 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:55.658649 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.658605 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8mvzf"] Jul 28 00:02:55.670743 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.670716 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8mvzf"] Jul 28 00:02:55.670910 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.670828 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.673232 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.673101 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 00:02:55.673351 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.673253 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 00:02:55.673937 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.673905 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 00:02:55.674063 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.673971 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 00:02:55.674063 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.673906 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 00:02:55.674252 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.674235 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zrjxd\"" Jul 28 00:02:55.693018 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.692988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:55.730299 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.730265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.730468 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.730320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gztjj\" (UniqueName: \"kubernetes.io/projected/8981f40d-eb08-49e4-a299-9d8b02755249-kube-api-access-gztjj\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.730468 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.730441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.730659 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.730531 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8981f40d-eb08-49e4-a299-9d8b02755249-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.831318 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.831284 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.831505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.831336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gztjj\" (UniqueName: \"kubernetes.io/projected/8981f40d-eb08-49e4-a299-9d8b02755249-kube-api-access-gztjj\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.831505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.831375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.831505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.831435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8981f40d-eb08-49e4-a299-9d8b02755249-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.831505 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:55.831437 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 00:02:55.831741 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:02:55.831547 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-tls podName:8981f40d-eb08-49e4-a299-9d8b02755249 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:56.331528914 +0000 UTC m=+66.466385125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-8mvzf" (UID: "8981f40d-eb08-49e4-a299-9d8b02755249") : secret "prometheus-operator-tls" not found Jul 28 00:02:55.832138 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.832111 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8981f40d-eb08-49e4-a299-9d8b02755249-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.834125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.834098 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:55.840157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:55.840113 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gztjj\" (UniqueName: \"kubernetes.io/projected/8981f40d-eb08-49e4-a299-9d8b02755249-kube-api-access-gztjj\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:56.033629 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.033586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:56.035824 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.035802 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:02:56.047260 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.047234 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0242b9b-d5ab-4159-862f-47092ed8dcf0-metrics-certs\") pod \"network-metrics-daemon-j2dff\" (UID: \"d0242b9b-d5ab-4159-862f-47092ed8dcf0\") " pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:56.084876 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.084830 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:56.134332 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.134288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:56.136729 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.136704 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:02:56.140910 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.140287 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wccf\"" Jul 28 00:02:56.147252 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.147223 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b5d11f-bc1c-4035-8f55-f77392b23b49-original-pull-secret\") pod \"global-pull-secret-syncer-r5qw7\" (UID: \"b6b5d11f-bc1c-4035-8f55-f77392b23b49\") " pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:56.149107 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.149086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2dff" Jul 28 00:02:56.234882 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.234849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:56.237175 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.237150 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:02:56.248221 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.248197 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:02:56.258796 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.258763 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdz8v\" (UniqueName: \"kubernetes.io/projected/a963251a-13a8-4a39-9be9-c366e44a9126-kube-api-access-jdz8v\") pod \"network-check-target-bwgk9\" (UID: \"a963251a-13a8-4a39-9be9-c366e44a9126\") " pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:56.333258 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.333144 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5qw7" Jul 28 00:02:56.335428 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.335391 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:56.337859 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.337837 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8981f40d-eb08-49e4-a299-9d8b02755249-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8mvzf\" (UID: \"8981f40d-eb08-49e4-a299-9d8b02755249\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:56.447374 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.447350 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxxgg\"" Jul 28 00:02:56.455064 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.455031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:02:56.581308 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:56.581271 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" Jul 28 00:02:57.202598 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.202400 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5qw7"] Jul 28 00:02:57.205103 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:57.205079 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b5d11f_bc1c_4035_8f55_f77392b23b49.slice/crio-53a5acbf965128614c6dffd0cafa7865926eff668a3ec5df2cc920c15a590682 WatchSource:0}: Error finding container 53a5acbf965128614c6dffd0cafa7865926eff668a3ec5df2cc920c15a590682: Status 404 returned error can't find the container with id 53a5acbf965128614c6dffd0cafa7865926eff668a3ec5df2cc920c15a590682 Jul 28 00:02:57.427000 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.426970 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8mvzf"] Jul 28 00:02:57.431422 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:57.431118 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8981f40d_eb08_49e4_a299_9d8b02755249.slice/crio-bc58922d63c33405531dbe9e47c60b0725be0cc07dafc64ca574a971862774a5 WatchSource:0}: Error finding container bc58922d63c33405531dbe9e47c60b0725be0cc07dafc64ca574a971862774a5: Status 404 returned error can't find the container with id bc58922d63c33405531dbe9e47c60b0725be0cc07dafc64ca574a971862774a5 Jul 28 00:02:57.431699 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.431670 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bwgk9"] Jul 28 00:02:57.432512 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.432462 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2dff"] Jul 28 00:02:57.434436 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:57.434409 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0242b9b_d5ab_4159_862f_47092ed8dcf0.slice/crio-c0760b5784159a5e4bdf100741aa3d47cdff855317ddac239a829479b2a73a90 WatchSource:0}: Error finding container c0760b5784159a5e4bdf100741aa3d47cdff855317ddac239a829479b2a73a90: Status 404 returned error can't find the container with id c0760b5784159a5e4bdf100741aa3d47cdff855317ddac239a829479b2a73a90 Jul 28 00:02:57.434982 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:02:57.434960 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda963251a_13a8_4a39_9be9_c366e44a9126.slice/crio-d402b634a87bd8b1309f48a46e3a0aa9b0eaf93013e2965d6092b45cea77a5f5 WatchSource:0}: Error finding container d402b634a87bd8b1309f48a46e3a0aa9b0eaf93013e2965d6092b45cea77a5f5: Status 404 returned error can't find the container with id d402b634a87bd8b1309f48a46e3a0aa9b0eaf93013e2965d6092b45cea77a5f5 Jul 28 00:02:57.697497 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.697406 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knw6h" event={"ID":"383c3203-354c-42ea-a3ac-d108a4a0183d","Type":"ContainerStarted","Data":"1cb48e24eda32ed42ff70eef10707648a0530b70366138ef03b5c5e4b8e9d878"} Jul 28 00:02:57.698552 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.698525 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2dff" event={"ID":"d0242b9b-d5ab-4159-862f-47092ed8dcf0","Type":"ContainerStarted","Data":"c0760b5784159a5e4bdf100741aa3d47cdff855317ddac239a829479b2a73a90"} Jul 28 00:02:57.699576 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.699540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" event={"ID":"8981f40d-eb08-49e4-a299-9d8b02755249","Type":"ContainerStarted","Data":"bc58922d63c33405531dbe9e47c60b0725be0cc07dafc64ca574a971862774a5"} Jul 28 00:02:57.700533 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.700515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5qw7" event={"ID":"b6b5d11f-bc1c-4035-8f55-f77392b23b49","Type":"ContainerStarted","Data":"53a5acbf965128614c6dffd0cafa7865926eff668a3ec5df2cc920c15a590682"} Jul 28 00:02:57.701496 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:57.701476 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bwgk9" event={"ID":"a963251a-13a8-4a39-9be9-c366e44a9126","Type":"ContainerStarted","Data":"d402b634a87bd8b1309f48a46e3a0aa9b0eaf93013e2965d6092b45cea77a5f5"} Jul 28 00:02:58.534529 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:58.534484 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:58.593946 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:02:58.593873 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:03.690507 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:03.690469 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9xsd4" Jul 28 00:03:03.787222 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:03.787183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:03.890379 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:03.890337 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:04.731640 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.731599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5qw7" event={"ID":"b6b5d11f-bc1c-4035-8f55-f77392b23b49","Type":"ContainerStarted","Data":"393bb054bdb5d6d722f5be5f4a265761e83b0f8f72cbceaa3de13fa14e5f1edc"} Jul 28 00:03:04.732220 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.732191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:04.733182 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.733157 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bwgk9" event={"ID":"a963251a-13a8-4a39-9be9-c366e44a9126","Type":"ContainerStarted","Data":"f8b62201a12b916434ba7fdc24e2f0275c49339f58d3623337e1395b4c522130"} Jul 28 00:03:04.733288 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.733210 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:03:04.735277 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.735241 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knw6h" event={"ID":"383c3203-354c-42ea-a3ac-d108a4a0183d","Type":"ContainerStarted","Data":"35d53e0e48bc6a4313a8396b11a343f67970c147318c4b66fd845564f552bee4"} Jul 28 00:03:04.736914 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.736894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2dff" event={"ID":"d0242b9b-d5ab-4159-862f-47092ed8dcf0","Type":"ContainerStarted","Data":"bff0216b10559621f232ef581a48b66d8b313b4ec8c638ae64746fdb9c33ae47"} Jul 28 00:03:04.737006 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.736933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2dff" event={"ID":"d0242b9b-d5ab-4159-862f-47092ed8dcf0","Type":"ContainerStarted","Data":"79566c3621c3f06489424daacae21b5c30ebf26f148c2313e227548973c225a0"} Jul 28 00:03:04.738541 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.738521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" event={"ID":"8981f40d-eb08-49e4-a299-9d8b02755249","Type":"ContainerStarted","Data":"21b43a006482f69b1b7a29008df2762fc790f0d903aed4a4d1c72b2a6a7c92a6"} Jul 28 00:03:04.738636 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.738583 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" event={"ID":"8981f40d-eb08-49e4-a299-9d8b02755249","Type":"ContainerStarted","Data":"88ed21e4028174483ff23ac758889a23e4dbfd8c8f0a3d952ac89a1f8a12aeb0"} Jul 28 00:03:04.746842 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.746796 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r5qw7" podStartSLOduration=66.82598741300001 podStartE2EDuration="1m13.746779084s" totalImagesPullingTime="6.920791671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:04.746356099 +0000 UTC m=+74.881212331" watchObservedRunningTime="2026-07-28 00:03:04.746779084 +0000 UTC m=+74.881635293" Jul 28 00:03:04.776501 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.776447 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-8mvzf" podStartSLOduration=3.10205153 podStartE2EDuration="9.776433735s" totalImagesPullingTime="6.674382205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:04.776183619 +0000 UTC m=+74.911039933" watchObservedRunningTime="2026-07-28 00:03:04.776433735 +0000 UTC m=+74.911289965" Jul 28 00:03:04.806803 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.806747 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bwgk9" podStartSLOduration=67.127095462 podStartE2EDuration="1m13.806727517s" totalImagesPullingTime="6.679632055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:04.806000156 +0000 UTC m=+74.940856393" watchObservedRunningTime="2026-07-28 00:03:04.806727517 +0000 UTC m=+74.941583752" Jul 28 00:03:04.830947 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.830886 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j2dff" podStartSLOduration=67.157345943 podStartE2EDuration="1m13.830866524s" totalImagesPullingTime="6.673520581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:04.830612269 +0000 UTC m=+74.965468499" watchObservedRunningTime="2026-07-28 00:03:04.830866524 +0000 UTC m=+74.965722757" Jul 28 00:03:04.848239 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:04.848187 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-knw6h" podStartSLOduration=1.6977924359999998 podStartE2EDuration="18.848168872s" totalImagesPullingTime="17.150376436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:02:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:04.847606743 +0000 UTC m=+74.982462979" watchObservedRunningTime="2026-07-28 00:03:04.848168872 +0000 UTC m=+74.983025095" Jul 28 00:03:05.154457 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:05.154417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:05.254329 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:05.254285 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:06.753831 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:06.753789 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:06.991736 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:06.991701 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.012755 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.012683 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g"] Jul 28 00:03:07.015883 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.015866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.018152 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.018131 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 00:03:07.018262 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.018204 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 00:03:07.018321 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.018287 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kdlgj\"" Jul 28 00:03:07.027058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.027035 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g"] Jul 28 00:03:07.034937 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.034915 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf"] Jul 28 00:03:07.038047 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.038031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.040139 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.040118 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 00:03:07.040342 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.040327 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 00:03:07.040429 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.040360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-trtvh\"" Jul 28 00:03:07.041594 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.041430 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 00:03:07.054887 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.054862 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf"] Jul 28 00:03:07.055722 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.055698 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qqzvb"] Jul 28 00:03:07.058820 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.058798 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.061059 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.061042 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 00:03:07.061830 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.061805 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 00:03:07.061911 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.061875 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 00:03:07.062305 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.062283 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fbxbt\"" Jul 28 00:03:07.077404 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.077380 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.109304 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlphh\" (UniqueName: \"kubernetes.io/projected/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-api-access-xlphh\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.109304 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.109505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58c3325c-3492-4a30-87de-010070b53115-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.109505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109351 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-tls\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109394 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.109505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109428 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac86d78-5a4f-4aea-8ce1-fd573c231d88-metrics-client-ca\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109466 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm465\" (UniqueName: \"kubernetes.io/projected/cac86d78-5a4f-4aea-8ce1-fd573c231d88-kube-api-access-pm465\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbfl8\" (UniqueName: \"kubernetes.io/projected/58c3325c-3492-4a30-87de-010070b53115-kube-api-access-qbfl8\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.109712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be3bb7d5-5c75-4172-8b28-0ec92994873b-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.109712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109586 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.109712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.109712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-root\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-wtmp\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109914 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3bb7d5-5c75-4172-8b28-0ec92994873b-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.109914 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-sys\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109914 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-textfile\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.109914 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.109796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.211142 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac86d78-5a4f-4aea-8ce1-fd573c231d88-metrics-client-ca\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211142 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm465\" (UniqueName: \"kubernetes.io/projected/cac86d78-5a4f-4aea-8ce1-fd573c231d88-kube-api-access-pm465\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211336 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbfl8\" (UniqueName: \"kubernetes.io/projected/58c3325c-3492-4a30-87de-010070b53115-kube-api-access-qbfl8\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.211336 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211336 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211331 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be3bb7d5-5c75-4172-8b28-0ec92994873b-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.211480 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.211480 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211382 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.211480 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-root\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211480 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-wtmp\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211480 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211760 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:07.211496 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 00:03:07.211760 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3bb7d5-5c75-4172-8b28-0ec92994873b-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.211760 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-sys\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211760 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:07.211588 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-tls podName:58c3325c-3492-4a30-87de-010070b53115 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:07.711542399 +0000 UTC m=+77.846398629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-vkm8g" (UID: "58c3325c-3492-4a30-87de-010070b53115") : secret "openshift-state-metrics-tls" not found Jul 28 00:03:07.211760 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211607 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-sys\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211760 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211624 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-wtmp\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.211760 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-textfile\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211788 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be3bb7d5-5c75-4172-8b28-0ec92994873b-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlphh\" (UniqueName: \"kubernetes.io/projected/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-api-access-xlphh\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211855 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac86d78-5a4f-4aea-8ce1-fd573c231d88-metrics-client-ca\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58c3325c-3492-4a30-87de-010070b53115-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211895 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-textfile\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211927 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-tls\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.212103 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.211950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.212532 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.212155 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cac86d78-5a4f-4aea-8ce1-fd573c231d88-root\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.212532 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:07.212165 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 00:03:07.212532 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:07.212455 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-tls podName:cac86d78-5a4f-4aea-8ce1-fd573c231d88 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:07.712435281 +0000 UTC m=+77.847291704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-tls") pod "node-exporter-qqzvb" (UID: "cac86d78-5a4f-4aea-8ce1-fd573c231d88") : secret "node-exporter-tls" not found Jul 28 00:03:07.212532 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.212155 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.212532 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.212467 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3bb7d5-5c75-4172-8b28-0ec92994873b-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.212736 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.212539 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.212736 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.212651 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58c3325c-3492-4a30-87de-010070b53115-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.214552 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.214523 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.214552 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.214544 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.214767 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.214751 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.214965 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.214945 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.219373 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.219354 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbfl8\" (UniqueName: \"kubernetes.io/projected/58c3325c-3492-4a30-87de-010070b53115-kube-api-access-qbfl8\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.224030 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.224008 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm465\" (UniqueName: \"kubernetes.io/projected/cac86d78-5a4f-4aea-8ce1-fd573c231d88-kube-api-access-pm465\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.224164 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.224147 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlphh\" (UniqueName: \"kubernetes.io/projected/be3bb7d5-5c75-4172-8b28-0ec92994873b-kube-api-access-xlphh\") pod \"kube-state-metrics-56d9f944b4-x7klf\" (UID: \"be3bb7d5-5c75-4172-8b28-0ec92994873b\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.237818 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.237785 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.341442 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.341357 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.347232 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.347199 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" Jul 28 00:03:07.444113 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.444077 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.473600 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.473551 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf"] Jul 28 00:03:07.476540 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:03:07.476512 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3bb7d5_5c75_4172_8b28_0ec92994873b.slice/crio-40b723a8eee67636ab994cbfafc3929fd23f108a386457bf8c47bc834ceec659 WatchSource:0}: Error finding container 40b723a8eee67636ab994cbfafc3929fd23f108a386457bf8c47bc834ceec659: Status 404 returned error can't find the container with id 40b723a8eee67636ab994cbfafc3929fd23f108a386457bf8c47bc834ceec659 Jul 28 00:03:07.538358 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.538323 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.667307 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.667273 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.715194 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.715164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-tls\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.715367 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.715212 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.717581 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.717539 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cac86d78-5a4f-4aea-8ce1-fd573c231d88-node-exporter-tls\") pod \"node-exporter-qqzvb\" (UID: \"cac86d78-5a4f-4aea-8ce1-fd573c231d88\") " pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.717681 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.717617 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58c3325c-3492-4a30-87de-010070b53115-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-vkm8g\" (UID: \"58c3325c-3492-4a30-87de-010070b53115\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.751964 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.751929 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" event={"ID":"be3bb7d5-5c75-4172-8b28-0ec92994873b","Type":"ContainerStarted","Data":"40b723a8eee67636ab994cbfafc3929fd23f108a386457bf8c47bc834ceec659"} Jul 28 00:03:07.780021 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.779983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.867717 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.867674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.924824 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.924750 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" Jul 28 00:03:07.967247 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.967218 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qqzvb" Jul 28 00:03:07.970490 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:07.970460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:07.989581 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:03:07.983113 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac86d78_5a4f_4aea_8ce1_fd573c231d88.slice/crio-765a96b65164a5dbe97b2066c994f23f70944393e44da9aaa38a124904857fe8 WatchSource:0}: Error finding container 765a96b65164a5dbe97b2066c994f23f70944393e44da9aaa38a124904857fe8: Status 404 returned error can't find the container with id 765a96b65164a5dbe97b2066c994f23f70944393e44da9aaa38a124904857fe8 Jul 28 00:03:08.074718 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.074679 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:08.075349 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.075322 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g"] Jul 28 00:03:08.078122 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:03:08.078098 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c3325c_3492_4a30_87de_010070b53115.slice/crio-8250872148cf5d21cc8f978b83b68210e203ba972588e8c485552ee084813c3c WatchSource:0}: Error finding container 8250872148cf5d21cc8f978b83b68210e203ba972588e8c485552ee084813c3c: Status 404 returned error can't find the container with id 8250872148cf5d21cc8f978b83b68210e203ba972588e8c485552ee084813c3c Jul 28 00:03:08.107571 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.107539 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:03:08.117959 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.117938 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.120282 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120267 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 00:03:08.120443 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120300 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 00:03:08.120443 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120299 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 00:03:08.120607 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120588 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 00:03:08.120683 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120605 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 00:03:08.120683 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120611 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 00:03:08.120683 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120634 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 00:03:08.120833 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120762 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 00:03:08.120833 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120763 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 00:03:08.120950 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.120848 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xf777\"" Jul 28 00:03:08.126329 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.126238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:03:08.135410 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.135387 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:08.218339 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218460 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218362 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218460 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-web-config\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218460 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218430 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218460 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218664 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218664 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218664 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218750 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-config-out\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218750 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218810 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218810 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d82b\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-kube-api-access-4d82b\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.218875 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.218814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.268954 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.268919 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:08.319714 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.319682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.319714 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.319715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d82b\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-kube-api-access-4d82b\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.319735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.319758 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.319886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.319930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-web-config\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320214 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320214 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320077 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320214 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320214 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320214 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320468 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-config-out\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320468 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320613 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320590 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.320666 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320593 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.321010 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.320986 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.321119 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:08.321098 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 28 00:03:08.321175 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:08.321163 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls podName:4c054c5a-484e-480c-895c-1468918fd1cd nodeName:}" failed. No retries permitted until 2026-07-28 00:03:08.821142111 +0000 UTC m=+78.955998324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd") : secret "alertmanager-main-tls" not found Jul 28 00:03:08.322932 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.322881 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.323051 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.323029 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.323133 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.323029 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-web-config\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.323228 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.323209 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.323347 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.323322 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.323393 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.323322 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.323721 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.323702 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.324680 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.324661 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-config-out\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.327957 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.327933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d82b\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-kube-api-access-4d82b\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.368891 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.368856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:08.470465 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.470377 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:08.758589 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.758394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" event={"ID":"58c3325c-3492-4a30-87de-010070b53115","Type":"ContainerStarted","Data":"936311565bafc4928ee4e9ab1c4530e2a5bbc713d27a23b2283b712f3a217bdc"} Jul 28 00:03:08.758589 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.758463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" event={"ID":"58c3325c-3492-4a30-87de-010070b53115","Type":"ContainerStarted","Data":"ec959a7f07aa92b56fa73a13a76dc7c28f3115567e2883b3b1838a3634b19313"} Jul 28 00:03:08.758589 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.758492 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" event={"ID":"58c3325c-3492-4a30-87de-010070b53115","Type":"ContainerStarted","Data":"8250872148cf5d21cc8f978b83b68210e203ba972588e8c485552ee084813c3c"} Jul 28 00:03:08.759884 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.759852 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqzvb" event={"ID":"cac86d78-5a4f-4aea-8ce1-fd573c231d88","Type":"ContainerStarted","Data":"765a96b65164a5dbe97b2066c994f23f70944393e44da9aaa38a124904857fe8"} Jul 28 00:03:08.826175 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.826058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:08.829377 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:08.829343 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:09.028338 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.028312 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:03:09.087318 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.087289 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7"] Jul 28 00:03:09.092947 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.092927 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.096700 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.095968 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 00:03:09.096700 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.096178 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 00:03:09.096700 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.096498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 00:03:09.097321 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.097135 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zmgm8\"" Jul 28 00:03:09.097618 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.097441 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5qaltarhadbdr\"" Jul 28 00:03:09.097722 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.097683 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 00:03:09.099003 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.098080 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 00:03:09.104833 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.104807 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7"] Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl5qd\" (UniqueName: \"kubernetes.io/projected/360fb06d-d847-4149-b641-4d5d28268fb6-kube-api-access-jl5qd\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/360fb06d-d847-4149-b641-4d5d28268fb6-metrics-client-ca\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-grpc-tls\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-tls\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.129335 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.129228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.199607 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.199468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:03:09.230399 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.230550 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.230550 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl5qd\" (UniqueName: \"kubernetes.io/projected/360fb06d-d847-4149-b641-4d5d28268fb6-kube-api-access-jl5qd\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.230550 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/360fb06d-d847-4149-b641-4d5d28268fb6-metrics-client-ca\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.230550 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230504 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.230791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-grpc-tls\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.230791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-tls\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.230791 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.230659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.231439 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.231379 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/360fb06d-d847-4149-b641-4d5d28268fb6-metrics-client-ca\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.233444 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.233404 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.233680 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.233654 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-tls\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.233821 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.233801 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-grpc-tls\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.233909 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.233879 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.234060 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.234042 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.234847 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.234824 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/360fb06d-d847-4149-b641-4d5d28268fb6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.238776 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.238752 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl5qd\" (UniqueName: \"kubernetes.io/projected/360fb06d-d847-4149-b641-4d5d28268fb6-kube-api-access-jl5qd\") pod \"thanos-querier-656c4bdbf4-j6rt7\" (UID: \"360fb06d-d847-4149-b641-4d5d28268fb6\") " pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.407208 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.407167 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:09.443762 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:03:09.443718 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c054c5a_484e_480c_895c_1468918fd1cd.slice/crio-2f322df936b10f60fe53808b29322f304faaef303ef8c98884a2807d6dd7c086 WatchSource:0}: Error finding container 2f322df936b10f60fe53808b29322f304faaef303ef8c98884a2807d6dd7c086: Status 404 returned error can't find the container with id 2f322df936b10f60fe53808b29322f304faaef303ef8c98884a2807d6dd7c086 Jul 28 00:03:09.765805 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.765627 2567 generic.go:356] "Generic (PLEG): container finished" podID="cac86d78-5a4f-4aea-8ce1-fd573c231d88" containerID="dd399dc380e5ef7b391fed33a7768f84908ef3ab5b4d074da6b7986d6e16661a" exitCode=0 Jul 28 00:03:09.765805 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.765709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqzvb" event={"ID":"cac86d78-5a4f-4aea-8ce1-fd573c231d88","Type":"ContainerDied","Data":"dd399dc380e5ef7b391fed33a7768f84908ef3ab5b4d074da6b7986d6e16661a"} Jul 28 00:03:09.768641 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.768609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerStarted","Data":"2f322df936b10f60fe53808b29322f304faaef303ef8c98884a2807d6dd7c086"} Jul 28 00:03:09.866086 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.865991 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7"] Jul 28 00:03:09.964425 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:09.964313 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:10.066746 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.066702 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:10.169239 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.169201 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:10.265426 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.265312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:10.776410 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.776376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqzvb" event={"ID":"cac86d78-5a4f-4aea-8ce1-fd573c231d88","Type":"ContainerStarted","Data":"dc4e838190d3bd65645f94da584432527176cce1b3c3a7e844ce6e200c0986a8"} Jul 28 00:03:10.776580 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.776427 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqzvb" event={"ID":"cac86d78-5a4f-4aea-8ce1-fd573c231d88","Type":"ContainerStarted","Data":"ea070a284632d822100433a3558f765748a84472e37da3e48bea158ac0178477"} Jul 28 00:03:10.777937 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.777910 2567 generic.go:356] "Generic (PLEG): container finished" podID="4c054c5a-484e-480c-895c-1468918fd1cd" containerID="706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802" exitCode=0 Jul 28 00:03:10.778042 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.777980 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802"} Jul 28 00:03:10.779379 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.779346 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" event={"ID":"360fb06d-d847-4149-b641-4d5d28268fb6","Type":"ContainerStarted","Data":"769114c84638c9f67f55e7f7935ea2c73a2473eda798ff3e13fbf7cb4b38b76e"} Jul 28 00:03:10.781554 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.781530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" event={"ID":"be3bb7d5-5c75-4172-8b28-0ec92994873b","Type":"ContainerStarted","Data":"6fb5f404683e138d1c3fabfbb0603be3233341d0e0abb4f26c481a9549ba21fc"} Jul 28 00:03:10.781663 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.781595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" event={"ID":"be3bb7d5-5c75-4172-8b28-0ec92994873b","Type":"ContainerStarted","Data":"0cb8e6e0523a536fb4b83daecbd1ea6365927b841e1715c39219e848a9421264"} Jul 28 00:03:10.781663 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.781632 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" event={"ID":"be3bb7d5-5c75-4172-8b28-0ec92994873b","Type":"ContainerStarted","Data":"d261fc36c38ac34b407cfdc593583c3575921ef9099ee7e56757ffb0f42e6efb"} Jul 28 00:03:10.783431 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.783410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" event={"ID":"58c3325c-3492-4a30-87de-010070b53115","Type":"ContainerStarted","Data":"73cbc845e597fb3b20e654be2b403df462fb19f427cebaa3ab30abf10d2c581b"} Jul 28 00:03:10.794806 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.794757 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qqzvb" podStartSLOduration=2.676228875 podStartE2EDuration="3.794743414s" totalImagesPullingTime="1.037019917s" totalInitContainerRuntime="81.494622ms" isStatefulPod=true podCreationTimestamp="2026-07-28 00:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:10.793512354 +0000 UTC m=+80.928368563" watchObservedRunningTime="2026-07-28 00:03:10.794743414 +0000 UTC m=+80.929599646" Jul 28 00:03:10.814491 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.814439 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x7klf" podStartSLOduration=1.588140005 podStartE2EDuration="3.814425346s" totalImagesPullingTime="2.226285341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:10.813388418 +0000 UTC m=+80.948244690" watchObservedRunningTime="2026-07-28 00:03:10.814425346 +0000 UTC m=+80.949281556" Jul 28 00:03:10.853265 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:10.853215 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-vkm8g" podStartSLOduration=3.347205623 podStartE2EDuration="4.853199773s" totalImagesPullingTime="1.50599415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:10.852768063 +0000 UTC m=+80.987624305" watchObservedRunningTime="2026-07-28 00:03:10.853199773 +0000 UTC m=+80.988056004" Jul 28 00:03:11.254366 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.254328 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:11.358645 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.358608 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:11.364844 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.364818 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-558fbc6999-2hzdd"] Jul 28 00:03:11.368082 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.368062 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.369987 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.369964 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 00:03:11.370096 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.370015 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6pb8f\"" Jul 28 00:03:11.370704 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.370675 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 00:03:11.370810 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.370783 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7m9s64crt1sbo\"" Jul 28 00:03:11.370872 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.370682 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 00:03:11.371754 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.371622 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 00:03:11.379015 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.378994 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-558fbc6999-2hzdd"] Jul 28 00:03:11.451431 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.451398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-client-ca-bundle\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.451628 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.451445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bfad7d4-5323-44f7-9ce6-32db877f276c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.451628 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.451517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-secret-metrics-server-client-certs\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.451628 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.451613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-secret-metrics-server-tls\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.451813 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.451671 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bfad7d4-5323-44f7-9ce6-32db877f276c-audit-log\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.451813 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.451704 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bfad7d4-5323-44f7-9ce6-32db877f276c-metrics-server-audit-profiles\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.451813 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.451742 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whnd\" (UniqueName: \"kubernetes.io/projected/3bfad7d4-5323-44f7-9ce6-32db877f276c-kube-api-access-5whnd\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.552823 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.552734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bfad7d4-5323-44f7-9ce6-32db877f276c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.552823 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.552787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-secret-metrics-server-client-certs\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.553036 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.552835 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-secret-metrics-server-tls\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.553036 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.552874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bfad7d4-5323-44f7-9ce6-32db877f276c-audit-log\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.553036 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.552895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bfad7d4-5323-44f7-9ce6-32db877f276c-metrics-server-audit-profiles\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.553036 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.552919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5whnd\" (UniqueName: \"kubernetes.io/projected/3bfad7d4-5323-44f7-9ce6-32db877f276c-kube-api-access-5whnd\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.553036 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.552943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-client-ca-bundle\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.553558 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.553529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bfad7d4-5323-44f7-9ce6-32db877f276c-audit-log\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.553668 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.553648 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bfad7d4-5323-44f7-9ce6-32db877f276c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.554463 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.554436 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bfad7d4-5323-44f7-9ce6-32db877f276c-metrics-server-audit-profiles\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.555968 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.555922 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-client-ca-bundle\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.556809 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.556769 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-secret-metrics-server-tls\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.556911 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.556884 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bfad7d4-5323-44f7-9ce6-32db877f276c-secret-metrics-server-client-certs\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.561291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.561243 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whnd\" (UniqueName: \"kubernetes.io/projected/3bfad7d4-5323-44f7-9ce6-32db877f276c-kube-api-access-5whnd\") pod \"metrics-server-558fbc6999-2hzdd\" (UID: \"3bfad7d4-5323-44f7-9ce6-32db877f276c\") " pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.679450 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.679409 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:11.760175 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.760143 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg"] Jul 28 00:03:11.764390 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.764368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:11.768166 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.767730 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 00:03:11.768166 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.768013 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mr6jd\"" Jul 28 00:03:11.773646 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.773474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:11.774066 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.774041 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg"] Jul 28 00:03:11.846153 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.846062 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-558fbc6999-2hzdd"] Jul 28 00:03:11.850583 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:03:11.849575 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfad7d4_5323_44f7_9ce6_32db877f276c.slice/crio-a771c6e00166f92c947b656b085ae036b0ac376228017faab4c378de06216366 WatchSource:0}: Error finding container a771c6e00166f92c947b656b085ae036b0ac376228017faab4c378de06216366: Status 404 returned error can't find the container with id a771c6e00166f92c947b656b085ae036b0ac376228017faab4c378de06216366 Jul 28 00:03:11.856009 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.855854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80f43308-f2b8-423c-8a00-4bd2b46392ce-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vl6fg\" (UID: \"80f43308-f2b8-423c-8a00-4bd2b46392ce\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:11.856009 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.855996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2lv\" (UniqueName: \"kubernetes.io/projected/80f43308-f2b8-423c-8a00-4bd2b46392ce-kube-api-access-rz2lv\") pod \"monitoring-plugin-68b7fc9574-vl6fg\" (UID: \"80f43308-f2b8-423c-8a00-4bd2b46392ce\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:11.957001 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.956954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2lv\" (UniqueName: \"kubernetes.io/projected/80f43308-f2b8-423c-8a00-4bd2b46392ce-kube-api-access-rz2lv\") pod \"monitoring-plugin-68b7fc9574-vl6fg\" (UID: \"80f43308-f2b8-423c-8a00-4bd2b46392ce\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:11.957161 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.957046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80f43308-f2b8-423c-8a00-4bd2b46392ce-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vl6fg\" (UID: \"80f43308-f2b8-423c-8a00-4bd2b46392ce\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:11.957219 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:11.957172 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 28 00:03:11.957258 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:03:11.957250 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f43308-f2b8-423c-8a00-4bd2b46392ce-monitoring-plugin-cert podName:80f43308-f2b8-423c-8a00-4bd2b46392ce nodeName:}" failed. No retries permitted until 2026-07-28 00:03:12.457227824 +0000 UTC m=+82.592084052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/80f43308-f2b8-423c-8a00-4bd2b46392ce-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-vl6fg" (UID: "80f43308-f2b8-423c-8a00-4bd2b46392ce") : secret "monitoring-plugin-cert" not found Jul 28 00:03:11.968407 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:11.968374 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2lv\" (UniqueName: \"kubernetes.io/projected/80f43308-f2b8-423c-8a00-4bd2b46392ce-kube-api-access-rz2lv\") pod \"monitoring-plugin-68b7fc9574-vl6fg\" (UID: \"80f43308-f2b8-423c-8a00-4bd2b46392ce\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:12.104989 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.104902 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:12.461092 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.461051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80f43308-f2b8-423c-8a00-4bd2b46392ce-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vl6fg\" (UID: \"80f43308-f2b8-423c-8a00-4bd2b46392ce\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:12.463713 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.463685 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80f43308-f2b8-423c-8a00-4bd2b46392ce-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vl6fg\" (UID: \"80f43308-f2b8-423c-8a00-4bd2b46392ce\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:12.681041 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.680952 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:12.791668 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.791581 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" event={"ID":"3bfad7d4-5323-44f7-9ce6-32db877f276c","Type":"ContainerStarted","Data":"a771c6e00166f92c947b656b085ae036b0ac376228017faab4c378de06216366"} Jul 28 00:03:12.810015 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.809985 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:12.923544 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.923497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:12.971414 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:12.971385 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg"] Jul 28 00:03:12.973108 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:03:12.973060 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f43308_f2b8_423c_8a00_4bd2b46392ce.slice/crio-dd367c556b1796378492a62696342a19581ae26bbcf0319b9e7f5c15755666fa WatchSource:0}: Error finding container dd367c556b1796378492a62696342a19581ae26bbcf0319b9e7f5c15755666fa: Status 404 returned error can't find the container with id dd367c556b1796378492a62696342a19581ae26bbcf0319b9e7f5c15755666fa Jul 28 00:03:13.330053 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.329166 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:03:13.330787 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.330751 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:13.338062 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.338032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.349262 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.349009 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 00:03:13.349262 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.349206 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 00:03:13.349523 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.349490 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 00:03:13.350086 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.349866 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 00:03:13.350086 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.349981 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t7jxm\"" Jul 28 00:03:13.350721 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.350352 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 00:03:13.350721 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.350401 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 00:03:13.350721 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.350587 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 00:03:13.350917 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.350809 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 00:03:13.351291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.350986 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 00:03:13.351291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.351099 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4t6ahsa30csld\"" Jul 28 00:03:13.351291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.351170 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 00:03:13.351456 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.351384 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 00:03:13.356174 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.354874 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 00:03:13.356174 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.355094 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 00:03:13.356387 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.356366 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:03:13.361542 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.361512 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 00:03:13.370612 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-config\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.370788 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.370788 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq94n\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-kube-api-access-jq94n\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.370788 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.370788 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370779 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371004 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370839 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371004 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371004 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371004 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370952 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371004 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.370998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371227 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371227 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371227 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371227 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371227 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371465 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371465 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371465 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371465 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.371465 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.371367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.432694 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.432601 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:13.472178 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472140 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472178 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-config\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq94n\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-kube-api-access-jq94n\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472710 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.472727 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.473496 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472923 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.473496 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.473496 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.472989 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.473496 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.473214 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.474144 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.473789 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.474144 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.473967 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.477026 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.474507 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.477026 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.475389 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.477026 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.475658 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.477253 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.477155 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.477984 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.477960 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.478357 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.478334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.479030 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.478996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.479172 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.479148 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.479424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.479377 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.479621 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.479600 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.479851 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.479830 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.480307 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.480260 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-config\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.480395 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.480331 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.481187 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.481149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.481908 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.481860 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq94n\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-kube-api-access-jq94n\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.482008 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.481938 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.502057 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.502010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:13.653447 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.653390 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:13.706800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.706756 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:13.798990 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.798954 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" event={"ID":"80f43308-f2b8-423c-8a00-4bd2b46392ce","Type":"ContainerStarted","Data":"dd367c556b1796378492a62696342a19581ae26bbcf0319b9e7f5c15755666fa"} Jul 28 00:03:13.804898 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.804860 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerStarted","Data":"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1"} Jul 28 00:03:13.805064 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.804950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerStarted","Data":"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc"} Jul 28 00:03:13.805064 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.804993 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerStarted","Data":"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac"} Jul 28 00:03:13.805064 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.805033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerStarted","Data":"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d"} Jul 28 00:03:13.805192 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.805071 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerStarted","Data":"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd"} Jul 28 00:03:13.807476 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.807437 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" event={"ID":"360fb06d-d847-4149-b641-4d5d28268fb6","Type":"ContainerStarted","Data":"43a1dc11482ed5939980013f3963eb646520850efa0577279b07db5793fed034"} Jul 28 00:03:13.807632 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.807524 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" event={"ID":"360fb06d-d847-4149-b641-4d5d28268fb6","Type":"ContainerStarted","Data":"c6cb992df2249598d86696376472a36a96416df66cdf918f764d8a28ee108986"} Jul 28 00:03:13.807632 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.807587 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" event={"ID":"360fb06d-d847-4149-b641-4d5d28268fb6","Type":"ContainerStarted","Data":"e8610cfb3fd866adb4f46105f403b3e0b1cf508d09abd8110b36b606c466d778"} Jul 28 00:03:13.860512 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.860419 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:13.929244 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:13.929161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:14.053350 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.053115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:14.149728 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.149618 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:03:14.152310 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.152225 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:14.154293 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:03:14.154263 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c08be2b_5935_4400_b016_cfd785d1d04a.slice/crio-e8bf03ab45b58895807f8ef58c188bb077e20ed0f0c99e556173b2a3dd15d320 WatchSource:0}: Error finding container e8bf03ab45b58895807f8ef58c188bb077e20ed0f0c99e556173b2a3dd15d320: Status 404 returned error can't find the container with id e8bf03ab45b58895807f8ef58c188bb077e20ed0f0c99e556173b2a3dd15d320 Jul 28 00:03:14.462343 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.462267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:14.816402 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.816361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" event={"ID":"360fb06d-d847-4149-b641-4d5d28268fb6","Type":"ContainerStarted","Data":"6fd9e6ac89665491c5219d8a9e444c7e0d575be3758100fb6cd5ebe0164c963d"} Jul 28 00:03:14.816826 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.816446 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" event={"ID":"360fb06d-d847-4149-b641-4d5d28268fb6","Type":"ContainerStarted","Data":"9dacc8ae657867e74d645f8c409cc8a7dc3575dd66c29d5ab3266f94901b5995"} Jul 28 00:03:14.816826 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.816492 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:14.816826 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.816520 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" event={"ID":"360fb06d-d847-4149-b641-4d5d28268fb6","Type":"ContainerStarted","Data":"c66adf0c33e95096d9d3fa1c3cb586f23e1c218e70e1d217be395d3503f62394"} Jul 28 00:03:14.818437 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.818413 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" event={"ID":"3bfad7d4-5323-44f7-9ce6-32db877f276c","Type":"ContainerStarted","Data":"484dee3e1cb411410237441428bfc109b879bcddd94ccab9741771cc5186ea33"} Jul 28 00:03:14.822228 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.822200 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerStarted","Data":"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390"} Jul 28 00:03:14.824043 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.823958 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" exitCode=0 Jul 28 00:03:14.824043 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.823990 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be"} Jul 28 00:03:14.824198 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.824047 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerStarted","Data":"e8bf03ab45b58895807f8ef58c188bb077e20ed0f0c99e556173b2a3dd15d320"} Jul 28 00:03:14.843192 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.843121 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" podStartSLOduration=1.454393494 podStartE2EDuration="5.843096093s" totalImagesPullingTime="4.388702599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:14.840923271 +0000 UTC m=+84.975779503" watchObservedRunningTime="2026-07-28 00:03:14.843096093 +0000 UTC m=+84.977952327" Jul 28 00:03:14.857106 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.857065 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:14.867599 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.867531 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.324276388 podStartE2EDuration="6.867508276s" totalImagesPullingTime="4.527610768s" totalInitContainerRuntime="15.62112ms" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:14.865763564 +0000 UTC m=+85.000619797" watchObservedRunningTime="2026-07-28 00:03:14.867508276 +0000 UTC m=+85.002364509" Jul 28 00:03:14.891373 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.891309 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" podStartSLOduration=1.6847082169999998 podStartE2EDuration="3.891286725s" totalImagesPullingTime="2.206578508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:14.888783555 +0000 UTC m=+85.023639798" watchObservedRunningTime="2026-07-28 00:03:14.891286725 +0000 UTC m=+85.026142957" Jul 28 00:03:14.957997 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:14.957963 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:15.071610 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:15.071496 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:15.433337 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:15.433299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:15.534301 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:15.534267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:15.831178 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:15.831087 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" event={"ID":"80f43308-f2b8-423c-8a00-4bd2b46392ce","Type":"ContainerStarted","Data":"af669b38429308ada0fb88722619eb389d5aa756aa9a57ade2c43f8faf2ecb5a"} Jul 28 00:03:15.832123 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:15.832086 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:15.837449 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:15.837412 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" Jul 28 00:03:15.847401 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:15.847338 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vl6fg" podStartSLOduration=2.669028155 podStartE2EDuration="4.847323763s" totalImagesPullingTime="2.178295608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:15.845377398 +0000 UTC m=+85.980233640" watchObservedRunningTime="2026-07-28 00:03:15.847323763 +0000 UTC m=+85.982179993" Jul 28 00:03:18.851220 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:18.851135 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerStarted","Data":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} Jul 28 00:03:18.851220 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:18.851198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerStarted","Data":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} Jul 28 00:03:18.851658 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:18.851223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerStarted","Data":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} Jul 28 00:03:18.851658 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:18.851247 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerStarted","Data":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} Jul 28 00:03:18.851658 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:18.851271 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerStarted","Data":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} Jul 28 00:03:18.851658 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:18.851294 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerStarted","Data":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} Jul 28 00:03:18.881532 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:18.881464 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.349303341 podStartE2EDuration="5.881446183s" totalImagesPullingTime="3.505478355s" totalInitContainerRuntime="26.664487ms" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:18.879650316 +0000 UTC m=+89.014506548" watchObservedRunningTime="2026-07-28 00:03:18.881446183 +0000 UTC m=+89.016302442" Jul 28 00:03:19.697358 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:19.697320 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:19.798913 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:19.798866 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:20.131789 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:20.131703 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:20.232953 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:20.232917 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:20.450897 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:20.450850 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:20.837889 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:20.837812 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-656c4bdbf4-j6rt7" Jul 28 00:03:21.811752 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:21.811714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:21.868293 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:21.868252 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:22.350302 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:22.350266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:22.451395 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:22.451364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:23.653758 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:23.653717 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:03:25.495358 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:25.495323 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:25.628752 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:25.628714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:25.744228 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:25.744192 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:29.023313 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:29.023273 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:29.076598 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:29.076540 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:31.086473 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:31.086433 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:31.167198 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:31.167163 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:31.679842 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:31.679786 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:31.680016 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:31.679892 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:33.140201 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:33.140167 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:33.241166 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:33.241135 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:33.341325 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:33.341296 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:34.033274 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:34.033243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:34.089815 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:34.089788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:35.091478 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:35.091444 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:35.347301 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:35.347192 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:35.745536 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:35.745510 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bwgk9" Jul 28 00:03:38.122666 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:38.122620 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:38.182291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:38.182258 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:38.685540 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:38.685503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:38.786283 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:38.786240 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:40.486413 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:40.486370 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:40.588385 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:40.588350 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:40.644161 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:40.644130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:51.685196 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:51.685164 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:51.689131 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:51.689106 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-558fbc6999-2hzdd" Jul 28 00:03:55.600161 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:55.600130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:55.657101 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:03:55.657068 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:13.653784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:13.653719 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:13.673356 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:13.673325 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:14.087835 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:14.087749 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:26.226986 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:26.226937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:26.330851 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:26.330814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:27.289819 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:27.289778 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:04:27.290249 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:27.290204 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="alertmanager" containerID="cri-o://a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd" gracePeriod=120 Jul 28 00:04:27.290315 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:27.290275 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-web" containerID="cri-o://8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac" gracePeriod=120 Jul 28 00:04:27.290315 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:27.290275 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-metric" containerID="cri-o://fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1" gracePeriod=120 Jul 28 00:04:27.290420 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:27.290307 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy" containerID="cri-o://ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc" gracePeriod=120 Jul 28 00:04:27.290420 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:27.290337 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="prom-label-proxy" containerID="cri-o://ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390" gracePeriod=120 Jul 28 00:04:27.290420 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:27.290342 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="config-reloader" containerID="cri-o://d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d" gracePeriod=120 Jul 28 00:04:28.129230 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129192 2567 generic.go:356] "Generic (PLEG): container finished" podID="4c054c5a-484e-480c-895c-1468918fd1cd" containerID="ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390" exitCode=0 Jul 28 00:04:28.129230 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129220 2567 generic.go:356] "Generic (PLEG): container finished" podID="4c054c5a-484e-480c-895c-1468918fd1cd" containerID="ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc" exitCode=0 Jul 28 00:04:28.129230 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129228 2567 generic.go:356] "Generic (PLEG): container finished" podID="4c054c5a-484e-480c-895c-1468918fd1cd" containerID="d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d" exitCode=0 Jul 28 00:04:28.129230 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129234 2567 generic.go:356] "Generic (PLEG): container finished" podID="4c054c5a-484e-480c-895c-1468918fd1cd" containerID="a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd" exitCode=0 Jul 28 00:04:28.129539 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390"} Jul 28 00:04:28.129539 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc"} Jul 28 00:04:28.129539 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d"} Jul 28 00:04:28.129539 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.129387 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd"} Jul 28 00:04:28.539404 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.539371 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:28.631151 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631110 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-web-config\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631320 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631186 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-tls-assets\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631320 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631216 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d82b\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-kube-api-access-4d82b\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631320 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631244 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631320 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631276 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631320 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631304 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-cluster-tls-config\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631586 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631342 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-main-db\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631586 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631376 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631586 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631423 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-config-volume\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631586 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631451 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631586 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631480 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-config-out\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631586 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631538 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-metrics-client-ca\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631887 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631590 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-trusted-ca-bundle\") pod \"4c054c5a-484e-480c-895c-1468918fd1cd\" (UID: \"4c054c5a-484e-480c-895c-1468918fd1cd\") " Jul 28 00:04:28.631887 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631757 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:04:28.631987 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.631910 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-main-db\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.632220 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.632131 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:28.632641 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.632424 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:28.634359 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.634312 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:28.634895 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.634868 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:04:28.634895 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.634878 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:28.635233 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.635192 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:28.635318 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.635262 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-config-out" (OuterVolumeSpecName: "config-out") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:04:28.635532 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.635508 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-config-volume" (OuterVolumeSpecName: "config-volume") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:28.635656 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.635636 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:28.635730 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.635715 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-kube-api-access-4d82b" (OuterVolumeSpecName: "kube-api-access-4d82b") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "kube-api-access-4d82b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:04:28.639832 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.639758 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:28.646069 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.646041 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-web-config" (OuterVolumeSpecName: "web-config") pod "4c054c5a-484e-480c-895c-1468918fd1cd" (UID: "4c054c5a-484e-480c-895c-1468918fd1cd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732675 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-tls-assets\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732703 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d82b\" (UniqueName: \"kubernetes.io/projected/4c054c5a-484e-480c-895c-1468918fd1cd-kube-api-access-4d82b\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732715 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732725 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732736 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-cluster-tls-config\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732745 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-main-tls\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732754 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-config-volume\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.732759 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732763 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.733104 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732771 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c054c5a-484e-480c-895c-1468918fd1cd-config-out\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.733104 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732780 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-metrics-client-ca\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.733104 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732790 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c054c5a-484e-480c-895c-1468918fd1cd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:28.733104 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:28.732798 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c054c5a-484e-480c-895c-1468918fd1cd-web-config\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:29.136443 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.136349 2567 generic.go:356] "Generic (PLEG): container finished" podID="4c054c5a-484e-480c-895c-1468918fd1cd" containerID="fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1" exitCode=0 Jul 28 00:04:29.136443 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.136385 2567 generic.go:356] "Generic (PLEG): container finished" podID="4c054c5a-484e-480c-895c-1468918fd1cd" containerID="8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac" exitCode=0 Jul 28 00:04:29.136443 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.136393 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1"} Jul 28 00:04:29.136443 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.136437 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.136722 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.136471 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac"} Jul 28 00:04:29.136722 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.136498 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c054c5a-484e-480c-895c-1468918fd1cd","Type":"ContainerDied","Data":"2f322df936b10f60fe53808b29322f304faaef303ef8c98884a2807d6dd7c086"} Jul 28 00:04:29.136722 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.136529 2567 scope.go:117] "RemoveContainer" containerID="ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390" Jul 28 00:04:29.145835 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.145812 2567 scope.go:117] "RemoveContainer" containerID="fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1" Jul 28 00:04:29.153771 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.153750 2567 scope.go:117] "RemoveContainer" containerID="ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc" Jul 28 00:04:29.161076 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.161043 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:04:29.162814 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.162792 2567 scope.go:117] "RemoveContainer" containerID="8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac" Jul 28 00:04:29.165595 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.165541 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:04:29.170981 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.170961 2567 scope.go:117] "RemoveContainer" containerID="d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d" Jul 28 00:04:29.178577 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.178541 2567 scope.go:117] "RemoveContainer" containerID="a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd" Jul 28 00:04:29.186452 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.186433 2567 scope.go:117] "RemoveContainer" containerID="706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802" Jul 28 00:04:29.192076 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192051 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:04:29.192453 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192431 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-web" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192460 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-web" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192481 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="init-config-reloader" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192490 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="init-config-reloader" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192497 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-metric" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192504 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-metric" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192531 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="config-reloader" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192540 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="config-reloader" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192554 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192576 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192615 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="prom-label-proxy" Jul 28 00:04:29.192624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192625 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="prom-label-proxy" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192637 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="alertmanager" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192645 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="alertmanager" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192733 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192743 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="alertmanager" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192750 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-web" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192757 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="kube-rbac-proxy-metric" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192763 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="config-reloader" Jul 28 00:04:29.193017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.192768 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" containerName="prom-label-proxy" Jul 28 00:04:29.198403 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.196175 2567 scope.go:117] "RemoveContainer" containerID="ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390" Jul 28 00:04:29.199386 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:29.199291 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390\": container with ID starting with ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390 not found: ID does not exist" containerID="ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390" Jul 28 00:04:29.199539 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.199337 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390"} err="failed to get container status \"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390\": rpc error: code = NotFound desc = could not find container \"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390\": container with ID starting with ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390 not found: ID does not exist" Jul 28 00:04:29.199689 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.199541 2567 scope.go:117] "RemoveContainer" containerID="fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1" Jul 28 00:04:29.201488 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:29.201456 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1\": container with ID starting with fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1 not found: ID does not exist" containerID="fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1" Jul 28 00:04:29.201626 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.201493 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1"} err="failed to get container status \"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1\": rpc error: code = NotFound desc = could not find container \"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1\": container with ID starting with fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1 not found: ID does not exist" Jul 28 00:04:29.201626 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.201516 2567 scope.go:117] "RemoveContainer" containerID="ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc" Jul 28 00:04:29.201867 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:29.201850 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc\": container with ID starting with ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc not found: ID does not exist" containerID="ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc" Jul 28 00:04:29.201919 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.201874 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc"} err="failed to get container status \"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc\": rpc error: code = NotFound desc = could not find container \"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc\": container with ID starting with ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc not found: ID does not exist" Jul 28 00:04:29.201919 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.201892 2567 scope.go:117] "RemoveContainer" containerID="8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac" Jul 28 00:04:29.202189 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:29.202167 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac\": container with ID starting with 8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac not found: ID does not exist" containerID="8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac" Jul 28 00:04:29.202262 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.202191 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac"} err="failed to get container status \"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac\": rpc error: code = NotFound desc = could not find container \"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac\": container with ID starting with 8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac not found: ID does not exist" Jul 28 00:04:29.202262 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.202206 2567 scope.go:117] "RemoveContainer" containerID="d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d" Jul 28 00:04:29.202486 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:29.202463 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d\": container with ID starting with d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d not found: ID does not exist" containerID="d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d" Jul 28 00:04:29.202534 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.202495 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d"} err="failed to get container status \"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d\": rpc error: code = NotFound desc = could not find container \"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d\": container with ID starting with d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d not found: ID does not exist" Jul 28 00:04:29.202534 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.202515 2567 scope.go:117] "RemoveContainer" containerID="a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd" Jul 28 00:04:29.202873 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:29.202830 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd\": container with ID starting with a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd not found: ID does not exist" containerID="a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd" Jul 28 00:04:29.202925 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.202898 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd"} err="failed to get container status \"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd\": rpc error: code = NotFound desc = could not find container \"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd\": container with ID starting with a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd not found: ID does not exist" Jul 28 00:04:29.202963 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.202938 2567 scope.go:117] "RemoveContainer" containerID="706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802" Jul 28 00:04:29.203217 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.203184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.203296 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:29.203269 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802\": container with ID starting with 706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802 not found: ID does not exist" containerID="706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802" Jul 28 00:04:29.203340 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.203312 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802"} err="failed to get container status \"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802\": rpc error: code = NotFound desc = could not find container \"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802\": container with ID starting with 706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802 not found: ID does not exist" Jul 28 00:04:29.203398 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.203348 2567 scope.go:117] "RemoveContainer" containerID="ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390" Jul 28 00:04:29.203776 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.203755 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390"} err="failed to get container status \"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390\": rpc error: code = NotFound desc = could not find container \"ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390\": container with ID starting with ea014dc38e4e4f46f537f3c0a02d05b7fef10fd4b0653377ff320106175b1390 not found: ID does not exist" Jul 28 00:04:29.203776 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.203776 2567 scope.go:117] "RemoveContainer" containerID="fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1" Jul 28 00:04:29.204030 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204010 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1"} err="failed to get container status \"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1\": rpc error: code = NotFound desc = could not find container \"fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1\": container with ID starting with fb5b505c05dd73646796e95a58b6f3e65d52c4f52b26f8478ed477d8b4583bc1 not found: ID does not exist" Jul 28 00:04:29.204030 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204028 2567 scope.go:117] "RemoveContainer" containerID="ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc" Jul 28 00:04:29.204300 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204280 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc"} err="failed to get container status \"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc\": rpc error: code = NotFound desc = could not find container \"ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc\": container with ID starting with ccdf5767494b8450b4e391c050bd69b6b96184d5ee251a1fb388c6846c03a9cc not found: ID does not exist" Jul 28 00:04:29.204368 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204300 2567 scope.go:117] "RemoveContainer" containerID="8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac" Jul 28 00:04:29.204528 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204509 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac"} err="failed to get container status \"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac\": rpc error: code = NotFound desc = could not find container \"8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac\": container with ID starting with 8d8270c2a3464f565ea3cfc195f60f3b9918a36e2f3af7bf752cfc44159c9dac not found: ID does not exist" Jul 28 00:04:29.204624 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204529 2567 scope.go:117] "RemoveContainer" containerID="d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d" Jul 28 00:04:29.204792 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204773 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d"} err="failed to get container status \"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d\": rpc error: code = NotFound desc = could not find container \"d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d\": container with ID starting with d9c3cc372b74efc467bf46ad7c7913b6ca892149e135907ba8938f4049d44c0d not found: ID does not exist" Jul 28 00:04:29.204850 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.204792 2567 scope.go:117] "RemoveContainer" containerID="a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd" Jul 28 00:04:29.205024 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.205005 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd"} err="failed to get container status \"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd\": rpc error: code = NotFound desc = could not find container \"a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd\": container with ID starting with a711874aef5ff80367f96df7a72f05164d1255ad3841f76ce5bc2acd5355bcdd not found: ID does not exist" Jul 28 00:04:29.205070 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.205025 2567 scope.go:117] "RemoveContainer" containerID="706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802" Jul 28 00:04:29.205253 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.205233 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802"} err="failed to get container status \"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802\": rpc error: code = NotFound desc = could not find container \"706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802\": container with ID starting with 706f9010e41543fabfda61093056c7f69d45665853aaee34396827373a208802 not found: ID does not exist" Jul 28 00:04:29.205816 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.205803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 00:04:29.205863 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.205804 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 00:04:29.205905 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.205890 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 00:04:29.206116 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.206097 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 00:04:29.206164 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.206101 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 00:04:29.206397 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.206379 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xf777\"" Jul 28 00:04:29.206771 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.206754 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 00:04:29.206887 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.206834 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 00:04:29.206887 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.206839 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 00:04:29.209986 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.209861 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:04:29.211812 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.211793 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 00:04:29.337635 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-web-config\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.337635 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f0d5c6-93f9-440f-83b7-da2fe76916b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.337865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zql4n\" (UniqueName: \"kubernetes.io/projected/40f0d5c6-93f9-440f-83b7-da2fe76916b0-kube-api-access-zql4n\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.337865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.337865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.337865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f0d5c6-93f9-440f-83b7-da2fe76916b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.337865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f0d5c6-93f9-440f-83b7-da2fe76916b0-config-out\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.338386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f0d5c6-93f9-440f-83b7-da2fe76916b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.338386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.338386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337951 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f0d5c6-93f9-440f-83b7-da2fe76916b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.338386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.338386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.337994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.338386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.338021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.438724 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.438688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f0d5c6-93f9-440f-83b7-da2fe76916b0-config-out\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.438838 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.438735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f0d5c6-93f9-440f-83b7-da2fe76916b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.438838 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.438758 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.438838 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.438785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f0d5c6-93f9-440f-83b7-da2fe76916b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.438838 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.438814 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.438971 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.438839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.438971 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.438872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.439058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-web-config\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.439111 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f0d5c6-93f9-440f-83b7-da2fe76916b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.439111 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zql4n\" (UniqueName: \"kubernetes.io/projected/40f0d5c6-93f9-440f-83b7-da2fe76916b0-kube-api-access-zql4n\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.439209 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.439209 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.439209 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439200 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40f0d5c6-93f9-440f-83b7-da2fe76916b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.439353 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439204 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f0d5c6-93f9-440f-83b7-da2fe76916b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.440094 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439788 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40f0d5c6-93f9-440f-83b7-da2fe76916b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.440094 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.439894 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40f0d5c6-93f9-440f-83b7-da2fe76916b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.441760 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.441736 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40f0d5c6-93f9-440f-83b7-da2fe76916b0-config-out\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.441865 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.441825 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.441952 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.441926 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.442085 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.442066 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.442327 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.442311 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40f0d5c6-93f9-440f-83b7-da2fe76916b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.442494 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.442470 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.442587 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.442480 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-web-config\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.442636 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.442584 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.443751 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.443731 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40f0d5c6-93f9-440f-83b7-da2fe76916b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.449193 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.449170 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zql4n\" (UniqueName: \"kubernetes.io/projected/40f0d5c6-93f9-440f-83b7-da2fe76916b0-kube-api-access-zql4n\") pod \"alertmanager-main-0\" (UID: \"40f0d5c6-93f9-440f-83b7-da2fe76916b0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.516426 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.516394 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 00:04:29.655412 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:29.655385 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 00:04:29.657245 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:04:29.657221 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f0d5c6_93f9_440f_83b7_da2fe76916b0.slice/crio-4f0d59876f30a776d0d2c0f0e9377338766d265b5006ae3968eb2a9b4abcdff3 WatchSource:0}: Error finding container 4f0d59876f30a776d0d2c0f0e9377338766d265b5006ae3968eb2a9b4abcdff3: Status 404 returned error can't find the container with id 4f0d59876f30a776d0d2c0f0e9377338766d265b5006ae3968eb2a9b4abcdff3 Jul 28 00:04:30.142353 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:30.142325 2567 generic.go:356] "Generic (PLEG): container finished" podID="40f0d5c6-93f9-440f-83b7-da2fe76916b0" containerID="5346868d3d718599620bba8705363e76bdf0ae1dcd969a737e9592958a5e23d4" exitCode=0 Jul 28 00:04:30.142503 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:30.142417 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerDied","Data":"5346868d3d718599620bba8705363e76bdf0ae1dcd969a737e9592958a5e23d4"} Jul 28 00:04:30.142503 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:30.142485 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerStarted","Data":"4f0d59876f30a776d0d2c0f0e9377338766d265b5006ae3968eb2a9b4abcdff3"} Jul 28 00:04:30.431945 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:30.431915 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c054c5a-484e-480c-895c-1468918fd1cd" path="/var/lib/kubelet/pods/4c054c5a-484e-480c-895c-1468918fd1cd/volumes" Jul 28 00:04:31.150625 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.150593 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerStarted","Data":"a0e95a6cc9724b3157ded2a3695de534315207ad02593c93f07d6cb66be8d4e5"} Jul 28 00:04:31.150998 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.150685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerStarted","Data":"fb13f33e3593b0d9ce6d3181615a13453497e13f2b98ae124c7b16f59d7fd6d1"} Jul 28 00:04:31.150998 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.150713 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerStarted","Data":"f3de6ebcf422331a40265052bd913c1825e19500ee54b4afe9f225d1c614e363"} Jul 28 00:04:31.150998 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.150746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerStarted","Data":"225f6f7d972a72fff7e4f636038fb60126ac7df371c21c0f66dfd15e33567b80"} Jul 28 00:04:31.150998 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.150773 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerStarted","Data":"86d3dfa75577ac94331dfd54dbcce21f3682f549443e4b47418c1f1fbbf5a457"} Jul 28 00:04:31.150998 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.150804 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40f0d5c6-93f9-440f-83b7-da2fe76916b0","Type":"ContainerStarted","Data":"dad036787b2a70155a3806252330fb68c6c545ef69760dcaf1e3224cf517005b"} Jul 28 00:04:31.176278 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.176225 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.165290848 podStartE2EDuration="2.176206442s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.915594ms" isStatefulPod=false podCreationTimestamp="2026-07-28 00:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:04:31.17508303 +0000 UTC m=+161.309939263" watchObservedRunningTime="2026-07-28 00:04:31.176206442 +0000 UTC m=+161.311062672" Jul 28 00:04:31.306704 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.306663 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6447dfdcd6-2646c"] Jul 28 00:04:31.309449 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.309420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.312677 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.312654 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 00:04:31.312799 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.312682 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 00:04:31.313692 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.313671 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 00:04:31.313780 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.313718 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 00:04:31.314435 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.314421 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bqwgd\"" Jul 28 00:04:31.314686 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.314672 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 00:04:31.320393 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.320370 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 00:04:31.328151 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.328120 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6447dfdcd6-2646c"] Jul 28 00:04:31.460270 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tlwv\" (UniqueName: \"kubernetes.io/projected/06218c18-b430-47f8-9487-76a21bafeef7-kube-api-access-6tlwv\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.460270 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-secret-telemeter-client\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.460270 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460254 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.460537 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.460537 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-serving-certs-ca-bundle\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.460537 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-federate-client-tls\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.460537 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460409 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-telemeter-client-tls\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.460537 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.460433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-metrics-client-ca\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561281 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561244 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561455 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-serving-certs-ca-bundle\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561455 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-federate-client-tls\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561590 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-telemeter-client-tls\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561590 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-metrics-client-ca\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561706 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tlwv\" (UniqueName: \"kubernetes.io/projected/06218c18-b430-47f8-9487-76a21bafeef7-kube-api-access-6tlwv\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561706 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-secret-telemeter-client\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.561825 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.561796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.562113 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.562077 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-serving-certs-ca-bundle\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.562201 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.562158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-metrics-client-ca\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.562741 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.562714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06218c18-b430-47f8-9487-76a21bafeef7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.564054 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.564034 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-telemeter-client-tls\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.564218 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.564200 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.564273 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.564207 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-secret-telemeter-client\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.564393 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.564373 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/06218c18-b430-47f8-9487-76a21bafeef7-federate-client-tls\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.569225 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.569205 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tlwv\" (UniqueName: \"kubernetes.io/projected/06218c18-b430-47f8-9487-76a21bafeef7-kube-api-access-6tlwv\") pod \"telemeter-client-6447dfdcd6-2646c\" (UID: \"06218c18-b430-47f8-9487-76a21bafeef7\") " pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.614467 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.614423 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:04:31.614944 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.614752 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="prometheus" containerID="cri-o://457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" gracePeriod=600 Jul 28 00:04:31.614944 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.614775 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy" containerID="cri-o://dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" gracePeriod=600 Jul 28 00:04:31.614944 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.614795 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-web" containerID="cri-o://259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" gracePeriod=600 Jul 28 00:04:31.614944 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.614836 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="config-reloader" containerID="cri-o://1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" gracePeriod=600 Jul 28 00:04:31.614944 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.614802 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" gracePeriod=600 Jul 28 00:04:31.614944 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.614805 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="thanos-sidecar" containerID="cri-o://658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" gracePeriod=600 Jul 28 00:04:31.625847 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.625408 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" Jul 28 00:04:31.810665 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.810637 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6447dfdcd6-2646c"] Jul 28 00:04:31.813123 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:04:31.813093 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06218c18_b430_47f8_9487_76a21bafeef7.slice/crio-c6279d97e30104cbb933a2fc132dde6d07bf81906f9569531b35efcf6230d7ef WatchSource:0}: Error finding container c6279d97e30104cbb933a2fc132dde6d07bf81906f9569531b35efcf6230d7ef: Status 404 returned error can't find the container with id c6279d97e30104cbb933a2fc132dde6d07bf81906f9569531b35efcf6230d7ef Jul 28 00:04:31.889014 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:31.888889 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.066184 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066086 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-db\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066184 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066136 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-serving-certs-ca-bundle\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066184 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066158 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-kube-rbac-proxy\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066184 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066177 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-trusted-ca-bundle\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066204 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066230 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-2\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066246 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq94n\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-kube-api-access-jq94n\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066264 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066300 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-grpc-tls\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066327 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-0\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066350 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-tls-assets\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066372 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-metrics-client-ca\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066423 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-tls\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066451 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-thanos-prometheus-http-client-file\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.066517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066484 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-config\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.067101 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066525 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-kubelet-serving-ca-bundle\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.067101 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066554 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-web-config\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.067101 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066601 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-metrics-client-certs\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.067101 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066658 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-1\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.067101 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066702 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-config-out\") pod \"5c08be2b-5935-4400-b016-cfd785d1d04a\" (UID: \"5c08be2b-5935-4400-b016-cfd785d1d04a\") " Jul 28 00:04:32.067589 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066516 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:32.067589 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066710 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:32.067747 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.066714 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:32.067747 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.067212 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:04:32.067747 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.067596 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:32.067747 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.067732 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:32.067956 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.067844 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:32.067956 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.067866 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:04:32.069692 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.069649 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.069817 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.069726 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.069889 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.069815 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:04:32.069952 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.069915 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.070087 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.070066 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-kube-api-access-jq94n" (OuterVolumeSpecName: "kube-api-access-jq94n") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "kube-api-access-jq94n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:04:32.070333 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.070313 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-config-out" (OuterVolumeSpecName: "config-out") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:04:32.070641 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.070617 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.070835 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.070803 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.071366 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.071343 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-config" (OuterVolumeSpecName: "config") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.071609 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.071558 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.071714 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.071672 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.080827 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.080804 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-web-config" (OuterVolumeSpecName: "web-config") pod "5c08be2b-5935-4400-b016-cfd785d1d04a" (UID: "5c08be2b-5935-4400-b016-cfd785d1d04a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:04:32.159105 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159074 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" exitCode=0 Jul 28 00:04:32.159105 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159099 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" exitCode=0 Jul 28 00:04:32.159105 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159106 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" exitCode=0 Jul 28 00:04:32.159105 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159113 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" exitCode=0 Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159119 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" exitCode=0 Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159124 2567 generic.go:356] "Generic (PLEG): container finished" podID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" exitCode=0 Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159165 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159160 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159244 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159322 2567 scope.go:117] "RemoveContainer" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159331 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159375 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} Jul 28 00:04:32.159707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.159455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5c08be2b-5935-4400-b016-cfd785d1d04a","Type":"ContainerDied","Data":"e8bf03ab45b58895807f8ef58c188bb077e20ed0f0c99e556173b2a3dd15d320"} Jul 28 00:04:32.160694 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.160671 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" event={"ID":"06218c18-b430-47f8-9487-76a21bafeef7","Type":"ContainerStarted","Data":"c6279d97e30104cbb933a2fc132dde6d07bf81906f9569531b35efcf6230d7ef"} Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168139 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-config-out\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168169 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-db\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168185 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168205 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-kube-rbac-proxy\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168217 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168230 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168243 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168260 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq94n\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-kube-api-access-jq94n\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168273 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168285 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-grpc-tls\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168302 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168315 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c08be2b-5935-4400-b016-cfd785d1d04a-tls-assets\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168327 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-metrics-client-ca\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168339 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168356 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168369 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-config\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168381 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168416 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-web-config\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168436 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5c08be2b-5935-4400-b016-cfd785d1d04a-secret-metrics-client-certs\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.168448 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c08be2b-5935-4400-b016-cfd785d1d04a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-51.ec2.internal\" DevicePath \"\"" Jul 28 00:04:32.170486 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.169843 2567 scope.go:117] "RemoveContainer" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.178700 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.178682 2567 scope.go:117] "RemoveContainer" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.186259 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.186051 2567 scope.go:117] "RemoveContainer" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.188019 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.187997 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:04:32.192100 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.192078 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:04:32.194355 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.194335 2567 scope.go:117] "RemoveContainer" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.201433 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.201413 2567 scope.go:117] "RemoveContainer" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.209051 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.209026 2567 scope.go:117] "RemoveContainer" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.216284 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.216258 2567 scope.go:117] "RemoveContainer" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.216609 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:32.216579 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": container with ID starting with 3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908 not found: ID does not exist" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.216712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.216616 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} err="failed to get container status \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": rpc error: code = NotFound desc = could not find container \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": container with ID starting with 3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908 not found: ID does not exist" Jul 28 00:04:32.216712 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.216637 2567 scope.go:117] "RemoveContainer" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.216909 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:32.216887 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": container with ID starting with dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8 not found: ID does not exist" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.216960 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.216914 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} err="failed to get container status \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": rpc error: code = NotFound desc = could not find container \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": container with ID starting with dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8 not found: ID does not exist" Jul 28 00:04:32.216960 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.216931 2567 scope.go:117] "RemoveContainer" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.217216 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:32.217175 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": container with ID starting with 259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722 not found: ID does not exist" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.217263 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217219 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} err="failed to get container status \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": rpc error: code = NotFound desc = could not find container \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": container with ID starting with 259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722 not found: ID does not exist" Jul 28 00:04:32.217263 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217233 2567 scope.go:117] "RemoveContainer" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.217442 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:32.217427 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": container with ID starting with 658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2 not found: ID does not exist" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.217485 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217447 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} err="failed to get container status \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": rpc error: code = NotFound desc = could not find container \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": container with ID starting with 658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2 not found: ID does not exist" Jul 28 00:04:32.217485 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217467 2567 scope.go:117] "RemoveContainer" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.217729 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:32.217714 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": container with ID starting with 1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e not found: ID does not exist" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.217776 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217733 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} err="failed to get container status \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": rpc error: code = NotFound desc = could not find container \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": container with ID starting with 1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e not found: ID does not exist" Jul 28 00:04:32.217776 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217746 2567 scope.go:117] "RemoveContainer" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.217857 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217833 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:04:32.217989 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:32.217956 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": container with ID starting with 457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c not found: ID does not exist" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.218031 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.217998 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} err="failed to get container status \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": rpc error: code = NotFound desc = could not find container \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": container with ID starting with 457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c not found: ID does not exist" Jul 28 00:04:32.218031 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218021 2567 scope.go:117] "RemoveContainer" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.218253 ip-10-0-136-51 kubenswrapper[2567]: E0728 00:04:32.218236 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": container with ID starting with 6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be not found: ID does not exist" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.218319 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218259 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be"} err="failed to get container status \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": rpc error: code = NotFound desc = could not find container \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": container with ID starting with 6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be not found: ID does not exist" Jul 28 00:04:32.218319 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218275 2567 scope.go:117] "RemoveContainer" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.218319 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218265 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218323 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218339 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-thanos" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218346 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-thanos" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218356 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="config-reloader" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218365 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="config-reloader" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218377 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="init-config-reloader" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218383 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="init-config-reloader" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218390 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-web" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218397 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-web" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218413 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="thanos-sidecar" Jul 28 00:04:32.218424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218422 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="thanos-sidecar" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218440 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="prometheus" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218445 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="prometheus" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218521 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="prometheus" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218520 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} err="failed to get container status \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": rpc error: code = NotFound desc = could not find container \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": container with ID starting with 3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908 not found: ID does not exist" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218542 2567 scope.go:117] "RemoveContainer" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218528 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218587 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-thanos" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218596 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="config-reloader" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218608 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="thanos-sidecar" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218617 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" containerName="kube-rbac-proxy-web" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218813 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} err="failed to get container status \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": rpc error: code = NotFound desc = could not find container \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": container with ID starting with dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8 not found: ID does not exist" Jul 28 00:04:32.218845 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.218828 2567 scope.go:117] "RemoveContainer" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.219268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219025 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} err="failed to get container status \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": rpc error: code = NotFound desc = could not find container \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": container with ID starting with 259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722 not found: ID does not exist" Jul 28 00:04:32.219268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219043 2567 scope.go:117] "RemoveContainer" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.219268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219240 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} err="failed to get container status \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": rpc error: code = NotFound desc = could not find container \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": container with ID starting with 658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2 not found: ID does not exist" Jul 28 00:04:32.219268 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219253 2567 scope.go:117] "RemoveContainer" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.219469 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219432 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} err="failed to get container status \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": rpc error: code = NotFound desc = could not find container \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": container with ID starting with 1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e not found: ID does not exist" Jul 28 00:04:32.219469 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219444 2567 scope.go:117] "RemoveContainer" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.219642 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219622 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} err="failed to get container status \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": rpc error: code = NotFound desc = could not find container \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": container with ID starting with 457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c not found: ID does not exist" Jul 28 00:04:32.219642 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219640 2567 scope.go:117] "RemoveContainer" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.219863 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219846 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be"} err="failed to get container status \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": rpc error: code = NotFound desc = could not find container \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": container with ID starting with 6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be not found: ID does not exist" Jul 28 00:04:32.219918 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.219865 2567 scope.go:117] "RemoveContainer" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.220060 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.220044 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} err="failed to get container status \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": rpc error: code = NotFound desc = could not find container \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": container with ID starting with 3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908 not found: ID does not exist" Jul 28 00:04:32.220104 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.220061 2567 scope.go:117] "RemoveContainer" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.220299 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.220280 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} err="failed to get container status \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": rpc error: code = NotFound desc = could not find container \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": container with ID starting with dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8 not found: ID does not exist" Jul 28 00:04:32.220351 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.220300 2567 scope.go:117] "RemoveContainer" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.220766 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.220734 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} err="failed to get container status \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": rpc error: code = NotFound desc = could not find container \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": container with ID starting with 259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722 not found: ID does not exist" Jul 28 00:04:32.220766 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.220762 2567 scope.go:117] "RemoveContainer" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.221058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221030 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} err="failed to get container status \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": rpc error: code = NotFound desc = could not find container \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": container with ID starting with 658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2 not found: ID does not exist" Jul 28 00:04:32.221058 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221057 2567 scope.go:117] "RemoveContainer" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.221342 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221322 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} err="failed to get container status \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": rpc error: code = NotFound desc = could not find container \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": container with ID starting with 1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e not found: ID does not exist" Jul 28 00:04:32.221342 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221342 2567 scope.go:117] "RemoveContainer" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.221635 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221606 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} err="failed to get container status \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": rpc error: code = NotFound desc = could not find container \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": container with ID starting with 457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c not found: ID does not exist" Jul 28 00:04:32.221635 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221626 2567 scope.go:117] "RemoveContainer" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.221843 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221826 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be"} err="failed to get container status \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": rpc error: code = NotFound desc = could not find container \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": container with ID starting with 6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be not found: ID does not exist" Jul 28 00:04:32.221893 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.221843 2567 scope.go:117] "RemoveContainer" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.222078 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222060 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} err="failed to get container status \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": rpc error: code = NotFound desc = could not find container \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": container with ID starting with 3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908 not found: ID does not exist" Jul 28 00:04:32.222133 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222079 2567 scope.go:117] "RemoveContainer" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.222297 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222273 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} err="failed to get container status \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": rpc error: code = NotFound desc = could not find container \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": container with ID starting with dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8 not found: ID does not exist" Jul 28 00:04:32.222347 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222298 2567 scope.go:117] "RemoveContainer" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.222347 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222340 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.222864 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222552 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} err="failed to get container status \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": rpc error: code = NotFound desc = could not find container \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": container with ID starting with 259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722 not found: ID does not exist" Jul 28 00:04:32.222864 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222600 2567 scope.go:117] "RemoveContainer" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.223021 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222850 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} err="failed to get container status \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": rpc error: code = NotFound desc = could not find container \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": container with ID starting with 658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2 not found: ID does not exist" Jul 28 00:04:32.223021 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.222880 2567 scope.go:117] "RemoveContainer" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.223125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223109 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} err="failed to get container status \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": rpc error: code = NotFound desc = could not find container \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": container with ID starting with 1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e not found: ID does not exist" Jul 28 00:04:32.223183 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223130 2567 scope.go:117] "RemoveContainer" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.223360 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223341 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} err="failed to get container status \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": rpc error: code = NotFound desc = could not find container \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": container with ID starting with 457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c not found: ID does not exist" Jul 28 00:04:32.223403 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223361 2567 scope.go:117] "RemoveContainer" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.223638 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223612 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be"} err="failed to get container status \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": rpc error: code = NotFound desc = could not find container \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": container with ID starting with 6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be not found: ID does not exist" Jul 28 00:04:32.223707 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223641 2567 scope.go:117] "RemoveContainer" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.223895 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223874 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} err="failed to get container status \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": rpc error: code = NotFound desc = could not find container \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": container with ID starting with 3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908 not found: ID does not exist" Jul 28 00:04:32.223944 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.223897 2567 scope.go:117] "RemoveContainer" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.224177 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224158 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} err="failed to get container status \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": rpc error: code = NotFound desc = could not find container \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": container with ID starting with dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8 not found: ID does not exist" Jul 28 00:04:32.224177 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224174 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 00:04:32.224281 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224178 2567 scope.go:117] "RemoveContainer" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.224485 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224467 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 00:04:32.224757 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224739 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} err="failed to get container status \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": rpc error: code = NotFound desc = could not find container \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": container with ID starting with 259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722 not found: ID does not exist" Jul 28 00:04:32.224818 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224759 2567 scope.go:117] "RemoveContainer" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.224906 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224890 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 00:04:32.224980 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224891 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 00:04:32.224980 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.224961 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 00:04:32.225081 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225047 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} err="failed to get container status \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": rpc error: code = NotFound desc = could not find container \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": container with ID starting with 658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2 not found: ID does not exist" Jul 28 00:04:32.225081 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225073 2567 scope.go:117] "RemoveContainer" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.225182 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225048 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 00:04:32.225234 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225178 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 00:04:32.225234 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225191 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 00:04:32.225234 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225219 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 00:04:32.225379 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225234 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t7jxm\"" Jul 28 00:04:32.225379 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225244 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4t6ahsa30csld\"" Jul 28 00:04:32.225472 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225437 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 00:04:32.225519 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225507 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 00:04:32.225596 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225525 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 00:04:32.225869 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225841 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} err="failed to get container status \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": rpc error: code = NotFound desc = could not find container \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": container with ID starting with 1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e not found: ID does not exist" Jul 28 00:04:32.225869 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.225866 2567 scope.go:117] "RemoveContainer" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.226155 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.226130 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} err="failed to get container status \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": rpc error: code = NotFound desc = could not find container \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": container with ID starting with 457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c not found: ID does not exist" Jul 28 00:04:32.226155 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.226155 2567 scope.go:117] "RemoveContainer" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.226606 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.226582 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be"} err="failed to get container status \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": rpc error: code = NotFound desc = could not find container \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": container with ID starting with 6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be not found: ID does not exist" Jul 28 00:04:32.226706 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.226607 2567 scope.go:117] "RemoveContainer" containerID="3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908" Jul 28 00:04:32.226899 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.226876 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908"} err="failed to get container status \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": rpc error: code = NotFound desc = could not find container \"3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908\": container with ID starting with 3d53141ab2bb043e3a8cbc3794ebd92abb3f556592fb25f849de08f22e7aa908 not found: ID does not exist" Jul 28 00:04:32.226997 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.226900 2567 scope.go:117] "RemoveContainer" containerID="dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8" Jul 28 00:04:32.227208 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.227150 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8"} err="failed to get container status \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": rpc error: code = NotFound desc = could not find container \"dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8\": container with ID starting with dcf7a1736161092d501330b809dab29964d0f0126f2e8622fdba26ab5288bea8 not found: ID does not exist" Jul 28 00:04:32.227208 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.227209 2567 scope.go:117] "RemoveContainer" containerID="259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722" Jul 28 00:04:32.227493 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.227472 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722"} err="failed to get container status \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": rpc error: code = NotFound desc = could not find container \"259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722\": container with ID starting with 259ee782171d752e1e9028e3e0e34716220c7c3ca59969ba30b45c30af192722 not found: ID does not exist" Jul 28 00:04:32.227493 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.227493 2567 scope.go:117] "RemoveContainer" containerID="658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2" Jul 28 00:04:32.227782 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.227760 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2"} err="failed to get container status \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": rpc error: code = NotFound desc = could not find container \"658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2\": container with ID starting with 658eedf015cfa67f2c42df687dabf3c7c2a8b8609da2873c2973f5ef0b20d6d2 not found: ID does not exist" Jul 28 00:04:32.227848 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.227784 2567 scope.go:117] "RemoveContainer" containerID="1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e" Jul 28 00:04:32.227935 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.227914 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 00:04:32.228112 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.228088 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e"} err="failed to get container status \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": rpc error: code = NotFound desc = could not find container \"1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e\": container with ID starting with 1d59b40a1f15afdb5189672276e28d879eacf3b7d8448b80e67772429ad4d94e not found: ID does not exist" Jul 28 00:04:32.228197 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.228113 2567 scope.go:117] "RemoveContainer" containerID="457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c" Jul 28 00:04:32.228580 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.228546 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c"} err="failed to get container status \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": rpc error: code = NotFound desc = could not find container \"457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c\": container with ID starting with 457bb4cb15e397d54fef535751074aab03ac9f96ac1b2b2ce3f08b35e2db338c not found: ID does not exist" Jul 28 00:04:32.228821 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.228585 2567 scope.go:117] "RemoveContainer" containerID="6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be" Jul 28 00:04:32.228883 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.228818 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be"} err="failed to get container status \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": rpc error: code = NotFound desc = could not find container \"6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be\": container with ID starting with 6179e76a2165bdcdc3940a016634ab918fc0166cf61c5f7c55ab5540f25fc7be not found: ID does not exist" Jul 28 00:04:32.230989 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.230840 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 00:04:32.238766 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.238741 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:04:32.370610 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370500 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w42bm\" (UniqueName: \"kubernetes.io/projected/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-kube-api-access-w42bm\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370610 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370610 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370610 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370601 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370628 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370649 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-config\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-config-out\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-web-config\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.370861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.371159 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.371159 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.371159 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370932 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.371159 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.371159 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.370972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.371159 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.371015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.371159 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.371048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.430792 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.430753 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c08be2b-5935-4400-b016-cfd785d1d04a" path="/var/lib/kubelet/pods/5c08be2b-5935-4400-b016-cfd785d1d04a/volumes" Jul 28 00:04:32.472139 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472139 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472148 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42bm\" (UniqueName: \"kubernetes.io/projected/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-kube-api-access-w42bm\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472341 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472363 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472386 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-config\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-config-out\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472480 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-web-config\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472599 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.472690 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.473189 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472703 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.473189 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.473189 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.472762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.475123 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.473490 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.475556 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.475501 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.475683 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.475511 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.475683 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.475534 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.475683 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.475542 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.475683 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.475634 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.475894 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.475693 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-web-config\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.476306 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.476284 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.476380 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.476333 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.476811 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.476787 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.476904 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.476828 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.476974 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.476898 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.477450 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.477424 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.478145 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.478110 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.478145 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.478133 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.478263 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.478139 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.478490 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.478468 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-config-out\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.478538 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.478525 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-config\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.480726 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.480704 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42bm\" (UniqueName: \"kubernetes.io/projected/6876c36c-6592-4e7e-95fc-2e9fe55f0ab5-kube-api-access-w42bm\") pod \"prometheus-k8s-0\" (UID: \"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.533731 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.533689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:32.692787 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:32.692682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:04:32.696224 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:04:32.695470 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6876c36c_6592_4e7e_95fc_2e9fe55f0ab5.slice/crio-621dc2102c8920776c0c9b02b8bad63a79b5e75198cb04ce812444372ef28258 WatchSource:0}: Error finding container 621dc2102c8920776c0c9b02b8bad63a79b5e75198cb04ce812444372ef28258: Status 404 returned error can't find the container with id 621dc2102c8920776c0c9b02b8bad63a79b5e75198cb04ce812444372ef28258 Jul 28 00:04:33.167065 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:33.167031 2567 generic.go:356] "Generic (PLEG): container finished" podID="6876c36c-6592-4e7e-95fc-2e9fe55f0ab5" containerID="6889657f7fe223b9910ebb0bef582609e1d6db59fc74800d3c19a2edc85dd9a5" exitCode=0 Jul 28 00:04:33.167532 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:33.167118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerDied","Data":"6889657f7fe223b9910ebb0bef582609e1d6db59fc74800d3c19a2edc85dd9a5"} Jul 28 00:04:33.167532 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:33.167205 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerStarted","Data":"621dc2102c8920776c0c9b02b8bad63a79b5e75198cb04ce812444372ef28258"} Jul 28 00:04:34.174357 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.174312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" event={"ID":"06218c18-b430-47f8-9487-76a21bafeef7","Type":"ContainerStarted","Data":"30bab26c9123692eb14188abfa69aed640ad328eebcf5506bb4015d87208f14c"} Jul 28 00:04:34.174784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.174391 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" event={"ID":"06218c18-b430-47f8-9487-76a21bafeef7","Type":"ContainerStarted","Data":"46a93c8a24bc80325a8aa4355ba181e97b3a9965a7b551429f137853cdd2e796"} Jul 28 00:04:34.174784 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.174424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" event={"ID":"06218c18-b430-47f8-9487-76a21bafeef7","Type":"ContainerStarted","Data":"51463fbc6b5af6ebca953470411b0c79e88e49f30d77a9b1f36fd148f215032d"} Jul 28 00:04:34.177534 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.177509 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerStarted","Data":"045ef103e3ac2ba6790dd978e5ca3d8848a792d6510d6b87237251d267361891"} Jul 28 00:04:34.177671 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.177603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerStarted","Data":"e23edc410f529685d7d466822653a5a5d041413f6dbda948aa1147b3d8e1c089"} Jul 28 00:04:34.177671 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.177633 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerStarted","Data":"f8e4a28c94ef0acb6cce47ed7beaa59e5f2cf04c828d18afccde208ab9cbbc1e"} Jul 28 00:04:34.177671 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.177663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerStarted","Data":"0a5bf7bb92b9b76d79f7eb156c8235dac5355156050b1a88c3bfe90ea1c75b40"} Jul 28 00:04:34.177834 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.177693 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerStarted","Data":"e853a5b1f4c28b8e034fde74831ec3ee535e371d397ad69b41de88a5606ca8dd"} Jul 28 00:04:34.177834 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.177718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6876c36c-6592-4e7e-95fc-2e9fe55f0ab5","Type":"ContainerStarted","Data":"509fbac8448895752ac2d6d7ae4aec1a8338d7508682c23f2888c6610225fb7f"} Jul 28 00:04:34.198673 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.198615 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6447dfdcd6-2646c" podStartSLOduration=1.220391491 podStartE2EDuration="3.198592759s" totalImagesPullingTime="1.978201268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:04:34.195285708 +0000 UTC m=+164.330141939" watchObservedRunningTime="2026-07-28 00:04:34.198592759 +0000 UTC m=+164.333448998" Jul 28 00:04:34.229136 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:34.229078 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.202688545 podStartE2EDuration="2.229057138s" totalImagesPullingTime="0s" totalInitContainerRuntime="26.368593ms" isStatefulPod=false podCreationTimestamp="2026-07-28 00:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:04:34.228624926 +0000 UTC m=+164.363481157" watchObservedRunningTime="2026-07-28 00:04:34.229057138 +0000 UTC m=+164.363913371" Jul 28 00:04:35.189514 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:35.189472 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:35.244202 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:35.244157 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:35.336861 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:35.336824 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:35.392402 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:35.392367 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:35.932477 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:35.932432 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:35.982325 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:35.982288 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:37.534480 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:37.534429 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:04:45.616186 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:45.616091 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:46.382542 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:46.382500 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:46.446157 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:46.446127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:04:46.505831 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:04:46.505801 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:22.839951 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:22.839912 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:22.976256 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:22.976223 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:26.471488 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:26.471452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:32.534406 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:32.534357 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:05:32.550576 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:32.550534 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:05:33.427472 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:33.427435 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:05:41.441404 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:41.441336 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:41.493282 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:41.493255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:41.645858 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:41.645821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:52.481061 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:52.481023 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:52.579525 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:52.579485 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:52.638152 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:52.638118 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:53.365390 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:53.365356 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:53.420017 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:05:53.419977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:10.630175 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:06:10.630137 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:10.728299 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:06:10.728266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:50.242521 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:06:50.242492 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 00:06:53.682925 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:06:53.682885 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:55.349899 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:06:55.349864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:20.443928 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:20.443892 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:21.306190 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:21.306156 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:24.084305 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:24.084244 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:24.184932 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:24.184882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:28.847669 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:28.847609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:28.950316 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:28.950267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:42.729872 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:42.729792 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:42.784054 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:07:42.784023 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:09:10.767009 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:09:10.766971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:09:32.563687 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:09:32.563636 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:09:32.626578 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:09:32.626530 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:09:55.767449 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:09:55.767415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:09:55.828116 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:09:55.828089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:10:06.563230 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:10:06.563195 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:10:06.663037 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:10:06.663002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:08.239876 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:11:08.239793 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:45.453931 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:11:45.453889 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:45.518336 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:11:45.518299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:12:32.383402 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.383362 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qnmh4/must-gather-hv47d"] Jul 28 00:12:32.388289 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.388263 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.390970 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.390947 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qnmh4\"/\"default-dockercfg-kmcm2\"" Jul 28 00:12:32.391192 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.391176 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qnmh4\"/\"openshift-service-ca.crt\"" Jul 28 00:12:32.391660 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.391641 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qnmh4\"/\"kube-root-ca.crt\"" Jul 28 00:12:32.394462 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.394435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnmh4/must-gather-hv47d"] Jul 28 00:12:32.396378 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.396210 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:12:32.465551 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.465508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8v9g\" (UniqueName: \"kubernetes.io/projected/06e6274e-4ce3-4b3e-8bda-be5432ab2775-kube-api-access-f8v9g\") pod \"must-gather-hv47d\" (UID: \"06e6274e-4ce3-4b3e-8bda-be5432ab2775\") " pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.465757 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.465618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06e6274e-4ce3-4b3e-8bda-be5432ab2775-must-gather-output\") pod \"must-gather-hv47d\" (UID: \"06e6274e-4ce3-4b3e-8bda-be5432ab2775\") " pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.566910 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.566873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8v9g\" (UniqueName: \"kubernetes.io/projected/06e6274e-4ce3-4b3e-8bda-be5432ab2775-kube-api-access-f8v9g\") pod \"must-gather-hv47d\" (UID: \"06e6274e-4ce3-4b3e-8bda-be5432ab2775\") " pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.567101 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.566936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06e6274e-4ce3-4b3e-8bda-be5432ab2775-must-gather-output\") pod \"must-gather-hv47d\" (UID: \"06e6274e-4ce3-4b3e-8bda-be5432ab2775\") " pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.567291 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.567270 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06e6274e-4ce3-4b3e-8bda-be5432ab2775-must-gather-output\") pod \"must-gather-hv47d\" (UID: \"06e6274e-4ce3-4b3e-8bda-be5432ab2775\") " pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.575706 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.575677 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8v9g\" (UniqueName: \"kubernetes.io/projected/06e6274e-4ce3-4b3e-8bda-be5432ab2775-kube-api-access-f8v9g\") pod \"must-gather-hv47d\" (UID: \"06e6274e-4ce3-4b3e-8bda-be5432ab2775\") " pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.710509 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.710478 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnmh4/must-gather-hv47d" Jul 28 00:12:32.844274 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.844170 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnmh4/must-gather-hv47d"] Jul 28 00:12:32.846393 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:12:32.846366 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06e6274e_4ce3_4b3e_8bda_be5432ab2775.slice/crio-938fd0951ad161259ed753c7a7bc7ca4957ddd2ee87aff8da923eed480b249ab WatchSource:0}: Error finding container 938fd0951ad161259ed753c7a7bc7ca4957ddd2ee87aff8da923eed480b249ab: Status 404 returned error can't find the container with id 938fd0951ad161259ed753c7a7bc7ca4957ddd2ee87aff8da923eed480b249ab Jul 28 00:12:32.848197 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:32.848183 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:12:33.079369 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:33.079276 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnmh4/must-gather-hv47d" event={"ID":"06e6274e-4ce3-4b3e-8bda-be5432ab2775","Type":"ContainerStarted","Data":"938fd0951ad161259ed753c7a7bc7ca4957ddd2ee87aff8da923eed480b249ab"} Jul 28 00:12:34.086585 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:34.086522 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnmh4/must-gather-hv47d" event={"ID":"06e6274e-4ce3-4b3e-8bda-be5432ab2775","Type":"ContainerStarted","Data":"3c9e8758b160f212cf4d924790fa6c92e19bbf108286b415ce3093c3c9e0bb9c"} Jul 28 00:12:34.087081 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:34.086596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnmh4/must-gather-hv47d" event={"ID":"06e6274e-4ce3-4b3e-8bda-be5432ab2775","Type":"ContainerStarted","Data":"cfb53eaf3fd9372814f8a29abeb16e82f686da15feadac80bc606c233f90b934"} Jul 28 00:12:34.107872 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:34.107814 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qnmh4/must-gather-hv47d" podStartSLOduration=1.356196232 podStartE2EDuration="2.10779534s" totalImagesPullingTime="751.599108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:12:34.106773154 +0000 UTC m=+644.241629386" watchObservedRunningTime="2026-07-28 00:12:34.10779534 +0000 UTC m=+644.242651571" Jul 28 00:12:34.395854 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:34.395806 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" limit=1024 Jul 28 00:12:35.076069 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:35.076029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r5qw7_b6b5d11f-bc1c-4035-8f55-f77392b23b49/global-pull-secret-syncer/0.log" Jul 28 00:12:35.128954 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:35.128873 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jwvtx_ab7b8be4-11ad-41f8-a79d-6c93dcbe41b7/konnectivity-agent/0.log" Jul 28 00:12:35.240320 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:35.240288 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-51.ec2.internal_78e50d64494b0564c66b772f1fad8aca/haproxy/0.log" Jul 28 00:12:38.881914 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:38.881880 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40f0d5c6-93f9-440f-83b7-da2fe76916b0/alertmanager/0.log" Jul 28 00:12:38.925233 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:38.925182 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40f0d5c6-93f9-440f-83b7-da2fe76916b0/config-reloader/0.log" Jul 28 00:12:38.958013 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:38.957983 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40f0d5c6-93f9-440f-83b7-da2fe76916b0/kube-rbac-proxy-web/0.log" Jul 28 00:12:38.998974 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:38.998947 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40f0d5c6-93f9-440f-83b7-da2fe76916b0/kube-rbac-proxy/0.log" Jul 28 00:12:39.042732 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.042697 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40f0d5c6-93f9-440f-83b7-da2fe76916b0/kube-rbac-proxy-metric/0.log" Jul 28 00:12:39.069915 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.069872 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40f0d5c6-93f9-440f-83b7-da2fe76916b0/prom-label-proxy/0.log" Jul 28 00:12:39.107968 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.107937 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40f0d5c6-93f9-440f-83b7-da2fe76916b0/init-config-reloader/0.log" Jul 28 00:12:39.189369 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.189338 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-x7klf_be3bb7d5-5c75-4172-8b28-0ec92994873b/kube-state-metrics/0.log" Jul 28 00:12:39.219773 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.219750 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-x7klf_be3bb7d5-5c75-4172-8b28-0ec92994873b/kube-rbac-proxy-main/0.log" Jul 28 00:12:39.252145 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.252113 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-x7klf_be3bb7d5-5c75-4172-8b28-0ec92994873b/kube-rbac-proxy-self/0.log" Jul 28 00:12:39.287424 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.287393 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-558fbc6999-2hzdd_3bfad7d4-5323-44f7-9ce6-32db877f276c/metrics-server/0.log" Jul 28 00:12:39.326800 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.326772 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-vl6fg_80f43308-f2b8-423c-8a00-4bd2b46392ce/monitoring-plugin/0.log" Jul 28 00:12:39.593677 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.593548 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqzvb_cac86d78-5a4f-4aea-8ce1-fd573c231d88/node-exporter/0.log" Jul 28 00:12:39.623484 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.623457 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqzvb_cac86d78-5a4f-4aea-8ce1-fd573c231d88/kube-rbac-proxy/0.log" Jul 28 00:12:39.651551 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.651522 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqzvb_cac86d78-5a4f-4aea-8ce1-fd573c231d88/init-textfile/0.log" Jul 28 00:12:39.687875 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.687845 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-vkm8g_58c3325c-3492-4a30-87de-010070b53115/kube-rbac-proxy-main/0.log" Jul 28 00:12:39.722813 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.722788 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-vkm8g_58c3325c-3492-4a30-87de-010070b53115/kube-rbac-proxy-self/0.log" Jul 28 00:12:39.751953 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.751921 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-vkm8g_58c3325c-3492-4a30-87de-010070b53115/openshift-state-metrics/0.log" Jul 28 00:12:39.793801 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.793779 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6876c36c-6592-4e7e-95fc-2e9fe55f0ab5/prometheus/0.log" Jul 28 00:12:39.827919 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.827825 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6876c36c-6592-4e7e-95fc-2e9fe55f0ab5/config-reloader/0.log" Jul 28 00:12:39.853276 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.853197 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6876c36c-6592-4e7e-95fc-2e9fe55f0ab5/thanos-sidecar/0.log" Jul 28 00:12:39.878020 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.877993 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6876c36c-6592-4e7e-95fc-2e9fe55f0ab5/kube-rbac-proxy-web/0.log" Jul 28 00:12:39.908951 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.908923 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6876c36c-6592-4e7e-95fc-2e9fe55f0ab5/kube-rbac-proxy/0.log" Jul 28 00:12:39.935846 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.935812 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6876c36c-6592-4e7e-95fc-2e9fe55f0ab5/kube-rbac-proxy-thanos/0.log" Jul 28 00:12:39.967685 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:39.967649 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6876c36c-6592-4e7e-95fc-2e9fe55f0ab5/init-config-reloader/0.log" Jul 28 00:12:40.011334 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.011299 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8mvzf_8981f40d-eb08-49e4-a299-9d8b02755249/prometheus-operator/0.log" Jul 28 00:12:40.036505 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.036465 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8mvzf_8981f40d-eb08-49e4-a299-9d8b02755249/kube-rbac-proxy/0.log" Jul 28 00:12:40.069843 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.069785 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-9qkrj_ab20b503-6313-4f55-acd9-809991d07cc6/prometheus-operator-admission-webhook/0.log" Jul 28 00:12:40.108376 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.108293 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6447dfdcd6-2646c_06218c18-b430-47f8-9487-76a21bafeef7/telemeter-client/0.log" Jul 28 00:12:40.134077 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.134044 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6447dfdcd6-2646c_06218c18-b430-47f8-9487-76a21bafeef7/reload/0.log" Jul 28 00:12:40.165143 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.165111 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6447dfdcd6-2646c_06218c18-b430-47f8-9487-76a21bafeef7/kube-rbac-proxy/0.log" Jul 28 00:12:40.203267 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.203241 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-656c4bdbf4-j6rt7_360fb06d-d847-4149-b641-4d5d28268fb6/thanos-query/0.log" Jul 28 00:12:40.228225 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.228199 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-656c4bdbf4-j6rt7_360fb06d-d847-4149-b641-4d5d28268fb6/kube-rbac-proxy-web/0.log" Jul 28 00:12:40.259952 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.259922 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-656c4bdbf4-j6rt7_360fb06d-d847-4149-b641-4d5d28268fb6/kube-rbac-proxy/0.log" Jul 28 00:12:40.288025 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.287993 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-656c4bdbf4-j6rt7_360fb06d-d847-4149-b641-4d5d28268fb6/prom-label-proxy/0.log" Jul 28 00:12:40.322451 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.322417 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-656c4bdbf4-j6rt7_360fb06d-d847-4149-b641-4d5d28268fb6/kube-rbac-proxy-rules/0.log" Jul 28 00:12:40.357160 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:40.357134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-656c4bdbf4-j6rt7_360fb06d-d847-4149-b641-4d5d28268fb6/kube-rbac-proxy-metrics/0.log" Jul 28 00:12:43.051190 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.051156 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk"] Jul 28 00:12:43.056429 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.056393 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.066079 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.066045 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk"] Jul 28 00:12:43.183781 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.183737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-sys\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.183972 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.183854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-podres\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.183972 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.183897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-lib-modules\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.183972 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.183943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-proc\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.183972 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.183958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t52m\" (UniqueName: \"kubernetes.io/projected/943f0c00-2f77-4e3d-98da-ca01794f0351-kube-api-access-8t52m\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284631 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-podres\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284811 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-lib-modules\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284811 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-proc\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284811 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t52m\" (UniqueName: \"kubernetes.io/projected/943f0c00-2f77-4e3d-98da-ca01794f0351-kube-api-access-8t52m\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284811 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-sys\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284780 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-podres\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284827 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-proc\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.284966 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284919 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-lib-modules\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.285067 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.284965 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/943f0c00-2f77-4e3d-98da-ca01794f0351-sys\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.293726 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.293692 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t52m\" (UniqueName: \"kubernetes.io/projected/943f0c00-2f77-4e3d-98da-ca01794f0351-kube-api-access-8t52m\") pod \"perf-node-gather-daemonset-cjbsk\" (UID: \"943f0c00-2f77-4e3d-98da-ca01794f0351\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.372553 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.372462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:43.532780 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:43.532753 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk"] Jul 28 00:12:43.535618 ip-10-0-136-51 kubenswrapper[2567]: W0728 00:12:43.535546 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod943f0c00_2f77_4e3d_98da_ca01794f0351.slice/crio-2176049e1e3aeb26ca7fabc9695d9a0202fa5663503201aa45dcd56cf792889a WatchSource:0}: Error finding container 2176049e1e3aeb26ca7fabc9695d9a0202fa5663503201aa45dcd56cf792889a: Status 404 returned error can't find the container with id 2176049e1e3aeb26ca7fabc9695d9a0202fa5663503201aa45dcd56cf792889a Jul 28 00:12:44.113301 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.113218 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9xsd4_db260c69-727c-4c59-9d40-f0dcd01b50f4/dns/0.log" Jul 28 00:12:44.133806 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.133783 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9xsd4_db260c69-727c-4c59-9d40-f0dcd01b50f4/kube-rbac-proxy/0.log" Jul 28 00:12:44.142804 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.142778 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" event={"ID":"943f0c00-2f77-4e3d-98da-ca01794f0351","Type":"ContainerStarted","Data":"dff044bda318ab1ed96d4757419fdb5e5f014829fb7acf313d7e3191e10487e1"} Jul 28 00:12:44.142933 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.142834 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" event={"ID":"943f0c00-2f77-4e3d-98da-ca01794f0351","Type":"ContainerStarted","Data":"2176049e1e3aeb26ca7fabc9695d9a0202fa5663503201aa45dcd56cf792889a"} Jul 28 00:12:44.142933 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.142921 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:44.159863 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.159806 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" podStartSLOduration=1.159786019 podStartE2EDuration="1.159786019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:12:44.158683069 +0000 UTC m=+654.293539324" watchObservedRunningTime="2026-07-28 00:12:44.159786019 +0000 UTC m=+654.294642251" Jul 28 00:12:44.234733 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.234704 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzfrd_bdc6849a-ca3c-44c8-bdeb-740d76098d9f/dns-node-resolver/0.log" Jul 28 00:12:44.690885 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:44.690847 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2ddmz_8095d4ac-6e1f-40f6-b3e4-1f5e004e5dc5/node-ca/0.log" Jul 28 00:12:45.879313 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:45.879289 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lzgzc_c79f27f6-86a3-4be5-baf6-d0be5b31959b/serve-healthcheck-canary/0.log" Jul 28 00:12:46.404638 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:46.404599 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knw6h_383c3203-354c-42ea-a3ac-d108a4a0183d/kube-rbac-proxy/0.log" Jul 28 00:12:46.427168 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:46.427137 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knw6h_383c3203-354c-42ea-a3ac-d108a4a0183d/exporter/0.log" Jul 28 00:12:46.458968 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:46.458931 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knw6h_383c3203-354c-42ea-a3ac-d108a4a0183d/extractor/0.log" Jul 28 00:12:50.158481 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:50.158446 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-cjbsk" Jul 28 00:12:52.554550 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.554465 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7qcr_6d7ff173-2ce5-4228-9308-f3449f173cd2/kube-multus-additional-cni-plugins/0.log" Jul 28 00:12:52.578883 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.578853 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7qcr_6d7ff173-2ce5-4228-9308-f3449f173cd2/egress-router-binary-copy/0.log" Jul 28 00:12:52.606925 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.606899 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7qcr_6d7ff173-2ce5-4228-9308-f3449f173cd2/cni-plugins/0.log" Jul 28 00:12:52.634046 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.634021 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7qcr_6d7ff173-2ce5-4228-9308-f3449f173cd2/bond-cni-plugin/0.log" Jul 28 00:12:52.657517 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.657487 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7qcr_6d7ff173-2ce5-4228-9308-f3449f173cd2/routeoverride-cni/0.log" Jul 28 00:12:52.683198 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.683167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7qcr_6d7ff173-2ce5-4228-9308-f3449f173cd2/whereabouts-cni-bincopy/0.log" Jul 28 00:12:52.710868 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.710840 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7qcr_6d7ff173-2ce5-4228-9308-f3449f173cd2/whereabouts-cni/0.log" Jul 28 00:12:52.745876 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.745835 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b94w4_49ac63aa-4e02-43ad-bc96-fdda6c904b89/kube-multus/0.log" Jul 28 00:12:52.896043 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.896011 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j2dff_d0242b9b-d5ab-4159-862f-47092ed8dcf0/network-metrics-daemon/0.log" Jul 28 00:12:52.918236 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:52.918207 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j2dff_d0242b9b-d5ab-4159-862f-47092ed8dcf0/kube-rbac-proxy/0.log" Jul 28 00:12:54.201125 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.201096 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/ovn-controller/0.log" Jul 28 00:12:54.224665 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.224630 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/ovn-acl-logging/0.log" Jul 28 00:12:54.254767 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.254735 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/kube-rbac-proxy-node/0.log" Jul 28 00:12:54.280939 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.280908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 00:12:54.304584 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.304532 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/northd/0.log" Jul 28 00:12:54.327419 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.327396 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/nbdb/0.log" Jul 28 00:12:54.350133 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.350108 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/sbdb/0.log" Jul 28 00:12:54.405008 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:54.404977 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zv5w7_cc64fc4a-5161-43ef-8190-c0965bd55f7e/ovnkube-controller/0.log" Jul 28 00:12:55.412367 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:55.412335 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bwgk9_a963251a-13a8-4a39-9be9-c366e44a9126/network-check-target-container/0.log" Jul 28 00:12:56.426230 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:56.426200 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-74666_69b5949c-2f73-4461-967a-fc8b6fa05aad/iptables-alerter/0.log" Jul 28 00:12:57.146237 ip-10-0-136-51 kubenswrapper[2567]: I0728 00:12:57.146204 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-26mrl_69c9043d-d28b-49c6-b0a0-24e19084eb05/tuned/0.log"