Jul 28 11:33:15.463072 ip-10-0-132-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 11:33:15.463077 ip-10-0-132-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 11:33:15.463084 ip-10-0-132-238 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 11:33:15.463330 ip-10-0-132-238 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 11:33:25.653736 ip-10-0-132-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 11:33:25.653756 ip-10-0-132-238 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3c15787f6c394736b8d92a9814b075d7 -- Jul 28 11:35:22.035969 ip-10-0-132-238 systemd[1]: Starting Kubernetes Kubelet... Jul 28 11:35:23.800521 ip-10-0-132-238 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 11:35:23.800521 ip-10-0-132-238 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 11:35:23.800974 ip-10-0-132-238 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 11:35:23.800974 ip-10-0-132-238 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 11:35:23.800974 ip-10-0-132-238 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 11:35:23.802222 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.802091 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 11:35:23.806700 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806684 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 11:35:23.806700 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806700 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806704 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806708 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806711 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806714 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806717 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806720 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806723 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806726 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806729 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806731 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806734 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806737 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806742 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806750 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806753 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806756 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806759 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806763 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 11:35:23.806770 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806766 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806769 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806772 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806775 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806778 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806781 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806785 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806789 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806792 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806795 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806798 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806802 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806805 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806807 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806810 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806813 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806817 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806820 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806823 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 11:35:23.807287 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806825 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806828 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806831 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806834 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806836 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806839 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806841 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806844 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806846 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806849 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806851 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806854 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806856 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806859 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806861 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806865 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806868 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806871 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806873 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806877 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 11:35:23.807747 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806879 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806882 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806885 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806887 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806890 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806892 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806895 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806898 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806900 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806903 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806905 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806908 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806911 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806914 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806917 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806919 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806922 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806924 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806927 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806930 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 11:35:23.808351 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806932 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806935 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806939 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806941 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806944 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806947 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806950 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806953 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806956 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806959 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806962 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806964 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806967 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806971 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806975 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806978 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806980 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806983 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806986 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 11:35:23.809220 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.806988 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807749 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807757 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807761 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807765 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807768 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807772 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807777 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807780 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807783 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807786 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807789 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807791 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807794 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807796 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807800 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807804 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807807 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807809 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 11:35:23.810041 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807812 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807815 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807818 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807821 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807824 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807826 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807829 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807832 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807836 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807839 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807841 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807844 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807847 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807849 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807852 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807855 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807857 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807860 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807862 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807865 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 11:35:23.810860 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807868 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807870 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807873 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807875 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807878 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807881 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807884 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807886 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807889 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807892 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807894 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807897 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807900 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807903 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807906 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807908 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807911 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807913 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807916 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 11:35:23.811377 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807919 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807922 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807926 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807929 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807931 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807934 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807937 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807940 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807942 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807945 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807948 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807950 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807953 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807955 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807959 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807961 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807964 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807966 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807969 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 11:35:23.811939 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807971 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807973 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807976 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807978 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807981 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807983 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807986 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807991 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807994 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807996 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.807999 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808002 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808004 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808007 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808009 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808012 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808014 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808017 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808020 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808023 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 11:35:23.812685 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808025 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808027 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808030 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808686 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808701 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808707 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808713 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808717 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808723 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808727 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808732 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808736 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808741 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808745 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808750 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808754 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808758 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808762 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808769 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808776 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 11:35:23.813320 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808780 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808785 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808789 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808794 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808799 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808803 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808808 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808813 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808817 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808830 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808834 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808839 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808843 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808847 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808851 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808857 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808862 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808866 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808870 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808875 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 11:35:23.813880 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808879 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808884 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808888 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808893 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808897 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808901 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808905 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808909 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808913 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808918 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808922 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808926 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808930 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808935 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808941 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808946 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808950 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808954 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808959 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808963 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 11:35:23.814454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808967 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808971 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808976 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808980 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808984 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808989 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808992 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.808996 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809002 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809006 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809010 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809014 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809018 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809023 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809027 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809031 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809035 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809039 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809045 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809049 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 11:35:23.814965 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809053 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809058 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809062 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809066 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809070 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809074 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809078 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809083 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809087 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809091 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809095 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809100 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809109 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809115 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809120 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809125 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809130 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809134 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809138 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 11:35:23.815525 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809143 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809148 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.809167 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809270 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809282 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809293 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809301 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809308 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809313 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809320 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809326 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809332 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809337 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809343 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809348 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809353 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809358 2559 flags.go:64] FLAG: --cgroup-root="" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809363 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809368 2559 flags.go:64] FLAG: --client-ca-file="" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809372 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809377 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809384 2559 flags.go:64] FLAG: --cluster-domain="" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809389 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809394 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 11:35:23.816016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809399 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809405 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809411 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809416 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809421 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809427 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809431 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809437 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809441 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809447 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809451 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809465 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809471 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809476 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809481 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809486 2559 flags.go:64] FLAG: --enable-server="true" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809491 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809498 2559 flags.go:64] FLAG: --event-burst="100" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809503 2559 flags.go:64] FLAG: --event-qps="50" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809508 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809513 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809517 2559 flags.go:64] FLAG: --eviction-hard="" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809524 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809528 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809533 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 11:35:23.816618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809538 2559 flags.go:64] FLAG: --eviction-soft="" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809546 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809551 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809556 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809560 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809565 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809570 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809575 2559 flags.go:64] FLAG: --feature-gates="" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809581 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809586 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809592 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809597 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809602 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809607 2559 flags.go:64] FLAG: --help="false" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809612 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-238.ec2.internal" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809617 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809622 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809627 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809633 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809639 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809644 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809649 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809654 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 11:35:23.817334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809658 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809663 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809669 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809674 2559 flags.go:64] FLAG: --kube-reserved="" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809679 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809683 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809689 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809694 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809699 2559 flags.go:64] FLAG: --lock-file="" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809704 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809710 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809715 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809724 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809729 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809734 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809739 2559 flags.go:64] FLAG: --logging-format="text" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809744 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809750 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809755 2559 flags.go:64] FLAG: --manifest-url="" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809759 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809767 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809772 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809778 2559 flags.go:64] FLAG: --max-pods="110" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809783 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809788 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 11:35:23.817929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809793 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809798 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809803 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809808 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809814 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809825 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809830 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809834 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809839 2559 flags.go:64] FLAG: --pod-cidr="" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809844 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809852 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809857 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809862 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809867 2559 flags.go:64] FLAG: --port="10250" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809872 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809877 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd44c1add138a7db" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809882 2559 flags.go:64] FLAG: --qos-reserved="" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809888 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809893 2559 flags.go:64] FLAG: --register-node="true" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809898 2559 flags.go:64] FLAG: --register-with-taints="" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809904 2559 flags.go:64] FLAG: --registry-burst="10" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809908 2559 flags.go:64] FLAG: --registry-qps="5" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809913 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809917 2559 flags.go:64] FLAG: --reserved-memory="" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809923 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 11:35:23.818562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809929 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809934 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809938 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809943 2559 flags.go:64] FLAG: --runonce="false" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809948 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809953 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809958 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809962 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809967 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809972 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809977 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809982 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809987 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809992 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.809996 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810001 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810006 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810011 2559 flags.go:64] FLAG: --system-cgroups="" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810016 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810024 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810029 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810034 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810039 2559 flags.go:64] FLAG: --tls-min-version="" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810044 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810050 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 11:35:23.819234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810054 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810059 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810064 2559 flags.go:64] FLAG: --v="2" Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810070 2559 flags.go:64] FLAG: --version="false" Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810077 2559 flags.go:64] FLAG: --vmodule="" Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810083 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.810088 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810285 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810293 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810298 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810304 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810308 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810313 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810317 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810321 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810326 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810331 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810335 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810339 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810343 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810353 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 11:35:23.819844 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810357 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810362 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810366 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810370 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810374 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810378 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810382 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810387 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810391 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810396 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810402 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810406 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810410 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810415 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810419 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810423 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810427 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810432 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810439 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 11:35:23.820486 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810443 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810447 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810451 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810455 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810460 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810464 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810468 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810473 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810477 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810482 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810486 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810490 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810494 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810499 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810504 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810508 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810512 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810517 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810521 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810526 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 11:35:23.821006 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810530 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810534 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810538 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810544 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810549 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810553 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810557 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810562 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810567 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810574 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810579 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810586 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810591 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810596 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810601 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810605 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810612 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810617 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810622 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 11:35:23.821801 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810626 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810631 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810636 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810641 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810645 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810650 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810654 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810659 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810664 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810668 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810673 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810677 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810682 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810686 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810690 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810694 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810700 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810704 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810709 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 11:35:23.822371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810713 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810719 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810725 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810730 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810734 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810740 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810744 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.810749 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.811434 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.818565 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.818582 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.818599 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.818605 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818659 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 11:35:23.822833 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818665 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818669 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818672 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818676 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818679 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818682 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818685 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818688 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818691 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818694 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818697 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818700 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818702 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818705 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818708 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818710 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818713 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818716 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818720 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818724 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 11:35:23.823355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818727 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818729 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818732 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818735 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818738 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818741 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818744 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818747 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818750 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818752 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818755 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818758 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818760 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818763 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818765 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818768 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818771 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818773 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818776 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818779 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 11:35:23.823838 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818782 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818785 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818788 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818790 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818793 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818795 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818798 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818800 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818803 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818805 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818808 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818810 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818812 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818815 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818819 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818822 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818825 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818828 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818831 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 11:35:23.824355 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818834 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818837 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818840 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818843 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818846 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818849 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818852 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818854 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818857 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818860 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818863 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818865 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818868 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818871 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818873 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818876 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818878 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818881 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818883 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818885 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 11:35:23.824828 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818888 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818891 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818894 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818896 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818898 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818901 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818904 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818907 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818910 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818913 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818915 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818918 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818920 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818923 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818926 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818928 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818931 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818934 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 11:35:23.825341 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.818936 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.818941 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819065 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819070 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819073 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819076 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819079 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819082 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819085 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819088 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819091 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819095 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819099 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819102 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 11:35:23.825776 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819105 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819107 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819110 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819112 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819115 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819118 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819120 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819123 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819125 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819128 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819130 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819133 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819136 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819138 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819141 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819144 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819147 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819149 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819167 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819170 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 11:35:23.826128 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819173 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819175 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819178 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819181 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819184 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819187 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819190 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819193 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819196 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819198 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819201 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819203 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819206 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819208 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819211 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819213 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819216 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819218 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819221 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819223 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 11:35:23.826649 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819226 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819228 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819231 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819234 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819236 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819239 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819242 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819245 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819248 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819251 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819253 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819256 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819259 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819261 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819264 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819266 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819269 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819272 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819275 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819278 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 11:35:23.827132 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819281 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819284 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819287 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819289 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819292 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819294 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819297 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819299 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819302 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819305 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819307 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819310 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819313 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819317 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819320 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819323 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819326 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819328 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819331 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819334 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 11:35:23.827643 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819336 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819339 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819341 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819344 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819346 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819349 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:23.819352 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.819356 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.819465 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.823721 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.825100 2559 server.go:1019] "Starting client certificate rotation" Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.825192 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.825228 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 11:35:23.828125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.827855 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 11:35:23.830600 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.830582 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 11:35:23.841928 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.841906 2559 log.go:25] "Validated CRI v1 runtime API" Jul 28 11:35:23.844069 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.844048 2559 log.go:25] "Validated CRI v1 image API" Jul 28 11:35:23.846230 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.846211 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 11:35:23.848604 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.848576 2559 fs.go:135] Filesystem UUIDs: map[5f9c65c0-22eb-49ac-8210-f341f1792777:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b49bbfc1-e657-4fc3-ad1e-876953a9152b:/dev/nvme0n1p3] Jul 28 11:35:23.848678 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.848602 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 11:35:23.851854 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.851836 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 11:35:23.855071 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.854954 2559 manager.go:216] Machine: {Timestamp:2026-07-28 11:35:23.853742241 +0000 UTC m=+0.317939372 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099032 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec232dd0112a7bf331bf6d3ff8ef23e3 SystemUUID:ec232dd0-112a-7bf3-31bf-6d3ff8ef23e3 BootID:3c15787f-6c39-4736-b8d9-2a9814b075d7 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:5f:22:f1:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:5f:22:f1:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:e8:27:3f:62:26 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 11:35:23.855071 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.855064 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 11:35:23.855205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.855150 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 11:35:23.856635 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.856581 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 11:35:23.857055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.856640 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 11:35:23.857792 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.857780 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 11:35:23.857832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.857796 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 11:35:23.857832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.857804 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 11:35:23.858469 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.858457 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 11:35:23.859218 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.859208 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 11:35:23.860939 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.860927 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 28 11:35:23.861051 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861042 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 11:35:23.861086 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861071 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 28 11:35:23.861117 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861086 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 11:35:23.861117 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861100 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 11:35:23.861117 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861109 2559 kubelet.go:398] "Adding apiserver pod source" Jul 28 11:35:23.861117 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861118 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 11:35:23.861522 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861499 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 11:35:23.861522 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.861520 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 11:35:23.863654 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.863636 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 11:35:23.865736 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.865722 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 11:35:23.865792 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.865752 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 11:35:23.867494 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867482 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 11:35:23.867539 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867509 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 11:35:23.867539 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867519 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 11:35:23.867539 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867527 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 11:35:23.867539 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867539 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 11:35:23.867646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867547 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 11:35:23.867646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867576 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 11:35:23.867646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867585 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 11:35:23.867646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867594 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 11:35:23.867646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867602 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 11:35:23.867646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867614 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 11:35:23.867646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.867621 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 11:35:23.868305 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.868292 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 11:35:23.868337 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.868309 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 11:35:23.871611 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.871596 2559 server.go:1268] "Started kubelet" Jul 28 11:35:23.871682 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.871656 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 11:35:23.871885 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.871724 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 11:35:23.871938 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.871910 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 11:35:23.872381 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.872354 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 11:35:23.872470 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.872428 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 11:35:23.872557 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.872524 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 11:35:23.872662 ip-10-0-132-238 systemd[1]: Started Kubernetes Kubelet. Jul 28 11:35:23.873519 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.873502 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 11:35:23.874716 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.874689 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 28 11:35:23.875887 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.875870 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 11:35:23.880723 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.880701 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 11:35:23.880831 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.880716 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 11:35:23.880881 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.880850 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:23.881687 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.881668 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 11:35:23.881785 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.881671 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 11:35:23.881785 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.881707 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 11:35:23.881893 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.881874 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 28 11:35:23.881893 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.881891 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 28 11:35:23.882034 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.881943 2559 factory.go:55] Registering systemd factory Jul 28 11:35:23.882034 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.881961 2559 factory.go:223] Registration of the systemd container factory successfully Jul 28 11:35:23.882303 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.882288 2559 factory.go:153] Registering CRI-O factory Jul 28 11:35:23.882303 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.882305 2559 factory.go:223] Registration of the crio container factory successfully Jul 28 11:35:23.882440 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.882374 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 11:35:23.882537 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.882515 2559 factory.go:103] Registering Raw factory Jul 28 11:35:23.882585 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.882538 2559 manager.go:1196] Started watching for new ooms in manager Jul 28 11:35:23.883414 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.883399 2559 manager.go:349] Starting recovery of all containers Jul 28 11:35:23.885710 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.885679 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 11:35:23.885930 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.885906 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 11:35:23.888657 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.885618 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-238.ec2.internal.18c670fa96b4f0b4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-238.ec2.internal,UID:ip-10-0-132-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-238.ec2.internal,},FirstTimestamp:2026-07-28 11:35:23.871555764 +0000 UTC m=+0.335752893,LastTimestamp:2026-07-28 11:35:23.871555764 +0000 UTC m=+0.335752893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-238.ec2.internal,}" Jul 28 11:35:23.893464 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.893373 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nqhlq" Jul 28 11:35:23.896941 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.896920 2559 manager.go:354] Recovery completed Jul 28 11:35:23.901097 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.901078 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nqhlq" Jul 28 11:35:23.901233 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.901221 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 11:35:23.903007 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.902993 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientMemory" Jul 28 11:35:23.903068 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.903020 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 11:35:23.903068 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.903031 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientPID" Jul 28 11:35:23.903626 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.903614 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 11:35:23.903626 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.903624 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 11:35:23.903715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.903638 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 28 11:35:23.903715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.903683 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 11:35:23.904374 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.904355 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientMemory" Jul 28 11:35:23.904453 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.904391 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 11:35:23.904453 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.904404 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientPID" Jul 28 11:35:23.904882 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.904809 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-238.ec2.internal.18c670fa9894daa4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-238.ec2.internal,UID:ip-10-0-132-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-238.ec2.internal,},FirstTimestamp:2026-07-28 11:35:23.903007396 +0000 UTC m=+0.367204526,LastTimestamp:2026-07-28 11:35:23.903007396 +0000 UTC m=+0.367204526,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-238.ec2.internal,}" Jul 28 11:35:23.905306 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.905177 2559 policy_none.go:49] "None policy: Start" Jul 28 11:35:23.905366 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.905314 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 11:35:23.905366 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.905326 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 11:35:23.906311 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.906299 2559 policy_none.go:47] "Start" Jul 28 11:35:23.949715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.949694 2559 manager.go:337] "Starting Device Plugin manager" Jul 28 11:35:23.949820 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.949735 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 11:35:23.949820 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.949747 2559 server.go:87] "Starting device plugin registration server" Jul 28 11:35:23.950023 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.950011 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 11:35:23.950072 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.950031 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 11:35:23.950118 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.950104 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 11:35:23.950210 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.950197 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 11:35:23.950261 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:23.950211 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 11:35:23.950770 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.950747 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 11:35:23.950862 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:23.950796 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.050430 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.050358 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 11:35:24.052444 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.051309 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientMemory" Jul 28 11:35:24.052444 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.051341 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 11:35:24.052444 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.051353 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientPID" Jul 28 11:35:24.052444 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.051382 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.059307 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.059290 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.059307 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.059312 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-238.ec2.internal\": node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.079830 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.079807 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.117180 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.117137 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 11:35:24.118361 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.118342 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 11:35:24.118430 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.118390 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 11:35:24.118430 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.118419 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 11:35:24.118503 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.118463 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 11:35:24.120992 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.120947 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 11:35:24.180410 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.180383 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.218834 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.218781 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal"] Jul 28 11:35:24.218914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.218888 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 11:35:24.220536 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.220521 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientMemory" Jul 28 11:35:24.220624 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.220550 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 11:35:24.220624 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.220568 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientPID" Jul 28 11:35:24.222810 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.222797 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 11:35:24.222979 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.222965 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.223065 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.222993 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 11:35:24.223559 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.223542 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientMemory" Jul 28 11:35:24.223640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.223569 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 11:35:24.223640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.223586 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientPID" Jul 28 11:35:24.223640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.223591 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientMemory" Jul 28 11:35:24.223640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.223610 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 11:35:24.223640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.223623 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientPID" Jul 28 11:35:24.225884 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.225867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.225994 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.225892 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 11:35:24.226571 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.226557 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientMemory" Jul 28 11:35:24.226640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.226594 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 11:35:24.226640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.226607 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeHasSufficientPID" Jul 28 11:35:24.248851 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.248829 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-238.ec2.internal\" not found" node="ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.253143 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.253127 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-238.ec2.internal\" not found" node="ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.281071 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.281049 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.284341 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.284325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb08da72a473db0ae4f0a5d5930c1dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal\" (UID: \"4fb08da72a473db0ae4f0a5d5930c1dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.284416 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.284353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb08da72a473db0ae4f0a5d5930c1dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal\" (UID: \"4fb08da72a473db0ae4f0a5d5930c1dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.284416 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.284372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f112d9abde8daeb5837b42f75048eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-238.ec2.internal\" (UID: \"7f112d9abde8daeb5837b42f75048eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.381848 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.381769 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.384990 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.384957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f112d9abde8daeb5837b42f75048eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-238.ec2.internal\" (UID: \"7f112d9abde8daeb5837b42f75048eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.385065 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.385005 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb08da72a473db0ae4f0a5d5930c1dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal\" (UID: \"4fb08da72a473db0ae4f0a5d5930c1dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.385065 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.385025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb08da72a473db0ae4f0a5d5930c1dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal\" (UID: \"4fb08da72a473db0ae4f0a5d5930c1dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.385065 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.385055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb08da72a473db0ae4f0a5d5930c1dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal\" (UID: \"4fb08da72a473db0ae4f0a5d5930c1dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.385196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.385067 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb08da72a473db0ae4f0a5d5930c1dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal\" (UID: \"4fb08da72a473db0ae4f0a5d5930c1dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.385196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.385071 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f112d9abde8daeb5837b42f75048eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-238.ec2.internal\" (UID: \"7f112d9abde8daeb5837b42f75048eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.482285 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.482248 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.552616 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.552578 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.556378 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.556357 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" Jul 28 11:35:24.582648 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.582622 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.683177 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.683074 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.783631 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.783593 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.824936 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.824894 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 11:35:24.825397 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.825057 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 11:35:24.884202 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.884151 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:24.905748 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.905715 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 11:30:23 +0000 UTC" deadline="2028-01-25 16:47:14.253107461 +0000 UTC" Jul 28 11:35:24.905748 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.905745 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13109h11m49.347365884s" Jul 28 11:35:24.941973 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:24.941897 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 11:35:24.985005 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:24.984977 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:25.085518 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:25.085483 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-238.ec2.internal\" not found" Jul 28 11:35:25.116196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.116168 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 11:35:25.141048 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:25.141013 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb08da72a473db0ae4f0a5d5930c1dc.slice/crio-55da6bcb23da74efdedd93cbe097a733b7bb1726ac95524aa5611963d48a95ab WatchSource:0}: Error finding container 55da6bcb23da74efdedd93cbe097a733b7bb1726ac95524aa5611963d48a95ab: Status 404 returned error can't find the container with id 55da6bcb23da74efdedd93cbe097a733b7bb1726ac95524aa5611963d48a95ab Jul 28 11:35:25.141408 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:25.141385 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f112d9abde8daeb5837b42f75048eeb.slice/crio-d257a41896b7f4c30e12c8943daec2c1fdcb53d36fad66315cb59126ed39ec34 WatchSource:0}: Error finding container d257a41896b7f4c30e12c8943daec2c1fdcb53d36fad66315cb59126ed39ec34: Status 404 returned error can't find the container with id d257a41896b7f4c30e12c8943daec2c1fdcb53d36fad66315cb59126ed39ec34 Jul 28 11:35:25.146323 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.146307 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 11:35:25.181819 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.181784 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" Jul 28 11:35:25.201528 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.201460 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 11:35:25.202867 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.202852 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" Jul 28 11:35:25.212606 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.211121 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 11:35:25.403351 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.403319 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 11:35:25.863116 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.863081 2559 apiserver.go:52] "Watching apiserver" Jul 28 11:35:25.870438 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.870402 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 11:35:25.871642 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.871613 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4jcsx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v","openshift-cluster-node-tuning-operator/tuned-gfpmh","openshift-dns/node-resolver-544np","openshift-network-diagnostics/network-check-target-7bkvm","openshift-network-operator/iptables-alerter-p7z8f","openshift-ovn-kubernetes/ovnkube-node-8vjzj","kube-system/global-pull-secret-syncer-4bcsv","kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal","openshift-image-registry/node-ca-zfk5s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal","openshift-multus/multus-additional-cni-plugins-gf2bz","openshift-multus/multus-c5swf","openshift-multus/network-metrics-daemon-27s5h"] Jul 28 11:35:25.874307 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.874278 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.876586 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.876560 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.877897 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.877875 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 11:35:25.878015 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.877920 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7vrld\"" Jul 28 11:35:25.878015 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.878010 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 11:35:25.878168 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.878116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 11:35:25.879008 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.878790 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.879554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.879269 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 11:35:25.879554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.879287 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 11:35:25.879554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.879430 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 11:35:25.881437 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.881002 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-544np" Jul 28 11:35:25.881437 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.881109 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 11:35:25.882914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.882443 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 11:35:25.882914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.882659 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 11:35:25.882914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.882669 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 11:35:25.883512 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.883362 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 11:35:25.883512 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.883376 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 11:35:25.884012 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.883885 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5bhd5\"" Jul 28 11:35:25.884012 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.883896 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jzlhh\"" Jul 28 11:35:25.884990 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.884728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:25.884990 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:25.884812 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:25.885780 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.885587 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 11:35:25.885780 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.885645 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 11:35:25.885949 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.885934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xzst2\"" Jul 28 11:35:25.886938 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.886916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 11:35:25.887742 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.887224 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:25.889725 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.889696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:25.889853 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:25.889770 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:25.890889 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.890868 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 11:35:25.891079 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sxqm5\"" Jul 28 11:35:25.891148 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891101 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 11:35:25.891226 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891188 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 11:35:25.891479 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:25.891554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.891554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qdnh\" (UniqueName: \"kubernetes.io/projected/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-kube-api-access-8qdnh\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.891664 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-etc-kubernetes\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.891664 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-sys\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.891767 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-host\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.891767 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-etc-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.891767 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.891767 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.891767 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znr95\" (UniqueName: \"kubernetes.io/projected/57790825-368f-4eab-a1af-27e76d3c24ea-kube-api-access-znr95\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-systemd\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-multus-certs\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-var-lib-kubelet\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-tuned\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/732aea48-b74a-4438-aa34-fafb50d63ca3-hosts-file\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-cni-netd\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.891984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-cni-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.892009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.892005 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-cnibin\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.892592 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.892035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-netns\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.892592 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.892063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-cni-bin\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.892592 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.892085 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:25.893984 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.892084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-cni-multus\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894096 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.893980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57790825-368f-4eab-a1af-27e76d3c24ea-multus-daemon-config\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894096 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-os-release\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894096 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-cni-bin\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894096 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-socket-dir-parent\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894314 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-kubelet\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894366 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-kubelet\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894366 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997cf\" (UniqueName: \"kubernetes.io/projected/732aea48-b74a-4438-aa34-fafb50d63ca3-kube-api-access-997cf\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:25.894466 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-system-cni-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894466 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmjxg\" (UniqueName: \"kubernetes.io/projected/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-kube-api-access-kmjxg\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.894565 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732aea48-b74a-4438-aa34-fafb50d63ca3-tmp-dir\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:25.894565 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-ovn\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894565 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-k8s-cni-cncf-io\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-systemd-units\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-slash\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovn-node-metrics-cert\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-kubernetes\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.894915 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysctl-d\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.894915 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-systemd\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.894915 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-env-overrides\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894915 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894833 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57790825-368f-4eab-a1af-27e76d3c24ea-cni-binary-copy\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.894915 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894878 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.894915 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-var-lib-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.894915 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894915 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovnkube-script-lib\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.895254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.894995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysconfig\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.895254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-run\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.895254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-lib-modules\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.895254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-hostroot\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.895447 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-tmp\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.895447 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-run-netns\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.895447 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-modprobe-d\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.895447 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-node-log\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.895447 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-log-socket\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.895737 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovnkube-config\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.895737 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-conf-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.895737 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.895535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysctl-conf\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.896146 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.896123 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vf7dd\"" Jul 28 11:35:25.896248 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.896186 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 11:35:25.897543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.897522 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 11:35:25.899308 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.898011 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:25.899308 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.898375 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 11:35:25.899308 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.898451 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s4g8f\"" Jul 28 11:35:25.899308 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.899085 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 11:35:25.899579 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.899363 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 11:35:25.901251 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.901232 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:25.901379 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:25.901344 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:25.902931 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.902739 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 11:35:25.903004 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.902970 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 11:35:25.903071 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.903024 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 11:35:25.903430 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.903409 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jvdxc\"" Jul 28 11:35:25.903618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.903601 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.908773 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.908750 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 11:35:25.909706 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.909686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 11:35:25.909942 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.909927 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qtwtv\"" Jul 28 11:35:25.910197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.910180 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 11:35:25.953243 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.953212 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r8pc6" Jul 28 11:35:25.954093 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.954071 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 11:35:25.969350 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.969320 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r8pc6" Jul 28 11:35:25.983494 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.983467 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 11:35:25.996524 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-cnibin\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.996676 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996527 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-netns\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.996676 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-cni-bin\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.996676 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-cni-multus\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.996676 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57790825-368f-4eab-a1af-27e76d3c24ea-multus-daemon-config\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.996676 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:25.996676 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-os-release\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-socket-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-device-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-cnibin\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-cni-bin\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-socket-dir-parent\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eae05074-07f0-49ee-a307-2c481baa8e2e-iptables-alerter-script\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-os-release\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-kubelet\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-kubelet\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.996997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-serviceca\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:25.997064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997cf\" (UniqueName: \"kubernetes.io/projected/732aea48-b74a-4438-aa34-fafb50d63ca3-kube-api-access-997cf\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997178 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-system-cni-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997191 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-cnibin\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997189 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-cni-multus\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmjxg\" (UniqueName: \"kubernetes.io/projected/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-kube-api-access-kmjxg\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-sys-fs\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997241 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-socket-dir-parent\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997257 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-os-release\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997280 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-system-cni-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997284 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-kubelet\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xdt\" (UniqueName: \"kubernetes.io/projected/041cee35-562a-4db0-a574-f6271c12f721-kube-api-access-45xdt\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732aea48-b74a-4438-aa34-fafb50d63ca3-tmp-dir\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997379 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-kubelet\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-ovn\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997428 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-k8s-cni-cncf-io\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.997649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pfxz\" (UniqueName: \"kubernetes.io/projected/eae05074-07f0-49ee-a307-2c481baa8e2e-kube-api-access-9pfxz\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997661 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-systemd-units\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-slash\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997692 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-var-lib-cni-bin\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovn-node-metrics-cert\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997722 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-ovn\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997733 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-netns\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997686 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732aea48-b74a-4438-aa34-fafb50d63ca3-tmp-dir\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-kubernetes\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997808 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-cni-bin\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997808 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-k8s-cni-cncf-io\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997845 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-kubernetes\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997855 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-slash\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997879 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-systemd-units\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997889 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysctl-d\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.997902 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57790825-368f-4eab-a1af-27e76d3c24ea-multus-daemon-config\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-systemd\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-registration-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.998435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998118 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysctl-d\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fld5s\" (UniqueName: \"kubernetes.io/projected/11bbd64f-93f8-4391-a1d9-ecdd66978d91-kube-api-access-fld5s\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998099 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-systemd\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-env-overrides\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57790825-368f-4eab-a1af-27e76d3c24ea-cni-binary-copy\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998215 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1798509-7230-4963-a154-f42bc2f7e21b-kubelet-config\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-host\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-system-cni-dir\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-var-lib-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovnkube-script-lib\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysconfig\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-run\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998600 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysconfig\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-env-overrides\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:25.999267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998638 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-var-lib-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998658 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-run\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-lib-modules\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-hostroot\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998746 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-hostroot\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998757 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57790825-368f-4eab-a1af-27e76d3c24ea-cni-binary-copy\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-tmp\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998826 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-run-netns\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998844 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-lib-modules\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-modprobe-d\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998887 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-run-netns\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpl7p\" (UniqueName: \"kubernetes.io/projected/3861a753-509b-4421-9d6b-157dd144bfd1-kube-api-access-fpl7p\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998941 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-modprobe-d\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xjz\" (UniqueName: \"kubernetes.io/projected/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-kube-api-access-q9xjz\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.998976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-node-log\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999012 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-log-socket\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovnkube-config\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999079 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-log-socket\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999116 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-node-log\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-conf-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysctl-conf\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999207 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovnkube-script-lib\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qdnh\" (UniqueName: \"kubernetes.io/projected/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-kube-api-access-8qdnh\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-etc-kubernetes\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999353 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-conf-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999349 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-sysctl-conf\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999394 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-sys\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999404 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999508 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovnkube-config\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-host\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999581 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-etc-kubernetes\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-etc-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999625 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-sys\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.000920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999691 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-etc-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-openvswitch\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999711 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-host\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999762 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znr95\" (UniqueName: \"kubernetes.io/projected/57790825-368f-4eab-a1af-27e76d3c24ea-kube-api-access-znr95\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-systemd\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-multus-certs\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999865 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-run-systemd\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-var-lib-kubelet\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-tuned\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4061bfa3-be9d-4daf-b83a-37ea9e7b8f05-agent-certs\") pod \"konnectivity-agent-4jcsx\" (UID: \"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05\") " pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999951 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-host-run-multus-certs\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:25.999915 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-var-lib-kubelet\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/732aea48-b74a-4438-aa34-fafb50d63ca3-hosts-file\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-cni-netd\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1798509-7230-4963-a154-f42bc2f7e21b-dbus\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:26.001739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000105 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/732aea48-b74a-4438-aa34-fafb50d63ca3-hosts-file\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:26.002578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eae05074-07f0-49ee-a307-2c481baa8e2e-host-slash\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.002578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000169 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-host-cni-netd\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.002578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4061bfa3-be9d-4daf-b83a-37ea9e7b8f05-konnectivity-ca\") pod \"konnectivity-agent-4jcsx\" (UID: \"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05\") " pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:26.002578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-cni-binary-copy\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.002578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-cni-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.002578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.000390 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57790825-368f-4eab-a1af-27e76d3c24ea-multus-cni-dir\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.003089 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.003056 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-ovn-node-metrics-cert\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.003189 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.003138 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-tmp\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.003533 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.003516 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-etc-tuned\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.008084 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.008022 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmjxg\" (UniqueName: \"kubernetes.io/projected/b1fe3b6a-b2b7-4548-aede-62346dbcfd25-kube-api-access-kmjxg\") pod \"tuned-gfpmh\" (UID: \"b1fe3b6a-b2b7-4548-aede-62346dbcfd25\") " pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.026193 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.026150 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 11:35:26.026193 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.026195 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 11:35:26.026193 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.026208 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jw865 for pod openshift-network-diagnostics/network-check-target-7bkvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:26.026449 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.026343 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865 podName:538e4919-e20e-46e3-8453-2702feeac868 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:26.526322159 +0000 UTC m=+2.990519292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jw865" (UniqueName: "kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865") pod "network-check-target-7bkvm" (UID: "538e4919-e20e-46e3-8453-2702feeac868") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:26.028872 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.028844 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znr95\" (UniqueName: \"kubernetes.io/projected/57790825-368f-4eab-a1af-27e76d3c24ea-kube-api-access-znr95\") pod \"multus-c5swf\" (UID: \"57790825-368f-4eab-a1af-27e76d3c24ea\") " pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.028992 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.028887 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qdnh\" (UniqueName: \"kubernetes.io/projected/f08dfc9d-9470-4c4b-b071-c0efd0794d6a-kube-api-access-8qdnh\") pod \"ovnkube-node-8vjzj\" (UID: \"f08dfc9d-9470-4c4b-b071-c0efd0794d6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.033433 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.033409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-997cf\" (UniqueName: \"kubernetes.io/projected/732aea48-b74a-4438-aa34-fafb50d63ca3-kube-api-access-997cf\") pod \"node-resolver-544np\" (UID: \"732aea48-b74a-4438-aa34-fafb50d63ca3\") " pod="openshift-dns/node-resolver-544np" Jul 28 11:35:26.100944 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.100908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4061bfa3-be9d-4daf-b83a-37ea9e7b8f05-agent-certs\") pod \"konnectivity-agent-4jcsx\" (UID: \"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05\") " pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:26.100944 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.100941 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1798509-7230-4963-a154-f42bc2f7e21b-dbus\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:26.101205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.100957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eae05074-07f0-49ee-a307-2c481baa8e2e-host-slash\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.101205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101011 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eae05074-07f0-49ee-a307-2c481baa8e2e-host-slash\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.101205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1798509-7230-4963-a154-f42bc2f7e21b-dbus\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:26.101205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4061bfa3-be9d-4daf-b83a-37ea9e7b8f05-konnectivity-ca\") pod \"konnectivity-agent-4jcsx\" (UID: \"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05\") " pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:26.101205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-cni-binary-copy\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.101483 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:26.101483 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-socket-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101483 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-socket-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101483 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-device-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101483 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-cnibin\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101514 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-device-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eae05074-07f0-49ee-a307-2c481baa8e2e-iptables-alerter-script\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-os-release\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-serviceca\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101682 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-cnibin\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-sys-fs\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.101731 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101736 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4061bfa3-be9d-4daf-b83a-37ea9e7b8f05-konnectivity-ca\") pod \"konnectivity-agent-4jcsx\" (UID: \"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05\") " pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101744 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xdt\" (UniqueName: \"kubernetes.io/projected/041cee35-562a-4db0-a574-f6271c12f721-kube-api-access-45xdt\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pfxz\" (UniqueName: \"kubernetes.io/projected/eae05074-07f0-49ee-a307-2c481baa8e2e-kube-api-access-9pfxz\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101797 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-sys-fs\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-registration-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101824 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-os-release\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld5s\" (UniqueName: \"kubernetes.io/projected/11bbd64f-93f8-4391-a1d9-ecdd66978d91-kube-api-access-fld5s\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.101857 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1798509-7230-4963-a154-f42bc2f7e21b-kubelet-config\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.101928 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret podName:a1798509-7230-4963-a154-f42bc2f7e21b nodeName:}" failed. No retries permitted until 2026-07-28 11:35:26.601910755 +0000 UTC m=+3.066107877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret") pod "global-pull-secret-syncer-4bcsv" (UID: "a1798509-7230-4963-a154-f42bc2f7e21b") : object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101951 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1798509-7230-4963-a154-f42bc2f7e21b-kubelet-config\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-host\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-system-cni-dir\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.102254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpl7p\" (UniqueName: \"kubernetes.io/projected/3861a753-509b-4421-9d6b-157dd144bfd1-kube-api-access-fpl7p\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xjz\" (UniqueName: \"kubernetes.io/projected/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-kube-api-access-q9xjz\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102209 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11bbd64f-93f8-4391-a1d9-ecdd66978d91-registration-dir\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102275 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/041cee35-562a-4db0-a574-f6271c12f721-system-cni-dir\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102291 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eae05074-07f0-49ee-a307-2c481baa8e2e-iptables-alerter-script\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.101744 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-cni-binary-copy\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102350 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-host\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.102353 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.102415 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs podName:3861a753-509b-4421-9d6b-157dd144bfd1 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:26.60239762 +0000 UTC m=+3.066594750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs") pod "network-metrics-daemon-27s5h" (UID: "3861a753-509b-4421-9d6b-157dd144bfd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102511 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102709 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/041cee35-562a-4db0-a574-f6271c12f721-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.103006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.102862 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-serviceca\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.104538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.104516 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4061bfa3-be9d-4daf-b83a-37ea9e7b8f05-agent-certs\") pod \"konnectivity-agent-4jcsx\" (UID: \"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05\") " pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:26.119371 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.119291 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pfxz\" (UniqueName: \"kubernetes.io/projected/eae05074-07f0-49ee-a307-2c481baa8e2e-kube-api-access-9pfxz\") pod \"iptables-alerter-p7z8f\" (UID: \"eae05074-07f0-49ee-a307-2c481baa8e2e\") " pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.123554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.120360 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpl7p\" (UniqueName: \"kubernetes.io/projected/3861a753-509b-4421-9d6b-157dd144bfd1-kube-api-access-fpl7p\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:26.123554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.120852 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xjz\" (UniqueName: \"kubernetes.io/projected/8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c-kube-api-access-q9xjz\") pod \"node-ca-zfk5s\" (UID: \"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c\") " pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.123554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.121364 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fld5s\" (UniqueName: \"kubernetes.io/projected/11bbd64f-93f8-4391-a1d9-ecdd66978d91-kube-api-access-fld5s\") pod \"aws-ebs-csi-driver-node-5g85v\" (UID: \"11bbd64f-93f8-4391-a1d9-ecdd66978d91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.124369 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.124340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xdt\" (UniqueName: \"kubernetes.io/projected/041cee35-562a-4db0-a574-f6271c12f721-kube-api-access-45xdt\") pod \"multus-additional-cni-plugins-gf2bz\" (UID: \"041cee35-562a-4db0-a574-f6271c12f721\") " pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.125721 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.125674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" event={"ID":"4fb08da72a473db0ae4f0a5d5930c1dc","Type":"ContainerStarted","Data":"55da6bcb23da74efdedd93cbe097a733b7bb1726ac95524aa5611963d48a95ab"} Jul 28 11:35:26.127011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.126988 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" event={"ID":"7f112d9abde8daeb5837b42f75048eeb","Type":"ContainerStarted","Data":"d257a41896b7f4c30e12c8943daec2c1fdcb53d36fad66315cb59126ed39ec34"} Jul 28 11:35:26.187103 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.187066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:26.197867 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.197844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c5swf" Jul 28 11:35:26.208856 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.208832 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" Jul 28 11:35:26.212813 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.212791 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-544np" Jul 28 11:35:26.222291 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.222266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p7z8f" Jul 28 11:35:26.228742 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.228714 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:26.236397 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.236374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" Jul 28 11:35:26.243039 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.243016 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfk5s" Jul 28 11:35:26.249675 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.249655 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" Jul 28 11:35:26.605371 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.605290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:26.605371 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.605337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:26.605371 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.605372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605468 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605496 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605517 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605526 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret podName:a1798509-7230-4963-a154-f42bc2f7e21b nodeName:}" failed. No retries permitted until 2026-07-28 11:35:27.605510545 +0000 UTC m=+4.069707665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret") pod "global-pull-secret-syncer-4bcsv" (UID: "a1798509-7230-4963-a154-f42bc2f7e21b") : object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605526 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jw865 for pod openshift-network-diagnostics/network-check-target-7bkvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605558 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865 podName:538e4919-e20e-46e3-8453-2702feeac868 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:27.605551278 +0000 UTC m=+4.069748395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw865" (UniqueName: "kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865") pod "network-check-target-7bkvm" (UID: "538e4919-e20e-46e3-8453-2702feeac868") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605503 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:26.605607 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:26.605588 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs podName:3861a753-509b-4421-9d6b-157dd144bfd1 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:27.605581869 +0000 UTC m=+4.069778986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs") pod "network-metrics-daemon-27s5h" (UID: "3861a753-509b-4421-9d6b-157dd144bfd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:26.972417 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.972328 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 11:30:25 +0000 UTC" deadline="2028-03-01 01:44:50.83219196 +0000 UTC" Jul 28 11:35:26.972417 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:26.972362 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13958h9m23.859833835s" Jul 28 11:35:27.007978 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:27.007953 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041cee35_562a_4db0_a574_f6271c12f721.slice/crio-8fb547c3f9829fb20d80e1039ff21bd318ba944599d95115237f1d1b99ca65b6 WatchSource:0}: Error finding container 8fb547c3f9829fb20d80e1039ff21bd318ba944599d95115237f1d1b99ca65b6: Status 404 returned error can't find the container with id 8fb547c3f9829fb20d80e1039ff21bd318ba944599d95115237f1d1b99ca65b6 Jul 28 11:35:27.009224 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:27.009148 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4061bfa3_be9d_4daf_b83a_37ea9e7b8f05.slice/crio-34f21f469abb9b9284a911a723dfb6c8ba991e41387b5dbc701e3b8456062245 WatchSource:0}: Error finding container 34f21f469abb9b9284a911a723dfb6c8ba991e41387b5dbc701e3b8456062245: Status 404 returned error can't find the container with id 34f21f469abb9b9284a911a723dfb6c8ba991e41387b5dbc701e3b8456062245 Jul 28 11:35:27.012917 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:27.012892 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732aea48_b74a_4438_aa34_fafb50d63ca3.slice/crio-88d3583e110d1934da262a8266bb32260b509f95765b55f868a6b9e833b46a66 WatchSource:0}: Error finding container 88d3583e110d1934da262a8266bb32260b509f95765b55f868a6b9e833b46a66: Status 404 returned error can't find the container with id 88d3583e110d1934da262a8266bb32260b509f95765b55f868a6b9e833b46a66 Jul 28 11:35:27.014371 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:27.014341 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c82ae1b_b46c_4697_bdb7_6bf5a09eae2c.slice/crio-765f07ea767cf5c73a96e720caf812c18da684471f1bd94b906982e2702f0b43 WatchSource:0}: Error finding container 765f07ea767cf5c73a96e720caf812c18da684471f1bd94b906982e2702f0b43: Status 404 returned error can't find the container with id 765f07ea767cf5c73a96e720caf812c18da684471f1bd94b906982e2702f0b43 Jul 28 11:35:27.015726 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:27.015705 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fe3b6a_b2b7_4548_aede_62346dbcfd25.slice/crio-6dc2d3aa44e7772910c021289dd2795759433e8e188b43056cd61cbff236e11d WatchSource:0}: Error finding container 6dc2d3aa44e7772910c021289dd2795759433e8e188b43056cd61cbff236e11d: Status 404 returned error can't find the container with id 6dc2d3aa44e7772910c021289dd2795759433e8e188b43056cd61cbff236e11d Jul 28 11:35:27.021674 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:35:27.021344 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08dfc9d_9470_4c4b_b071_c0efd0794d6a.slice/crio-97ed11bd1b0e70bd66f0b4184e84d7c91362d74696333e931ebe19d605349255 WatchSource:0}: Error finding container 97ed11bd1b0e70bd66f0b4184e84d7c91362d74696333e931ebe19d605349255: Status 404 returned error can't find the container with id 97ed11bd1b0e70bd66f0b4184e84d7c91362d74696333e931ebe19d605349255 Jul 28 11:35:27.118946 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.118768 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:27.119114 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.119050 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:27.129742 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.129703 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"97ed11bd1b0e70bd66f0b4184e84d7c91362d74696333e931ebe19d605349255"} Jul 28 11:35:27.130722 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.130697 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" event={"ID":"11bbd64f-93f8-4391-a1d9-ecdd66978d91","Type":"ContainerStarted","Data":"ee34dea2d8183d6d6e4491c83573e215229700c5c39c4a373b0c54a9a0f8cee4"} Jul 28 11:35:27.131831 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.131807 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c5swf" event={"ID":"57790825-368f-4eab-a1af-27e76d3c24ea","Type":"ContainerStarted","Data":"6ebc218070c173e73eab8abb1dbefe8bec379a11a896691bd8d762f03e889126"} Jul 28 11:35:27.132966 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.132948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfk5s" event={"ID":"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c","Type":"ContainerStarted","Data":"765f07ea767cf5c73a96e720caf812c18da684471f1bd94b906982e2702f0b43"} Jul 28 11:35:27.133896 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.133877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-544np" event={"ID":"732aea48-b74a-4438-aa34-fafb50d63ca3","Type":"ContainerStarted","Data":"88d3583e110d1934da262a8266bb32260b509f95765b55f868a6b9e833b46a66"} Jul 28 11:35:27.135052 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.135031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jcsx" event={"ID":"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05","Type":"ContainerStarted","Data":"34f21f469abb9b9284a911a723dfb6c8ba991e41387b5dbc701e3b8456062245"} Jul 28 11:35:27.136922 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.136869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" event={"ID":"7f112d9abde8daeb5837b42f75048eeb","Type":"ContainerStarted","Data":"996b57d424aecc1701ca5b5d444321856e8c686b87ade1d2ba59dd5361a7e75c"} Jul 28 11:35:27.138085 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.138066 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p7z8f" event={"ID":"eae05074-07f0-49ee-a307-2c481baa8e2e","Type":"ContainerStarted","Data":"94478adf00baeca64ec0f01882e6787dd757590658f2b2cc23e42ab7f87bb5cc"} Jul 28 11:35:27.139170 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.139138 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" event={"ID":"b1fe3b6a-b2b7-4548-aede-62346dbcfd25","Type":"ContainerStarted","Data":"6dc2d3aa44e7772910c021289dd2795759433e8e188b43056cd61cbff236e11d"} Jul 28 11:35:27.140292 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.140269 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerStarted","Data":"8fb547c3f9829fb20d80e1039ff21bd318ba944599d95115237f1d1b99ca65b6"} Jul 28 11:35:27.153683 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.153583 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-238.ec2.internal" podStartSLOduration=2.15356917 podStartE2EDuration="2.15356917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:27.15321917 +0000 UTC m=+3.617416310" watchObservedRunningTime="2026-07-28 11:35:27.15356917 +0000 UTC m=+3.617766309" Jul 28 11:35:27.612439 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.612354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:27.612439 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.612425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:27.612708 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.612472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:27.612708 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.612596 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:27.612708 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.612666 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs podName:3861a753-509b-4421-9d6b-157dd144bfd1 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:29.612639207 +0000 UTC m=+6.076836339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs") pod "network-metrics-daemon-27s5h" (UID: "3861a753-509b-4421-9d6b-157dd144bfd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:27.613108 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.613087 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 11:35:27.613201 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.613114 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 11:35:27.613201 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.613130 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jw865 for pod openshift-network-diagnostics/network-check-target-7bkvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:27.613201 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.613197 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865 podName:538e4919-e20e-46e3-8453-2702feeac868 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:29.613180214 +0000 UTC m=+6.077377336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw865" (UniqueName: "kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865") pod "network-check-target-7bkvm" (UID: "538e4919-e20e-46e3-8453-2702feeac868") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:27.613363 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.613259 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:27.613363 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:27.613290 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret podName:a1798509-7230-4963-a154-f42bc2f7e21b nodeName:}" failed. No retries permitted until 2026-07-28 11:35:29.61327996 +0000 UTC m=+6.077477082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret") pod "global-pull-secret-syncer-4bcsv" (UID: "a1798509-7230-4963-a154-f42bc2f7e21b") : object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:27.972998 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.972933 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 11:30:25 +0000 UTC" deadline="2028-01-28 00:51:31.542087156 +0000 UTC" Jul 28 11:35:27.972998 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:27.972996 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13165h16m3.569096212s" Jul 28 11:35:28.121705 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:28.121674 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:28.121888 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:28.121805 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:28.122233 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:28.122203 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:28.122319 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:28.122301 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:28.159229 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:28.159033 2559 generic.go:356] "Generic (PLEG): container finished" podID="4fb08da72a473db0ae4f0a5d5930c1dc" containerID="f02ed3ffc0cfd0b32e3d95772b03961476439ed6260a37e0ad7edcb477f75222" exitCode=0 Jul 28 11:35:28.160115 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:28.159454 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" event={"ID":"4fb08da72a473db0ae4f0a5d5930c1dc","Type":"ContainerDied","Data":"f02ed3ffc0cfd0b32e3d95772b03961476439ed6260a37e0ad7edcb477f75222"} Jul 28 11:35:29.120593 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:29.120508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:29.121067 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.120658 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:29.176650 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:29.176610 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" event={"ID":"4fb08da72a473db0ae4f0a5d5930c1dc","Type":"ContainerStarted","Data":"2daffaa55f12d63bb7bf5b493c43929274967b3855b80230aca167d2d9896e29"} Jul 28 11:35:29.627538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:29.627497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:29.627743 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:29.627575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:29.627743 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:29.627625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:29.639591 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.639560 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 11:35:29.639591 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.639597 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 11:35:29.639840 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.639618 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jw865 for pod openshift-network-diagnostics/network-check-target-7bkvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:29.639840 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.639690 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865 podName:538e4919-e20e-46e3-8453-2702feeac868 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:33.639663278 +0000 UTC m=+10.103860407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw865" (UniqueName: "kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865") pod "network-check-target-7bkvm" (UID: "538e4919-e20e-46e3-8453-2702feeac868") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:29.639956 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.639862 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:29.639956 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.639913 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs podName:3861a753-509b-4421-9d6b-157dd144bfd1 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:33.639897755 +0000 UTC m=+10.104094872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs") pod "network-metrics-daemon-27s5h" (UID: "3861a753-509b-4421-9d6b-157dd144bfd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:29.639956 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.639935 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:29.640113 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:29.640008 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret podName:a1798509-7230-4963-a154-f42bc2f7e21b nodeName:}" failed. No retries permitted until 2026-07-28 11:35:33.639990541 +0000 UTC m=+10.104187659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret") pod "global-pull-secret-syncer-4bcsv" (UID: "a1798509-7230-4963-a154-f42bc2f7e21b") : object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:30.119311 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:30.119093 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:30.119311 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:30.119236 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:30.119533 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:30.119467 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:30.119586 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:30.119561 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:31.118811 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:31.118778 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:31.119279 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:31.118922 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:32.119332 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:32.119252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:32.119840 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:32.119387 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:32.121948 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:32.121773 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:32.121948 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:32.121877 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:33.119456 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:33.119066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:33.119456 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.119234 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:33.664710 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:33.664665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:33.664905 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:33.664731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:33.664905 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:33.664780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:33.665025 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.664910 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:33.665025 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.664972 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs podName:3861a753-509b-4421-9d6b-157dd144bfd1 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:41.664954779 +0000 UTC m=+18.129151901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs") pod "network-metrics-daemon-27s5h" (UID: "3861a753-509b-4421-9d6b-157dd144bfd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:33.665138 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.665120 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:33.665214 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.665182 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret podName:a1798509-7230-4963-a154-f42bc2f7e21b nodeName:}" failed. No retries permitted until 2026-07-28 11:35:41.665168599 +0000 UTC m=+18.129365730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret") pod "global-pull-secret-syncer-4bcsv" (UID: "a1798509-7230-4963-a154-f42bc2f7e21b") : object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:33.665283 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.665259 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 11:35:33.665283 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.665276 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 11:35:33.665377 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.665289 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jw865 for pod openshift-network-diagnostics/network-check-target-7bkvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:33.665377 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:33.665325 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865 podName:538e4919-e20e-46e3-8453-2702feeac868 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:41.665312786 +0000 UTC m=+18.129509905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw865" (UniqueName: "kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865") pod "network-check-target-7bkvm" (UID: "538e4919-e20e-46e3-8453-2702feeac868") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:34.119974 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:34.119887 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:34.120495 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:34.119973 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:34.120495 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:34.120339 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:34.120495 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:34.120433 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:35.118978 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:35.118870 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:35.119201 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:35.118990 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:36.118899 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:36.118866 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:36.119385 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:36.118998 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:36.119385 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:36.119083 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:36.119385 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:36.118994 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:37.118632 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:37.118597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:37.118812 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:37.118740 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:38.119106 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:38.119049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:38.119106 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:38.119091 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:38.119625 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:38.119195 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:38.119625 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:38.119303 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:39.118835 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:39.118798 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:39.119030 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:39.118920 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:40.119297 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:40.119260 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:40.119775 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:40.119260 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:40.119775 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:40.119390 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:40.119775 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:40.119500 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:41.118962 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:41.118919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:41.119278 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.119071 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:41.730705 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:41.730663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:41.730726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:41.730772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730850 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730870 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730911 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730932 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730936 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs podName:3861a753-509b-4421-9d6b-157dd144bfd1 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:57.730913867 +0000 UTC m=+34.195110992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs") pod "network-metrics-daemon-27s5h" (UID: "3861a753-509b-4421-9d6b-157dd144bfd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730945 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jw865 for pod openshift-network-diagnostics/network-check-target-7bkvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730957 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret podName:a1798509-7230-4963-a154-f42bc2f7e21b nodeName:}" failed. No retries permitted until 2026-07-28 11:35:57.730947456 +0000 UTC m=+34.195144576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret") pod "global-pull-secret-syncer-4bcsv" (UID: "a1798509-7230-4963-a154-f42bc2f7e21b") : object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:41.731198 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:41.730992 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865 podName:538e4919-e20e-46e3-8453-2702feeac868 nodeName:}" failed. No retries permitted until 2026-07-28 11:35:57.73097974 +0000 UTC m=+34.195176856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw865" (UniqueName: "kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865") pod "network-check-target-7bkvm" (UID: "538e4919-e20e-46e3-8453-2702feeac868") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:42.119101 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:42.119010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:42.119290 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:42.119022 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:42.119290 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:42.119138 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:42.119290 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:42.119218 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:43.118832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:43.118798 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:43.119286 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:43.118929 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:44.119867 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:44.119827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:44.120359 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:44.119930 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:44.120359 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:44.119992 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:44.120359 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:44.120105 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:45.119633 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:45.119586 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:45.119811 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:45.119733 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:46.119269 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.119097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:46.119817 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.119198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:46.119817 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:46.119414 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:46.119907 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:46.119856 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:46.212283 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.212249 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jcsx" event={"ID":"4061bfa3-be9d-4daf-b83a-37ea9e7b8f05","Type":"ContainerStarted","Data":"2ecc71228ae1c4655d18669f76baffb7c18684e77bbe8294344a3f2d54b9f4d9"} Jul 28 11:35:46.213723 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.213696 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" event={"ID":"b1fe3b6a-b2b7-4548-aede-62346dbcfd25","Type":"ContainerStarted","Data":"c4e985e81dbe5efd93127c894a69263307e9313912aeb98a11c6dec550618b7d"} Jul 28 11:35:46.215257 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.215234 2559 generic.go:356] "Generic (PLEG): container finished" podID="041cee35-562a-4db0-a574-f6271c12f721" containerID="d7c43c123c27c562c03533086ae4c950f3b0b676383a45ce9a9efc63fd449cee" exitCode=0 Jul 28 11:35:46.215361 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.215306 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerDied","Data":"d7c43c123c27c562c03533086ae4c950f3b0b676383a45ce9a9efc63fd449cee"} Jul 28 11:35:46.216939 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.216919 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" event={"ID":"11bbd64f-93f8-4391-a1d9-ecdd66978d91","Type":"ContainerStarted","Data":"108b562a3d1d4fccec99839662e40d8e4f61b70a00b1cf77bd23b0b879c707fd"} Jul 28 11:35:46.218553 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.218533 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c5swf" event={"ID":"57790825-368f-4eab-a1af-27e76d3c24ea","Type":"ContainerStarted","Data":"68c61488aa91c466888cc39c5c4852fed38f9f9f463cdfdfd402903f3c5e80e1"} Jul 28 11:35:46.220131 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.220107 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfk5s" event={"ID":"8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c","Type":"ContainerStarted","Data":"9390af6098daedb93d668c0a9f2caf61b7814e150e0ccd4407bb4042bb813935"} Jul 28 11:35:46.221648 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.221626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-544np" event={"ID":"732aea48-b74a-4438-aa34-fafb50d63ca3","Type":"ContainerStarted","Data":"5780c55cdb930db4f462512edcbbcb55b23fbbd2bb31e57f02a9fc33960fb52e"} Jul 28 11:35:46.228094 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.228044 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-238.ec2.internal" podStartSLOduration=21.228004666 podStartE2EDuration="21.228004666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:29.193312016 +0000 UTC m=+5.657509156" watchObservedRunningTime="2026-07-28 11:35:46.228004666 +0000 UTC m=+22.692201804" Jul 28 11:35:46.228556 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.228518 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4jcsx" podStartSLOduration=11.700518464 podStartE2EDuration="22.228504304s" totalImagesPullingTime="10.52798584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:46.228134062 +0000 UTC m=+22.692331204" watchObservedRunningTime="2026-07-28 11:35:46.228504304 +0000 UTC m=+22.692701443" Jul 28 11:35:46.246609 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.246555 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gfpmh" podStartSLOduration=3.539298543 podStartE2EDuration="22.246539364s" totalImagesPullingTime="18.707240821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:46.245847963 +0000 UTC m=+22.710045103" watchObservedRunningTime="2026-07-28 11:35:46.246539364 +0000 UTC m=+22.710736543" Jul 28 11:35:46.287708 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.287569 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-544np" podStartSLOduration=3.6030262730000002 podStartE2EDuration="22.287551124s" totalImagesPullingTime="18.684524851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:46.260067743 +0000 UTC m=+22.724264882" watchObservedRunningTime="2026-07-28 11:35:46.287551124 +0000 UTC m=+22.751748264" Jul 28 11:35:46.305896 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.305842 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c5swf" podStartSLOduration=3.602446619 podStartE2EDuration="22.305825237s" totalImagesPullingTime="18.703378618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:46.304896204 +0000 UTC m=+22.769093342" watchObservedRunningTime="2026-07-28 11:35:46.305825237 +0000 UTC m=+22.770022375" Jul 28 11:35:46.319252 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.319122 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zfk5s" podStartSLOduration=3.783581637 podStartE2EDuration="22.319106937s" totalImagesPullingTime="18.5355253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:46.318569642 +0000 UTC m=+22.782766782" watchObservedRunningTime="2026-07-28 11:35:46.319106937 +0000 UTC m=+22.783304069" Jul 28 11:35:46.436118 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.435891 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:46.535215 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:46.535188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:47.118981 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.118953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:47.119103 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:47.119082 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:47.227370 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.226885 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p7z8f" event={"ID":"eae05074-07f0-49ee-a307-2c481baa8e2e","Type":"ContainerStarted","Data":"31daac42b2d7d5d03aec056a48d41ade86602d6320b8beb61291e823edd36f1f"} Jul 28 11:35:47.231825 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.231795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"8db7e50cdf850df99e4cc90e6e52eff4f1e40a4b71050725191342284b072232"} Jul 28 11:35:47.231955 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.231890 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"0b68eae1f9e5041297ce545d10fd364ffa1de6b01a2230cfb4e530d31b01b939"} Jul 28 11:35:47.231955 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.231943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"9b5d5ff6b123d98e5370be094ea6f28fca5ad64d3bfbd190abaf41ea4275f4bf"} Jul 28 11:35:47.232059 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.231991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"d5a633c1c4e1258d4ff35ad173147f4c86171f440b3fd48d6ab77f9a9149e32d"} Jul 28 11:35:47.232059 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.232039 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"a58a64c0dbae02f9dc488ae4c89b8ea877040a61156a2d4f002f48e523c257fa"} Jul 28 11:35:47.232181 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.232089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"3b37585005ebfe262ca834294317b857111759a8950b699fbd42d27706384529"} Jul 28 11:35:47.245102 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.245048 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p7z8f" podStartSLOduration=4.5672030150000005 podStartE2EDuration="23.245031983s" totalImagesPullingTime="18.677828968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:47.244500375 +0000 UTC m=+23.708697519" watchObservedRunningTime="2026-07-28 11:35:47.245031983 +0000 UTC m=+23.709229123" Jul 28 11:35:47.361820 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.361749 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 11:35:47.368481 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.368456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:47.469422 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.469373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:47.961857 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.961814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:47.962710 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.962683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:47.965695 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.965583 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T11:35:47.361774809Z","UUID":"376cff0d-4d70-4216-8084-f4c2f2330d48","Handler":null,"Name":"","Endpoint":""} Jul 28 11:35:47.968073 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.968048 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 11:35:47.968217 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:47.968090 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 11:35:48.119729 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.119698 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:48.119913 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.119852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:48.119976 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:48.119946 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:48.120022 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:48.120000 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:48.132848 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.132824 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:48.133516 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.133494 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4jcsx" Jul 28 11:35:48.213137 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.213058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:48.236981 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.236881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" event={"ID":"11bbd64f-93f8-4391-a1d9-ecdd66978d91","Type":"ContainerStarted","Data":"77910afa6bbc02961d89c7ef40a3c63c0ccbce2a4fd9f07f456af12d258738fc"} Jul 28 11:35:48.534743 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.534707 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:48.635455 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.635412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:48.798997 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.798914 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:48.897499 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:48.897308 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:49.016417 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.016378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:49.086680 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.086585 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:49.118816 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.118789 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:49.119023 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:49.118910 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:49.243223 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.243186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"2521b9c16787ed802cff4b6c171b379dc2f4a2372a032eba068dccb7b3a1a33d"} Jul 28 11:35:49.245550 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.245516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" event={"ID":"11bbd64f-93f8-4391-a1d9-ecdd66978d91","Type":"ContainerStarted","Data":"a478e2df064bc4d9b4e85c9d54b43a6497ad3fba61a2a064b4f482e8ea50332d"} Jul 28 11:35:49.266566 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.266509 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g85v" podStartSLOduration=12.381201186 podStartE2EDuration="25.266486184s" totalImagesPullingTime="12.885284998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:49.266402098 +0000 UTC m=+25.730599257" watchObservedRunningTime="2026-07-28 11:35:49.266486184 +0000 UTC m=+25.730683324" Jul 28 11:35:49.464549 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.464458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:49.565568 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.565533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:49.968269 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:49.968238 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:50.046734 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:50.046702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:50.118822 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:50.118790 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:50.119014 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:50.118928 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:50.119065 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:50.118919 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:50.119065 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:50.119021 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:50.142639 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:50.142600 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:51.092417 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.092333 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:51.119654 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.119485 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:51.119775 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:51.119743 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:51.253973 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.253942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" event={"ID":"f08dfc9d-9470-4c4b-b071-c0efd0794d6a","Type":"ContainerStarted","Data":"80a185e488f3da3b79c49cf4c280413c2b7864aea413646f18f22e6c1f4f8835"} Jul 28 11:35:51.254223 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.254177 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:51.254298 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.254256 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:51.254356 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.254305 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:51.255987 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.255949 2559 generic.go:356] "Generic (PLEG): container finished" podID="041cee35-562a-4db0-a574-f6271c12f721" containerID="b711e2dd6648a63d45e7f0d3d49393ed2dfb73327169179bcacb8485da822b8c" exitCode=0 Jul 28 11:35:51.255987 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.255985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerDied","Data":"b711e2dd6648a63d45e7f0d3d49393ed2dfb73327169179bcacb8485da822b8c"} Jul 28 11:35:51.271323 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.271298 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:51.271477 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.271443 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:35:51.282076 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:51.282031 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" podStartSLOduration=8.201156397 podStartE2EDuration="27.282017752s" totalImagesPullingTime="19.080861355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:35:51.281808644 +0000 UTC m=+27.746005794" watchObservedRunningTime="2026-07-28 11:35:51.282017752 +0000 UTC m=+27.746214891" Jul 28 11:35:52.021658 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:52.021624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:52.119214 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:52.119114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:52.119714 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:52.119245 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:52.119714 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:52.119299 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:52.119714 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:52.119396 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:53.014932 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.014735 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bkvm"] Jul 28 11:35:53.015149 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.015002 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:53.015149 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:53.015093 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:53.017909 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.017878 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27s5h"] Jul 28 11:35:53.018058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.018001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:53.018125 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:53.018110 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:53.018482 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.018462 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4bcsv"] Jul 28 11:35:53.018575 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.018546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:53.018657 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:53.018638 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:53.263256 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.263171 2559 generic.go:356] "Generic (PLEG): container finished" podID="041cee35-562a-4db0-a574-f6271c12f721" containerID="79953b95753b78edc70c1f5df2ef9f39781cc7363d1fb87e98325aa17189a24a" exitCode=0 Jul 28 11:35:53.263256 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:53.263181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerDied","Data":"79953b95753b78edc70c1f5df2ef9f39781cc7363d1fb87e98325aa17189a24a"} Jul 28 11:35:54.119921 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:54.119883 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:54.120149 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:54.120000 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:55.011391 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.011312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:55.118744 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.118709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:55.118744 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.118734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:55.118928 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:55.118826 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:55.118968 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:55.118938 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:55.269538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.269445 2559 generic.go:356] "Generic (PLEG): container finished" podID="041cee35-562a-4db0-a574-f6271c12f721" containerID="5ea0c2f2cbd14128e5c1f329f1943c8a11b21ab94539484209a7355793461d43" exitCode=0 Jul 28 11:35:55.269538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.269500 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerDied","Data":"5ea0c2f2cbd14128e5c1f329f1943c8a11b21ab94539484209a7355793461d43"} Jul 28 11:35:55.422022 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.421988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:55.522134 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.522051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:55.629929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.629895 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:55.723344 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.723272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:55.808795 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:55.808698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:56.119085 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:56.119006 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:56.119682 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:56.119150 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:56.145573 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:56.145541 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:56.221857 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:56.221826 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:56.717440 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:56.717398 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:57.119461 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:57.119379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:57.119461 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:57.119410 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:57.120071 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.119520 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:57.120071 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.119667 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:57.321970 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:57.321932 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:57.717115 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:57.717078 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:57.760331 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:57.760296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:57.760515 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:57.760359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:57.760515 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:57.760403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:57.760515 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760407 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:57.760515 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760467 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs podName:3861a753-509b-4421-9d6b-157dd144bfd1 nodeName:}" failed. No retries permitted until 2026-07-28 11:36:29.760447466 +0000 UTC m=+66.224644594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs") pod "network-metrics-daemon-27s5h" (UID: "3861a753-509b-4421-9d6b-157dd144bfd1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 11:35:57.760515 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760491 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:57.760754 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760525 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret podName:a1798509-7230-4963-a154-f42bc2f7e21b nodeName:}" failed. No retries permitted until 2026-07-28 11:36:29.760515398 +0000 UTC m=+66.224712517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret") pod "global-pull-secret-syncer-4bcsv" (UID: "a1798509-7230-4963-a154-f42bc2f7e21b") : object "kube-system"/"original-pull-secret" not registered Jul 28 11:35:57.760754 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760542 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 11:35:57.760754 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760565 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 11:35:57.760754 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760576 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jw865 for pod openshift-network-diagnostics/network-check-target-7bkvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:57.760754 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:57.760623 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865 podName:538e4919-e20e-46e3-8453-2702feeac868 nodeName:}" failed. No retries permitted until 2026-07-28 11:36:29.760608701 +0000 UTC m=+66.224805817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jw865" (UniqueName: "kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865") pod "network-check-target-7bkvm" (UID: "538e4919-e20e-46e3-8453-2702feeac868") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 11:35:58.119000 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:58.118894 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:35:58.119177 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:58.119044 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:35:58.125599 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:58.125571 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:58.325862 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:58.325820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:58.923440 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:58.923404 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:59.119133 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:59.119092 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:35:59.119133 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:59.119137 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:35:59.119397 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:59.119249 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:35:59.119397 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:35:59.119355 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:35:59.127222 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:59.127185 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:59.320895 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:59.320859 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:59.520229 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:59.520137 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:35:59.892690 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:35:59.892605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:00.119125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.119093 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:00.119316 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:00.119250 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:36:00.124117 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.124085 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:00.284789 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.284705 2559 generic.go:356] "Generic (PLEG): container finished" podID="041cee35-562a-4db0-a574-f6271c12f721" containerID="733bf6c03c8bcc2aa9b9cb9a6552d19caefbd98bd07729d525c107f60073eaca" exitCode=0 Jul 28 11:36:00.284789 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.284741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerDied","Data":"733bf6c03c8bcc2aa9b9cb9a6552d19caefbd98bd07729d525c107f60073eaca"} Jul 28 11:36:00.298068 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.298044 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:00.365063 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.364865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:00.521245 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.521216 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:00.618367 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.618276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:00.920435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:00.920347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:01.117245 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:01.117214 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:01.119110 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:01.119080 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:01.119238 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:01.119202 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:36:01.119279 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:01.119256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:01.119411 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:01.119396 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:36:01.290490 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:01.290384 2559 generic.go:356] "Generic (PLEG): container finished" podID="041cee35-562a-4db0-a574-f6271c12f721" containerID="37d56ac07a141800fb4d5352e32a287ebff9c9f7edc8385f9715db364dbdee8d" exitCode=0 Jul 28 11:36:01.290490 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:01.290431 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerDied","Data":"37d56ac07a141800fb4d5352e32a287ebff9c9f7edc8385f9715db364dbdee8d"} Jul 28 11:36:01.719051 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:01.718925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:01.916360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:01.916325 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:02.031678 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:02.031600 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:02.119498 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:02.119464 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:02.119677 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:02.119604 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:36:02.296468 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:02.296383 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" event={"ID":"041cee35-562a-4db0-a574-f6271c12f721","Type":"ContainerStarted","Data":"7bfa3977720bb2d255b8c96d72417809fd2c6d5e89680370d4fd6dd3d98a71b9"} Jul 28 11:36:02.318900 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:02.318850 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gf2bz" podStartSLOduration=8.630010637 podStartE2EDuration="38.318834308s" totalImagesPullingTime="29.688823671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:02.317692277 +0000 UTC m=+38.781889417" watchObservedRunningTime="2026-07-28 11:36:02.318834308 +0000 UTC m=+38.783031448" Jul 28 11:36:02.319679 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:02.319650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:02.387859 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:02.387829 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:02.920047 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:02.919967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:03.119039 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:03.119003 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:03.119211 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:03.119113 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:36:03.119211 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:03.119175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:03.119302 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:03.119265 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:36:03.539986 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:03.539953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:03.721585 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:03.721552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:04.119908 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:04.119880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:04.120075 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:04.119976 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:36:04.121011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:04.120986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:04.249910 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:04.249879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:04.349365 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:04.349316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:04.452884 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:04.452803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:04.685600 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:04.685572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:04.786647 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:04.786565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:05.119438 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:05.119359 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:05.119563 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:05.119460 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:36:05.119563 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:05.119531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:05.119635 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:05.119611 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:36:05.121890 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:05.121867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:05.720137 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:05.720106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:05.940611 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:05.940577 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:06.118986 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:06.118905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:06.119117 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:06.119010 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:36:06.135603 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:06.135574 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:07.119006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:07.118974 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:07.119006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:07.119008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:07.119458 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:07.119075 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:36:07.119458 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:07.119235 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:36:08.119244 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:08.119213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:08.119624 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:08.119350 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:36:09.118621 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:09.118572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:09.118886 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:09.118574 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:09.118886 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:09.118700 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:36:09.118886 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:09.118764 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:36:10.122400 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:10.122373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:10.122769 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:10.122484 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27s5h" podUID="3861a753-509b-4421-9d6b-157dd144bfd1" Jul 28 11:36:10.839982 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:10.839947 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:10.939724 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:10.939688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:11.038955 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.038924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:11.119438 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.119356 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:11.119583 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.119356 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:11.119583 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:11.119487 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bkvm" podUID="538e4919-e20e-46e3-8453-2702feeac868" Jul 28 11:36:11.119583 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:11.119535 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bcsv" podUID="a1798509-7230-4963-a154-f42bc2f7e21b" Jul 28 11:36:11.140848 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.140820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:11.256126 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.256096 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:11.469342 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.469315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:11.660512 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.660418 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:11.726064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.726030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:11.760930 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.760902 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-238.ec2.internal" event="NodeReady" Jul 28 11:36:11.761083 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.761028 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 11:36:11.812269 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.812219 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-brkml"] Jul 28 11:36:11.851052 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.851022 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xpndg"] Jul 28 11:36:11.851220 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.851144 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:11.853721 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.853686 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 11:36:11.853875 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.853742 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hp2f8\"" Jul 28 11:36:11.853875 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.853797 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 11:36:11.853875 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.853746 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 11:36:11.870813 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.870791 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brkml"] Jul 28 11:36:11.870945 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.870820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xpndg"] Jul 28 11:36:11.870945 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.870914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:11.875446 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.875423 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 11:36:11.875575 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.875451 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fd7gg\"" Jul 28 11:36:11.875575 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.875488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 11:36:11.876110 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.876090 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 11:36:11.876110 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.876092 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 11:36:11.951903 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.951827 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kgjrh"] Jul 28 11:36:11.958149 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.958127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf7c1600-ee13-496d-83d0-fbcbfe084204-cert\") pod \"ingress-canary-brkml\" (UID: \"bf7c1600-ee13-496d-83d0-fbcbfe084204\") " pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:11.958240 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.958185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xl7\" (UniqueName: \"kubernetes.io/projected/bf7c1600-ee13-496d-83d0-fbcbfe084204-kube-api-access-h7xl7\") pod \"ingress-canary-brkml\" (UID: \"bf7c1600-ee13-496d-83d0-fbcbfe084204\") " pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:11.968868 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.968849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:11.975697 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.975677 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kgjrh"] Jul 28 11:36:11.977836 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.977811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 11:36:11.977941 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.977866 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l859x\"" Jul 28 11:36:11.978445 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:11.978429 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 11:36:12.058571 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.058530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-data-volume\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.058777 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.058587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.058777 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.058612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf7c1600-ee13-496d-83d0-fbcbfe084204-cert\") pod \"ingress-canary-brkml\" (UID: \"bf7c1600-ee13-496d-83d0-fbcbfe084204\") " pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:12.058777 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.058666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-crio-socket\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.058777 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.058737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xl7\" (UniqueName: \"kubernetes.io/projected/bf7c1600-ee13-496d-83d0-fbcbfe084204-kube-api-access-h7xl7\") pod \"ingress-canary-brkml\" (UID: \"bf7c1600-ee13-496d-83d0-fbcbfe084204\") " pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:12.058777 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.058767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.059026 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.058820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvzmx\" (UniqueName: \"kubernetes.io/projected/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-kube-api-access-qvzmx\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.062839 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.062819 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf7c1600-ee13-496d-83d0-fbcbfe084204-cert\") pod \"ingress-canary-brkml\" (UID: \"bf7c1600-ee13-496d-83d0-fbcbfe084204\") " pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:12.067362 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.067336 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xl7\" (UniqueName: \"kubernetes.io/projected/bf7c1600-ee13-496d-83d0-fbcbfe084204-kube-api-access-h7xl7\") pod \"ingress-canary-brkml\" (UID: \"bf7c1600-ee13-496d-83d0-fbcbfe084204\") " pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:12.096847 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.096818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:12.118885 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.118861 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:12.121241 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.121221 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 11:36:12.121363 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.121288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jmhds\"" Jul 28 11:36:12.159280 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159290 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krtnb\" (UniqueName: \"kubernetes.io/projected/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-kube-api-access-krtnb\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-config-volume\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-crio-socket\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-tmp-dir\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvzmx\" (UniqueName: \"kubernetes.io/projected/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-kube-api-access-qvzmx\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-metrics-tls\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159556 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-crio-socket\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.159641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-data-volume\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.160010 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brkml" Jul 28 11:36:12.160010 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.159867 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-data-volume\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.160107 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.160091 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.161553 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.161537 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.174143 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.173900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:12.174620 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.174598 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvzmx\" (UniqueName: \"kubernetes.io/projected/ce9a3f0b-af02-466a-a731-65c6f1c93e0b-kube-api-access-qvzmx\") pod \"insights-runtime-extractor-xpndg\" (UID: \"ce9a3f0b-af02-466a-a731-65c6f1c93e0b\") " pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.179429 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.179356 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xpndg" Jul 28 11:36:12.260089 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.260051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-tmp-dir\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.260282 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.260109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-metrics-tls\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.260282 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.260170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krtnb\" (UniqueName: \"kubernetes.io/projected/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-kube-api-access-krtnb\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.260282 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.260200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-config-volume\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.260467 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.260443 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-tmp-dir\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.260754 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.260726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-config-volume\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.262623 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.262578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-metrics-tls\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.267772 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.267609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krtnb\" (UniqueName: \"kubernetes.io/projected/2a8c8966-86b1-4767-9e9b-27b2c10a80f8-kube-api-access-krtnb\") pod \"dns-default-kgjrh\" (UID: \"2a8c8966-86b1-4767-9e9b-27b2c10a80f8\") " pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.278039 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.278010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:12.373006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.372971 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xpndg"] Jul 28 11:36:12.375655 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.375623 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brkml"] Jul 28 11:36:12.377066 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:12.377043 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9a3f0b_af02_466a_a731_65c6f1c93e0b.slice/crio-a73faf965ecb4ad789707e40bcf524e2d7951454acd2661c5ea8c94f84c7264e WatchSource:0}: Error finding container a73faf965ecb4ad789707e40bcf524e2d7951454acd2661c5ea8c94f84c7264e: Status 404 returned error can't find the container with id a73faf965ecb4ad789707e40bcf524e2d7951454acd2661c5ea8c94f84c7264e Jul 28 11:36:12.379605 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:12.379580 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7c1600_ee13_496d_83d0_fbcbfe084204.slice/crio-a117271a89edd837e813e68287080d0810e3aeab42f6287a7ced051a8718a2b0 WatchSource:0}: Error finding container a117271a89edd837e813e68287080d0810e3aeab42f6287a7ced051a8718a2b0: Status 404 returned error can't find the container with id a117271a89edd837e813e68287080d0810e3aeab42f6287a7ced051a8718a2b0 Jul 28 11:36:12.412832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.412803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:12.435254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.435216 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kgjrh"] Jul 28 11:36:12.438599 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:12.438574 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8c8966_86b1_4767_9e9b_27b2c10a80f8.slice/crio-2ef4abe42963dc68b35d3358b0f4cd536bfb474749fbde7e665790819d42ff4b WatchSource:0}: Error finding container 2ef4abe42963dc68b35d3358b0f4cd536bfb474749fbde7e665790819d42ff4b: Status 404 returned error can't find the container with id 2ef4abe42963dc68b35d3358b0f4cd536bfb474749fbde7e665790819d42ff4b Jul 28 11:36:12.514733 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.514704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:12.645055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.645008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:12.817388 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:12.817312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:13.017581 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.017457 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:13.119512 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.119103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:13.119512 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.119103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:13.121641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.121617 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6mch\"" Jul 28 11:36:13.121888 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.121872 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 11:36:13.122125 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.122108 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 11:36:13.122375 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.122356 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 11:36:13.230189 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.230064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:13.328346 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.328309 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgjrh" event={"ID":"2a8c8966-86b1-4767-9e9b-27b2c10a80f8","Type":"ContainerStarted","Data":"2ef4abe42963dc68b35d3358b0f4cd536bfb474749fbde7e665790819d42ff4b"} Jul 28 11:36:13.330027 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.329996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:13.330796 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.330767 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpndg" event={"ID":"ce9a3f0b-af02-466a-a731-65c6f1c93e0b","Type":"ContainerStarted","Data":"a73faf965ecb4ad789707e40bcf524e2d7951454acd2661c5ea8c94f84c7264e"} Jul 28 11:36:13.332571 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:13.332546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brkml" event={"ID":"bf7c1600-ee13-496d-83d0-fbcbfe084204","Type":"ContainerStarted","Data":"a117271a89edd837e813e68287080d0810e3aeab42f6287a7ced051a8718a2b0"} Jul 28 11:36:14.162354 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:14.162319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:14.228992 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:14.228918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:19.352650 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.352604 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgjrh" event={"ID":"2a8c8966-86b1-4767-9e9b-27b2c10a80f8","Type":"ContainerStarted","Data":"03a95aa02c5274c572cc9fc04e80a0895cd46a8ace0b56b6840ddf0638b50bed"} Jul 28 11:36:19.353241 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.352681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgjrh" event={"ID":"2a8c8966-86b1-4767-9e9b-27b2c10a80f8","Type":"ContainerStarted","Data":"bb95b20a12799dbc9f69149c5ca37c8bed2148253e3041be945ce2c7a0ee8e45"} Jul 28 11:36:19.353241 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.352811 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:19.354650 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.354621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpndg" event={"ID":"ce9a3f0b-af02-466a-a731-65c6f1c93e0b","Type":"ContainerStarted","Data":"28ea14d624cf91a666d8682dddf2031d5e67cc4eaf643dba3004cdccdbf15231"} Jul 28 11:36:19.356281 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.356257 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brkml" event={"ID":"bf7c1600-ee13-496d-83d0-fbcbfe084204","Type":"ContainerStarted","Data":"b903686b5ed2af0b77302cd83d5db8d726a1ddf34e73d162edc3949ad589ec17"} Jul 28 11:36:19.372183 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.372124 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kgjrh" podStartSLOduration=2.089103558 podStartE2EDuration="8.372111368s" totalImagesPullingTime="6.28300781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:19.370872452 +0000 UTC m=+55.835069592" watchObservedRunningTime="2026-07-28 11:36:19.372111368 +0000 UTC m=+55.836308505" Jul 28 11:36:19.385208 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.385143 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-brkml" podStartSLOduration=2.043310296 podStartE2EDuration="8.38512536s" totalImagesPullingTime="6.341815064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:19.384671448 +0000 UTC m=+55.848868582" watchObservedRunningTime="2026-07-28 11:36:19.38512536 +0000 UTC m=+55.849322505" Jul 28 11:36:19.654514 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.654305 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559855db94-szvb4"] Jul 28 11:36:19.656368 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.656342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.659940 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.659910 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 11:36:19.660186 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.660168 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 11:36:19.660701 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.660529 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 11:36:19.660701 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.660564 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 11:36:19.660701 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.660666 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 11:36:19.661231 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.661207 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 11:36:19.661383 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.661366 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 11:36:19.661606 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.661591 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jmkgt\"" Jul 28 11:36:19.673506 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.673476 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559855db94-szvb4"] Jul 28 11:36:19.716770 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.716731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-oauth-serving-cert\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.716969 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.716777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9nth\" (UniqueName: \"kubernetes.io/projected/0d9fdb11-b416-4ac1-a497-9e146ad1235c-kube-api-access-r9nth\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.716969 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.716805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-oauth-config\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.716969 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.716823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-service-ca\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.716969 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.716953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-config\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.717202 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.717071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-serving-cert\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.818462 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.818423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-config\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.818664 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.818612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-serving-cert\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.818664 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.818658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-oauth-serving-cert\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.818786 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.818681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9nth\" (UniqueName: \"kubernetes.io/projected/0d9fdb11-b416-4ac1-a497-9e146ad1235c-kube-api-access-r9nth\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.818786 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.818709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-oauth-config\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.818786 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.818732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-service-ca\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.819386 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.819333 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-config\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.819527 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.819453 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-service-ca\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.819527 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.819466 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-oauth-serving-cert\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.821686 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.821661 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-serving-cert\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.821846 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.821765 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-oauth-config\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.830351 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.830327 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9nth\" (UniqueName: \"kubernetes.io/projected/0d9fdb11-b416-4ac1-a497-9e146ad1235c-kube-api-access-r9nth\") pod \"console-559855db94-szvb4\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:19.969614 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:19.969509 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:20.130879 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.130844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559855db94-szvb4"] Jul 28 11:36:20.136295 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:20.136265 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9fdb11_b416_4ac1_a497_9e146ad1235c.slice/crio-869a53ccc58824ddbc789ed7f1b7699930fcda30e6bfa5d5c68cd9cb4e95e0c5 WatchSource:0}: Error finding container 869a53ccc58824ddbc789ed7f1b7699930fcda30e6bfa5d5c68cd9cb4e95e0c5: Status 404 returned error can't find the container with id 869a53ccc58824ddbc789ed7f1b7699930fcda30e6bfa5d5c68cd9cb4e95e0c5 Jul 28 11:36:20.360268 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.360224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559855db94-szvb4" event={"ID":"0d9fdb11-b416-4ac1-a497-9e146ad1235c","Type":"ContainerStarted","Data":"869a53ccc58824ddbc789ed7f1b7699930fcda30e6bfa5d5c68cd9cb4e95e0c5"} Jul 28 11:36:20.731535 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.731452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:20.769495 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.769461 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-9k87k"] Jul 28 11:36:20.776518 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.776486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.779958 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.779935 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 11:36:20.781190 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.780949 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 11:36:20.781190 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.780964 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-scvdh\"" Jul 28 11:36:20.781190 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.781100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 11:36:20.781190 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.781101 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 11:36:20.781496 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.781415 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 11:36:20.782868 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.782849 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-9k87k"] Jul 28 11:36:20.812518 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.812484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:20.826824 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.826781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnh9s\" (UniqueName: \"kubernetes.io/projected/a5deee8c-3a54-4aa0-b036-ae97b8934861-kube-api-access-jnh9s\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.826986 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.826864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.826986 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.826901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.826986 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.826972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5deee8c-3a54-4aa0-b036-ae97b8934861-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.927391 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.927354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5deee8c-3a54-4aa0-b036-ae97b8934861-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.927597 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.927563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnh9s\" (UniqueName: \"kubernetes.io/projected/a5deee8c-3a54-4aa0-b036-ae97b8934861-kube-api-access-jnh9s\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.927672 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.927606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.927672 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.927632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.927808 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:20.927784 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 11:36:20.927876 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:20.927864 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-tls podName:a5deee8c-3a54-4aa0-b036-ae97b8934861 nodeName:}" failed. No retries permitted until 2026-07-28 11:36:21.4278435 +0000 UTC m=+57.892040635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-9k87k" (UID: "a5deee8c-3a54-4aa0-b036-ae97b8934861") : secret "prometheus-operator-tls" not found Jul 28 11:36:20.928171 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.928121 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5deee8c-3a54-4aa0-b036-ae97b8934861-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.930141 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.930114 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:20.937363 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:20.937339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnh9s\" (UniqueName: \"kubernetes.io/projected/a5deee8c-3a54-4aa0-b036-ae97b8934861-kube-api-access-jnh9s\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:21.033229 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:21.033196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:21.432668 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:21.432590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:21.435072 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:21.435041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5deee8c-3a54-4aa0-b036-ae97b8934861-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-9k87k\" (UID: \"a5deee8c-3a54-4aa0-b036-ae97b8934861\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:21.688617 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:21.688521 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" Jul 28 11:36:22.325850 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:22.325667 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-9k87k"] Jul 28 11:36:22.333948 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:22.333909 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5deee8c_3a54_4aa0_b036_ae97b8934861.slice/crio-7a0ec8fc3480124500edcdd6b6c0c236d04497094dbe58cdec462f9a7cbf3742 WatchSource:0}: Error finding container 7a0ec8fc3480124500edcdd6b6c0c236d04497094dbe58cdec462f9a7cbf3742: Status 404 returned error can't find the container with id 7a0ec8fc3480124500edcdd6b6c0c236d04497094dbe58cdec462f9a7cbf3742 Jul 28 11:36:22.368811 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:22.368682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" event={"ID":"a5deee8c-3a54-4aa0-b036-ae97b8934861","Type":"ContainerStarted","Data":"7a0ec8fc3480124500edcdd6b6c0c236d04497094dbe58cdec462f9a7cbf3742"} Jul 28 11:36:22.371024 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:22.370993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpndg" event={"ID":"ce9a3f0b-af02-466a-a731-65c6f1c93e0b","Type":"ContainerStarted","Data":"4a569e9b4b677421d2ff11c93ffbd9c783bcd1526dabd90d57a3cdd55bda114d"} Jul 28 11:36:23.185932 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:23.185823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:23.249137 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:23.249097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:23.278253 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:23.278123 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vjzj" Jul 28 11:36:23.409544 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:23.409506 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:23.470648 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:23.470567 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:24.187727 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:24.187687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:24.251091 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:24.251054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:26.028939 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:26.028907 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:26.130754 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:26.130674 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:27.015578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.015546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:27.129356 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.129248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:27.387459 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.387360 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559855db94-szvb4" event={"ID":"0d9fdb11-b416-4ac1-a497-9e146ad1235c","Type":"ContainerStarted","Data":"debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398"} Jul 28 11:36:27.389344 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.389314 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xpndg" event={"ID":"ce9a3f0b-af02-466a-a731-65c6f1c93e0b","Type":"ContainerStarted","Data":"faf36afe83df91b1e11fcfcb041763442193ddff6c1ecf52be5affd01e0b859c"} Jul 28 11:36:27.391014 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.390991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" event={"ID":"a5deee8c-3a54-4aa0-b036-ae97b8934861","Type":"ContainerStarted","Data":"ab950b5d69fd202407c75ab4a1447dad83798958a1cbb603a1700019bc1ae55a"} Jul 28 11:36:27.391115 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.391030 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" event={"ID":"a5deee8c-3a54-4aa0-b036-ae97b8934861","Type":"ContainerStarted","Data":"f7d65ff870091fe18fa1c8ac89a41b868b04e94e6ae268befce5fa2f4b92b196"} Jul 28 11:36:27.405628 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.405585 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559855db94-szvb4" podStartSLOduration=1.716370728 podStartE2EDuration="8.405568935s" totalImagesPullingTime="6.689198207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:27.404890513 +0000 UTC m=+63.869087653" watchObservedRunningTime="2026-07-28 11:36:27.405568935 +0000 UTC m=+63.869766075" Jul 28 11:36:27.426734 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.426695 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xpndg" podStartSLOduration=2.11675922 podStartE2EDuration="16.426681533s" totalImagesPullingTime="14.309922313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:36:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:27.426202771 +0000 UTC m=+63.890399912" watchObservedRunningTime="2026-07-28 11:36:27.426681533 +0000 UTC m=+63.890878672" Jul 28 11:36:27.442659 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.442613 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-9k87k" podStartSLOduration=2.951277166 podStartE2EDuration="7.442597336s" totalImagesPullingTime="4.49132017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:27.442230169 +0000 UTC m=+63.906427307" watchObservedRunningTime="2026-07-28 11:36:27.442597336 +0000 UTC m=+63.906794476" Jul 28 11:36:27.689917 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.689835 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:27.745219 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:27.745191 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:28.222429 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.222394 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d78fc447c-qwjv9"] Jul 28 11:36:28.225467 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.225452 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.234104 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.234081 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 11:36:28.238052 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.238025 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d78fc447c-qwjv9"] Jul 28 11:36:28.291727 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.291688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-config\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.291914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.291737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-oauth-config\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.291914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.291756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-service-ca\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.291914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.291818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-927r5\" (UniqueName: \"kubernetes.io/projected/123ed147-7e82-4ac3-9c71-b35d4aee695d-kube-api-access-927r5\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.291914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.291878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-trusted-ca-bundle\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.292094 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.291970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-oauth-serving-cert\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.292094 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.292003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-serving-cert\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.392519 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.392486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-serving-cert\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.392519 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.392521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-config\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.392775 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.392563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-oauth-config\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.392775 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.392585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-service-ca\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.392775 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.392722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-927r5\" (UniqueName: \"kubernetes.io/projected/123ed147-7e82-4ac3-9c71-b35d4aee695d-kube-api-access-927r5\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.392928 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.392800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-trusted-ca-bundle\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.392928 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.392869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-oauth-serving-cert\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.393397 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.393363 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-config\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.393535 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.393516 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-service-ca\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.396013 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.393805 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-oauth-serving-cert\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.396013 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.393990 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-trusted-ca-bundle\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.396425 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.396400 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-serving-cert\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.396497 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.396467 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-oauth-config\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.405375 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.405352 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-927r5\" (UniqueName: \"kubernetes.io/projected/123ed147-7e82-4ac3-9c71-b35d4aee695d-kube-api-access-927r5\") pod \"console-6d78fc447c-qwjv9\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.534782 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.534746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:28.665041 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.665010 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d78fc447c-qwjv9"] Jul 28 11:36:28.668683 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:28.668642 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123ed147_7e82_4ac3_9c71_b35d4aee695d.slice/crio-41806a1251d81505edfbc515e812aea8e5d5753b85982bc3e5464589340c1c5f WatchSource:0}: Error finding container 41806a1251d81505edfbc515e812aea8e5d5753b85982bc3e5464589340c1c5f: Status 404 returned error can't find the container with id 41806a1251d81505edfbc515e812aea8e5d5753b85982bc3e5464589340c1c5f Jul 28 11:36:28.867385 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:28.867291 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.099401 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.099367 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.145750 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.145669 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m"] Jul 28 11:36:29.148699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.148681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.155363 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.155338 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 11:36:29.155490 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.155378 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8c57q\"" Jul 28 11:36:29.155490 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.155346 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 11:36:29.158249 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.158231 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr"] Jul 28 11:36:29.161084 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.161067 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.162760 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.162740 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m"] Jul 28 11:36:29.163295 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.163275 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 11:36:29.163388 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.163316 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t4rng\"" Jul 28 11:36:29.163388 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.163282 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 11:36:29.163648 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.163633 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 11:36:29.175394 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.175368 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6dztz"] Jul 28 11:36:29.178602 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.178583 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr"] Jul 28 11:36:29.178699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.178687 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.181253 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.181225 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 11:36:29.181363 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.181260 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bhnqj\"" Jul 28 11:36:29.181363 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.181286 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 11:36:29.181363 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.181312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 11:36:29.199566 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.199683 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/196f824d-bdad-4c7b-b3d7-62522d631e64-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.199683 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.199683 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d755d\" (UniqueName: \"kubernetes.io/projected/196f824d-bdad-4c7b-b3d7-62522d631e64-kube-api-access-d755d\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.199795 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.199795 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbdcz\" (UniqueName: \"kubernetes.io/projected/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-api-access-pbdcz\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.199795 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec71652e-6c9e-4007-a92f-354a25b8bda2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.199795 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.199926 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec71652e-6c9e-4007-a92f-354a25b8bda2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.199926 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.199832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.205649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.205624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.299570 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.299542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.300587 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrrjg\" (UniqueName: \"kubernetes.io/projected/e977f255-d8e9-46e0-906c-70505f0610fc-kube-api-access-mrrjg\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.300647 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.300705 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-textfile\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.300705 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/196f824d-bdad-4c7b-b3d7-62522d631e64-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.300705 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:29.300704 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 11:36:29.300851 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:29.300776 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-tls podName:ec71652e-6c9e-4007-a92f-354a25b8bda2 nodeName:}" failed. No retries permitted until 2026-07-28 11:36:29.800753241 +0000 UTC m=+66.264950380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-zhhrr" (UID: "ec71652e-6c9e-4007-a92f-354a25b8bda2") : secret "kube-state-metrics-tls" not found Jul 28 11:36:29.300851 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-sys\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.300851 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-root\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.300959 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.300992 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d755d\" (UniqueName: \"kubernetes.io/projected/196f824d-bdad-4c7b-b3d7-62522d631e64-kube-api-access-d755d\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.301064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.300987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.301064 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:29.301025 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 11:36:29.301171 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:36:29.301075 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-tls podName:196f824d-bdad-4c7b-b3d7-62522d631e64 nodeName:}" failed. No retries permitted until 2026-07-28 11:36:29.801057911 +0000 UTC m=+66.265255034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-t6v4m" (UID: "196f824d-bdad-4c7b-b3d7-62522d631e64") : secret "openshift-state-metrics-tls" not found Jul 28 11:36:29.301171 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbdcz\" (UniqueName: \"kubernetes.io/projected/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-api-access-pbdcz\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.301285 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e977f255-d8e9-46e0-906c-70505f0610fc-metrics-client-ca\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.301285 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.301285 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec71652e-6c9e-4007-a92f-354a25b8bda2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.301408 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.301408 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec71652e-6c9e-4007-a92f-354a25b8bda2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.301408 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301362 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/196f824d-bdad-4c7b-b3d7-62522d631e64-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.301408 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.301573 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.301573 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-tls\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.301573 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-wtmp\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.301724 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec71652e-6c9e-4007-a92f-354a25b8bda2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.301781 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301764 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.301942 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.301916 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec71652e-6c9e-4007-a92f-354a25b8bda2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.303747 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.303723 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.303842 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.303787 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.311521 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.311501 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbdcz\" (UniqueName: \"kubernetes.io/projected/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-api-access-pbdcz\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.311603 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.311521 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d755d\" (UniqueName: \"kubernetes.io/projected/196f824d-bdad-4c7b-b3d7-62522d631e64-kube-api-access-d755d\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.362558 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.362527 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kgjrh" Jul 28 11:36:29.402033 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.401919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402033 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-tls\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402263 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-wtmp\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402263 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrrjg\" (UniqueName: \"kubernetes.io/projected/e977f255-d8e9-46e0-906c-70505f0610fc-kube-api-access-mrrjg\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402263 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-textfile\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402263 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-sys\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402461 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-root\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402461 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e977f255-d8e9-46e0-906c-70505f0610fc-metrics-client-ca\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402461 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402602 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402584 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.402935 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.402821 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-sys\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.403538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.403144 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-textfile\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.403538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.403235 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-wtmp\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.403538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.403326 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e977f255-d8e9-46e0-906c-70505f0610fc-root\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.403750 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.403734 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e977f255-d8e9-46e0-906c-70505f0610fc-metrics-client-ca\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.404706 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.404679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78fc447c-qwjv9" event={"ID":"123ed147-7e82-4ac3-9c71-b35d4aee695d","Type":"ContainerStarted","Data":"27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7"} Jul 28 11:36:29.404877 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.404732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78fc447c-qwjv9" event={"ID":"123ed147-7e82-4ac3-9c71-b35d4aee695d","Type":"ContainerStarted","Data":"41806a1251d81505edfbc515e812aea8e5d5753b85982bc3e5464589340c1c5f"} Jul 28 11:36:29.406070 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.406048 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-tls\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.406384 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.406363 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e977f255-d8e9-46e0-906c-70505f0610fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.410737 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.410714 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrrjg\" (UniqueName: \"kubernetes.io/projected/e977f255-d8e9-46e0-906c-70505f0610fc-kube-api-access-mrrjg\") pod \"node-exporter-6dztz\" (UID: \"e977f255-d8e9-46e0-906c-70505f0610fc\") " pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.415954 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.415930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.423318 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.423278 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d78fc447c-qwjv9" podStartSLOduration=1.423266827 podStartE2EDuration="1.423266827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:29.422589314 +0000 UTC m=+65.886786455" watchObservedRunningTime="2026-07-28 11:36:29.423266827 +0000 UTC m=+65.887463966" Jul 28 11:36:29.487336 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.487294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dztz" Jul 28 11:36:29.500175 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:29.500136 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode977f255_d8e9_46e0_906c_70505f0610fc.slice/crio-30c062004f0439d1e0881115bfca7146d215322ef0dfb9971022b4c78c3fff4b WatchSource:0}: Error finding container 30c062004f0439d1e0881115bfca7146d215322ef0dfb9971022b4c78c3fff4b: Status 404 returned error can't find the container with id 30c062004f0439d1e0881115bfca7146d215322ef0dfb9971022b4c78c3fff4b Jul 28 11:36:29.516578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.516551 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.626712 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.626676 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.728782 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.728703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.805320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.805290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:29.805467 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.805336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.805467 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.805372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:29.805467 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.805410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.805467 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.805450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:29.807730 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.807710 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 11:36:29.807730 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.807727 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 11:36:29.807903 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.807719 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 11:36:29.807903 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.807892 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/196f824d-bdad-4c7b-b3d7-62522d631e64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-t6v4m\" (UID: \"196f824d-bdad-4c7b-b3d7-62522d631e64\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:29.807969 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.807892 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec71652e-6c9e-4007-a92f-354a25b8bda2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zhhrr\" (UID: \"ec71652e-6c9e-4007-a92f-354a25b8bda2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:29.817912 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.817890 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3861a753-509b-4421-9d6b-157dd144bfd1-metrics-certs\") pod \"network-metrics-daemon-27s5h\" (UID: \"3861a753-509b-4421-9d6b-157dd144bfd1\") " pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:29.817996 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.817922 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1798509-7230-4963-a154-f42bc2f7e21b-original-pull-secret\") pod \"global-pull-secret-syncer-4bcsv\" (UID: \"a1798509-7230-4963-a154-f42bc2f7e21b\") " pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:29.817996 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.817940 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 11:36:29.828790 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.828767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw865\" (UniqueName: \"kubernetes.io/projected/538e4919-e20e-46e3-8453-2702feeac868-kube-api-access-jw865\") pod \"network-check-target-7bkvm\" (UID: \"538e4919-e20e-46e3-8453-2702feeac868\") " pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:29.829273 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.829257 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jmhds\"" Jul 28 11:36:29.834194 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.834132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.838183 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.838170 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27s5h" Jul 28 11:36:29.934835 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.934797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:29.937134 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.937111 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6mch\"" Jul 28 11:36:29.944092 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.944062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bcsv" Jul 28 11:36:29.945124 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.945103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:29.970031 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.969800 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27s5h"] Jul 28 11:36:29.970031 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.969876 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:29.970256 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.970065 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:29.973602 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:29.973544 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3861a753_509b_4421_9d6b_157dd144bfd1.slice/crio-6acd7132ae0eae2d1aa2ea8b8d326fb0169ed6b8eaa1fe1792066c20d376424d WatchSource:0}: Error finding container 6acd7132ae0eae2d1aa2ea8b8d326fb0169ed6b8eaa1fe1792066c20d376424d: Status 404 returned error can't find the container with id 6acd7132ae0eae2d1aa2ea8b8d326fb0169ed6b8eaa1fe1792066c20d376424d Jul 28 11:36:29.977372 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:29.977326 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:30.057185 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.057008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" Jul 28 11:36:30.070450 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.070419 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" Jul 28 11:36:30.104522 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.104438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:30.109068 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.108965 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4bcsv"] Jul 28 11:36:30.114045 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:30.113958 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1798509_7230_4963_a154_f42bc2f7e21b.slice/crio-667db332dba20c99c1c37ce619e7280511f1d25d2abf7b0b84d6d0c0fc7587ec WatchSource:0}: Error finding container 667db332dba20c99c1c37ce619e7280511f1d25d2abf7b0b84d6d0c0fc7587ec: Status 404 returned error can't find the container with id 667db332dba20c99c1c37ce619e7280511f1d25d2abf7b0b84d6d0c0fc7587ec Jul 28 11:36:30.143826 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.142407 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bkvm"] Jul 28 11:36:30.205392 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.205269 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:30.228174 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.224537 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:36:30.241644 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.241618 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.244897 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.244866 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 11:36:30.245083 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245000 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rlfn\"" Jul 28 11:36:30.245403 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245249 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 11:36:30.245403 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245262 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 11:36:30.245558 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245459 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 11:36:30.245815 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 11:36:30.245934 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 11:36:30.245934 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245925 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 11:36:30.246200 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.245746 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 11:36:30.246200 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.246045 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 11:36:30.246200 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.246094 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:36:30.249001 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.248933 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m"] Jul 28 11:36:30.252222 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:30.252200 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196f824d_bdad_4c7b_b3d7_62522d631e64.slice/crio-0dad74bd94bd67cf689eacdc3897129de4aa2c967e5bcdf6ffac4879b4dacd5a WatchSource:0}: Error finding container 0dad74bd94bd67cf689eacdc3897129de4aa2c967e5bcdf6ffac4879b4dacd5a: Status 404 returned error can't find the container with id 0dad74bd94bd67cf689eacdc3897129de4aa2c967e5bcdf6ffac4879b4dacd5a Jul 28 11:36:30.266616 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.266592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr"] Jul 28 11:36:30.270298 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:30.270270 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec71652e_6c9e_4007_a92f_354a25b8bda2.slice/crio-bdfcf67895015a4864ae49aad664f68f4ca44f4bd1ca9b08437c688eef223b53 WatchSource:0}: Error finding container bdfcf67895015a4864ae49aad664f68f4ca44f4bd1ca9b08437c688eef223b53: Status 404 returned error can't find the container with id bdfcf67895015a4864ae49aad664f68f4ca44f4bd1ca9b08437c688eef223b53 Jul 28 11:36:30.316148 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316148 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316148 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrd6w\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-kube-api-access-qrd6w\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316413 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-web-config\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316444 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-out\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316623 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.316715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.316658 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.411706 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.411663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" event={"ID":"ec71652e-6c9e-4007-a92f-354a25b8bda2","Type":"ContainerStarted","Data":"bdfcf67895015a4864ae49aad664f68f4ca44f4bd1ca9b08437c688eef223b53"} Jul 28 11:36:30.413136 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.413098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bkvm" event={"ID":"538e4919-e20e-46e3-8453-2702feeac868","Type":"ContainerStarted","Data":"68677c59b3c85772d3c8a2f346f227a6412b4e09a47de86771d24de8b763679e"} Jul 28 11:36:30.414477 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.414439 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4bcsv" event={"ID":"a1798509-7230-4963-a154-f42bc2f7e21b","Type":"ContainerStarted","Data":"667db332dba20c99c1c37ce619e7280511f1d25d2abf7b0b84d6d0c0fc7587ec"} Jul 28 11:36:30.416295 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.416267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dztz" event={"ID":"e977f255-d8e9-46e0-906c-70505f0610fc","Type":"ContainerStarted","Data":"30c062004f0439d1e0881115bfca7146d215322ef0dfb9971022b4c78c3fff4b"} Jul 28 11:36:30.417076 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417194 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417194 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417194 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417194 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417402 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417402 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417402 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrd6w\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-kube-api-access-qrd6w\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417402 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417299 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-web-config\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417402 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417402 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417683 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-out\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.417683 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.417457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.419212 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.419183 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.420650 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.420379 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.421124 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.421062 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-web-config\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.421276 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.421252 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.422029 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.421978 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.424792 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.424772 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.426427 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.426406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-out\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.426699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.426648 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.426699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.426667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.426822 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.426708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.426822 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.426795 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.426924 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.426896 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.427567 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.427466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" event={"ID":"196f824d-bdad-4c7b-b3d7-62522d631e64","Type":"ContainerStarted","Data":"baa07e9bc03a722b859f097925cb5d5fd5f6af6fa0221f18acc2bc3b22ba0473"} Jul 28 11:36:30.427567 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.427531 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" event={"ID":"196f824d-bdad-4c7b-b3d7-62522d631e64","Type":"ContainerStarted","Data":"0dad74bd94bd67cf689eacdc3897129de4aa2c967e5bcdf6ffac4879b4dacd5a"} Jul 28 11:36:30.429136 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.429109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27s5h" event={"ID":"3861a753-509b-4421-9d6b-157dd144bfd1","Type":"ContainerStarted","Data":"6acd7132ae0eae2d1aa2ea8b8d326fb0169ed6b8eaa1fe1792066c20d376424d"} Jul 28 11:36:30.431698 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.431675 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrd6w\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-kube-api-access-qrd6w\") pod \"alertmanager-main-0\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.434654 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.434633 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:36:30.465945 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.465918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:30.556666 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.556622 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:36:30.723213 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:30.723097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:36:31.228740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.228249 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv"] Jul 28 11:36:31.247177 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.246829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.250258 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.250187 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 11:36:31.252150 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.250436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 11:36:31.252150 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.250715 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 11:36:31.252150 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.250997 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1nhsobspsm5vq\"" Jul 28 11:36:31.252150 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.251707 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv"] Jul 28 11:36:31.252150 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.251842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wxrb4\"" Jul 28 11:36:31.252150 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.251849 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 11:36:31.257699 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.253519 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2948cd7a-a676-4ef5-960c-137f45ca3e88-metrics-client-ca\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6xg\" (UniqueName: \"kubernetes.io/projected/2948cd7a-a676-4ef5-960c-137f45ca3e88-kube-api-access-jq6xg\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-grpc-tls\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-tls\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.329916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.329785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431124 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431124 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-grpc-tls\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431392 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431212 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431392 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-tls\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431392 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431392 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2948cd7a-a676-4ef5-960c-137f45ca3e88-metrics-client-ca\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431392 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6xg\" (UniqueName: \"kubernetes.io/projected/2948cd7a-a676-4ef5-960c-137f45ca3e88-kube-api-access-jq6xg\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.431392 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.431388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.433235 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.433128 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2948cd7a-a676-4ef5-960c-137f45ca3e88-metrics-client-ca\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.434499 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.434468 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.436737 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.436244 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.436737 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.436580 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-tls\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.436737 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.436683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.436959 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.436888 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-grpc-tls\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.437109 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.437057 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2948cd7a-a676-4ef5-960c-137f45ca3e88-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.444871 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.443817 2559 generic.go:356] "Generic (PLEG): container finished" podID="e977f255-d8e9-46e0-906c-70505f0610fc" containerID="828c2f4d6b5478ae9668dd5cc45554da4b5acb8f8d2614f3f3f9fdd23d6e1021" exitCode=0 Jul 28 11:36:31.444871 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.443938 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dztz" event={"ID":"e977f255-d8e9-46e0-906c-70505f0610fc","Type":"ContainerDied","Data":"828c2f4d6b5478ae9668dd5cc45554da4b5acb8f8d2614f3f3f9fdd23d6e1021"} Jul 28 11:36:31.445794 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.445648 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6xg\" (UniqueName: \"kubernetes.io/projected/2948cd7a-a676-4ef5-960c-137f45ca3e88-kube-api-access-jq6xg\") pod \"thanos-querier-84bc9d64fc-cb9nv\" (UID: \"2948cd7a-a676-4ef5-960c-137f45ca3e88\") " pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:31.449431 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.449335 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerStarted","Data":"a69d9ed05203dbe2e2b9b26d53ffdfd9f233afd2db15eaa6205181cdd7e3e227"} Jul 28 11:36:31.455813 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.455751 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" event={"ID":"196f824d-bdad-4c7b-b3d7-62522d631e64","Type":"ContainerStarted","Data":"58c7e694191a9a522398575a28baf8723952da84b31e019de0590cf4942f39e5"} Jul 28 11:36:31.566322 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:31.566272 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:32.124284 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:32.124247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:32.239099 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:32.239057 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:32.613603 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:32.613491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:33.386943 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.386881 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-754bbc95c7-ntkw2"] Jul 28 11:36:33.389481 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.389407 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:33.390032 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.390000 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.393469 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.393442 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 11:36:33.393712 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.393694 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 11:36:33.394179 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.394113 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 11:36:33.394179 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.394147 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rqvtd\"" Jul 28 11:36:33.394554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.393442 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f3v9ne1ddhue7\"" Jul 28 11:36:33.394554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.394228 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 11:36:33.400208 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.400039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-754bbc95c7-ntkw2"] Jul 28 11:36:33.449829 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.449799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70f28518-1cbf-4f2c-adcc-e1aa104bf510-metrics-server-audit-profiles\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.449829 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.449836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5qlt\" (UniqueName: \"kubernetes.io/projected/70f28518-1cbf-4f2c-adcc-e1aa104bf510-kube-api-access-l5qlt\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.450056 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.449860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-secret-metrics-server-client-certs\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.450056 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.449948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70f28518-1cbf-4f2c-adcc-e1aa104bf510-audit-log\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.450056 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.449987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f28518-1cbf-4f2c-adcc-e1aa104bf510-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.450213 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.450103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-secret-metrics-server-tls\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.450213 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.450133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-client-ca-bundle\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.551326 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.551282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f28518-1cbf-4f2c-adcc-e1aa104bf510-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.551531 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.551407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-secret-metrics-server-tls\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.551531 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.551440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-client-ca-bundle\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.551531 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.551476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70f28518-1cbf-4f2c-adcc-e1aa104bf510-metrics-server-audit-profiles\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.551531 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.551498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5qlt\" (UniqueName: \"kubernetes.io/projected/70f28518-1cbf-4f2c-adcc-e1aa104bf510-kube-api-access-l5qlt\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.551531 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.551523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-secret-metrics-server-client-certs\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.551787 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.551567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70f28518-1cbf-4f2c-adcc-e1aa104bf510-audit-log\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.552058 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.552007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70f28518-1cbf-4f2c-adcc-e1aa104bf510-audit-log\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.552208 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.552144 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f28518-1cbf-4f2c-adcc-e1aa104bf510-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.552542 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.552503 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70f28518-1cbf-4f2c-adcc-e1aa104bf510-metrics-server-audit-profiles\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.554494 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.554369 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-secret-metrics-server-client-certs\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.554494 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.554450 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-secret-metrics-server-tls\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.554669 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.554520 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70f28518-1cbf-4f2c-adcc-e1aa104bf510-client-ca-bundle\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.560432 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.560409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5qlt\" (UniqueName: \"kubernetes.io/projected/70f28518-1cbf-4f2c-adcc-e1aa104bf510-kube-api-access-l5qlt\") pod \"metrics-server-754bbc95c7-ntkw2\" (UID: \"70f28518-1cbf-4f2c-adcc-e1aa104bf510\") " pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.638296 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.638189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:33.703315 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.703220 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:33.737547 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.737503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:33.841230 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.841195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:33.898389 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.898245 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k"] Jul 28 11:36:33.901929 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.901900 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:33.904221 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.904189 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 11:36:33.904371 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.904200 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kh5n9\"" Jul 28 11:36:33.912053 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.911989 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k"] Jul 28 11:36:33.944265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.944225 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:33.955527 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.955496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8fb\" (UniqueName: \"kubernetes.io/projected/cc29749f-c6aa-44d3-8271-b9a6ce50e8c0-kube-api-access-mh8fb\") pod \"monitoring-plugin-68b7fc9574-pn67k\" (UID: \"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:33.955665 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:33.955616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc29749f-c6aa-44d3-8271-b9a6ce50e8c0-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-pn67k\" (UID: \"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:34.042356 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:34.042319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:34.056515 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:34.056475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8fb\" (UniqueName: \"kubernetes.io/projected/cc29749f-c6aa-44d3-8271-b9a6ce50e8c0-kube-api-access-mh8fb\") pod \"monitoring-plugin-68b7fc9574-pn67k\" (UID: \"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:34.056709 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:34.056556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc29749f-c6aa-44d3-8271-b9a6ce50e8c0-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-pn67k\" (UID: \"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:34.059512 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:34.059483 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc29749f-c6aa-44d3-8271-b9a6ce50e8c0-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-pn67k\" (UID: \"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:34.065012 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:34.064986 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8fb\" (UniqueName: \"kubernetes.io/projected/cc29749f-c6aa-44d3-8271-b9a6ce50e8c0-kube-api-access-mh8fb\") pod \"monitoring-plugin-68b7fc9574-pn67k\" (UID: \"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:34.214264 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:34.214176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:35.415008 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.414971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:35.421025 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.420996 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:36:35.425653 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.425629 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.429267 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.429240 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 11:36:35.429404 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.429308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fxlmc\"" Jul 28 11:36:35.429586 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.429568 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 11:36:35.429696 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.429680 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 11:36:35.429875 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.429861 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 11:36:35.430360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.430256 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 11:36:35.430882 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.430600 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 11:36:35.430882 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.430673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 11:36:35.432601 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.431611 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3bul0198rceov\"" Jul 28 11:36:35.433446 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.432830 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 11:36:35.433446 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.433110 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 11:36:35.433446 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.433210 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 11:36:35.433446 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.433432 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 11:36:35.433446 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.433436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 11:36:35.433756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.433628 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 11:36:35.441585 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.441556 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 11:36:35.449520 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.449499 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:36:35.550478 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.550280 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:35.569288 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569410 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569590 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569673 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569673 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569673 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9dq\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-kube-api-access-jq9dq\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.569832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.569976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.570037 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.570066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-config\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.570235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.570291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.570320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.570765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.570379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.666744 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.666638 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv"] Jul 28 11:36:35.674921 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.674118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.674894 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676496 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676642 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-config\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676767 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.679054 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.676994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.680740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.677019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.680740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.677044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9dq\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-kube-api-access-jq9dq\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.680740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.677077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.680740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.677104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.680740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.678485 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.680740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.679710 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.680740 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.680458 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.692134 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.681360 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.692134 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.682751 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.692134 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.686501 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.697662 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.697434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9dq\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-kube-api-access-jq9dq\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.697744 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.697676 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.701628 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.701379 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.701978 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:35.701739 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2948cd7a_a676_4ef5_960c_137f45ca3e88.slice/crio-fd86515de8cedb6ef4b08793751f35dade15887490af5f3fb07c212178ce24d0 WatchSource:0}: Error finding container fd86515de8cedb6ef4b08793751f35dade15887490af5f3fb07c212178ce24d0: Status 404 returned error can't find the container with id fd86515de8cedb6ef4b08793751f35dade15887490af5f3fb07c212178ce24d0 Jul 28 11:36:35.714618 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.714170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.716670 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.715441 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.716670 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.715925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.716670 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.716307 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-config\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.716670 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.716633 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.717749 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.717220 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.717749 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.717587 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.717749 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.717713 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.723575 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.723361 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.744641 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.744615 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-754bbc95c7-ntkw2"] Jul 28 11:36:35.756027 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.755791 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:35.772189 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:35.772133 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k"] Jul 28 11:36:36.013790 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.012351 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:36:36.017845 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:36:36.017812 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f63f3f_1704_4986_8844_38994c1aeeb3.slice/crio-509e2cfb32c8d5f0eecf60c20d3a5091659a33d1157432230989903f814e1365 WatchSource:0}: Error finding container 509e2cfb32c8d5f0eecf60c20d3a5091659a33d1157432230989903f814e1365: Status 404 returned error can't find the container with id 509e2cfb32c8d5f0eecf60c20d3a5091659a33d1157432230989903f814e1365 Jul 28 11:36:36.493904 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.493869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" event={"ID":"2948cd7a-a676-4ef5-960c-137f45ca3e88","Type":"ContainerStarted","Data":"fd86515de8cedb6ef4b08793751f35dade15887490af5f3fb07c212178ce24d0"} Jul 28 11:36:36.499602 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.499569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" event={"ID":"ec71652e-6c9e-4007-a92f-354a25b8bda2","Type":"ContainerStarted","Data":"71edd4e3b09811dcfd72d612a8f69c55f2190205754daeb03856afc7f97b0fcc"} Jul 28 11:36:36.499764 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.499647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" event={"ID":"ec71652e-6c9e-4007-a92f-354a25b8bda2","Type":"ContainerStarted","Data":"527479f41406035e039154c6720cb1886f3c287892de96ac17a19e1508bd26e6"} Jul 28 11:36:36.499764 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.499689 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" event={"ID":"ec71652e-6c9e-4007-a92f-354a25b8bda2","Type":"ContainerStarted","Data":"772216a5e6bd25ebf97dadec236d6ffb037d41c106ad4e42205c51a85dff0663"} Jul 28 11:36:36.506916 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.506874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bkvm" event={"ID":"538e4919-e20e-46e3-8453-2702feeac868","Type":"ContainerStarted","Data":"4cfb223f71613dd3f89599509eb6f73985701c4793121f4fcfbc32a56cd3a10c"} Jul 28 11:36:36.507807 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.507776 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:36:36.510847 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.510819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4bcsv" event={"ID":"a1798509-7230-4963-a154-f42bc2f7e21b","Type":"ContainerStarted","Data":"05988e7fd647ae0efcee696ef2710944431af10260c0f1cce0bad4a6e18cb8d4"} Jul 28 11:36:36.515094 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.515066 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dztz" event={"ID":"e977f255-d8e9-46e0-906c-70505f0610fc","Type":"ContainerStarted","Data":"8a0d4185307e90d513031f14e3592f5d828b0762a5805a8941ff9321284569be"} Jul 28 11:36:36.515295 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.515275 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dztz" event={"ID":"e977f255-d8e9-46e0-906c-70505f0610fc","Type":"ContainerStarted","Data":"84c5500b71d97602ceda27bb2b195dd9db2d685c0e1ea36d7c10fcd5ed26c702"} Jul 28 11:36:36.522535 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.518326 2559 generic.go:356] "Generic (PLEG): container finished" podID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerID="847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6" exitCode=0 Jul 28 11:36:36.522535 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.518413 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6"} Jul 28 11:36:36.525200 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.524495 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" exitCode=0 Jul 28 11:36:36.525200 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.524570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a"} Jul 28 11:36:36.525200 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.524630 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerStarted","Data":"509e2cfb32c8d5f0eecf60c20d3a5091659a33d1157432230989903f814e1365"} Jul 28 11:36:36.528515 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.528460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" event={"ID":"70f28518-1cbf-4f2c-adcc-e1aa104bf510","Type":"ContainerStarted","Data":"24851e02cacbe64be7411fabdebcd88dfb235520c00944369cbad5466a6c3a3b"} Jul 28 11:36:36.533312 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.533224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" event={"ID":"196f824d-bdad-4c7b-b3d7-62522d631e64","Type":"ContainerStarted","Data":"31f15305f9303e341cfe342243ab39dce4ec524834fcb5e315fb6f2bb0030a36"} Jul 28 11:36:36.539027 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.538570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27s5h" event={"ID":"3861a753-509b-4421-9d6b-157dd144bfd1","Type":"ContainerStarted","Data":"5ab8a535a8d036c5f183fa65e607aeb936ac9050d760b091bb9c78361fabcdba"} Jul 28 11:36:36.539027 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.538624 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27s5h" event={"ID":"3861a753-509b-4421-9d6b-157dd144bfd1","Type":"ContainerStarted","Data":"0e15e909e40092174c4d5d8ee86d3a3a314144a838f2081e35e981782aff3802"} Jul 28 11:36:36.540369 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.540307 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" event={"ID":"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0","Type":"ContainerStarted","Data":"731a18063f62fa1c1c3fabe730b0793e695e087bea263b62c7d1732b46b0e168"} Jul 28 11:36:36.548564 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.547907 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zhhrr" podStartSLOduration=2.385051042 podStartE2EDuration="7.547888371s" totalImagesPullingTime="5.162837329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:36.522310742 +0000 UTC m=+72.986507884" watchObservedRunningTime="2026-07-28 11:36:36.547888371 +0000 UTC m=+73.012085505" Jul 28 11:36:36.566405 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.566238 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7bkvm" podStartSLOduration=67.227400963 podStartE2EDuration="1m12.566216349s" totalImagesPullingTime="5.338815386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:36.547574681 +0000 UTC m=+73.011771821" watchObservedRunningTime="2026-07-28 11:36:36.566216349 +0000 UTC m=+73.030413489" Jul 28 11:36:36.566751 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.566713 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4bcsv" podStartSLOduration=67.179572326 podStartE2EDuration="1m12.566701861s" totalImagesPullingTime="5.387129535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:36.566641249 +0000 UTC m=+73.030838381" watchObservedRunningTime="2026-07-28 11:36:36.566701861 +0000 UTC m=+73.030899001" Jul 28 11:36:36.587272 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.585983 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6dztz" podStartSLOduration=6.338932186 podStartE2EDuration="7.585969917s" totalImagesPullingTime="1.135824383s" totalInitContainerRuntime="111.213348ms" isStatefulPod=true podCreationTimestamp="2026-07-28 11:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:36.585439241 +0000 UTC m=+73.049636381" watchObservedRunningTime="2026-07-28 11:36:36.585969917 +0000 UTC m=+73.050167059" Jul 28 11:36:36.643803 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.643264 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-t6v4m" podStartSLOduration=2.8146155029999997 podStartE2EDuration="7.643242635s" totalImagesPullingTime="4.828627132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:36.641678592 +0000 UTC m=+73.105875732" watchObservedRunningTime="2026-07-28 11:36:36.643242635 +0000 UTC m=+73.107439777" Jul 28 11:36:36.690458 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.690116 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-27s5h" podStartSLOduration=67.186746057 podStartE2EDuration="1m12.690092531s" totalImagesPullingTime="5.503346474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:36.689368819 +0000 UTC m=+73.153565962" watchObservedRunningTime="2026-07-28 11:36:36.690092531 +0000 UTC m=+73.154289673" Jul 28 11:36:36.790097 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.790020 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:36.858359 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.858319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:36.927208 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:36.927149 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:38.535013 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:38.534965 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:38.535576 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:38.535037 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:38.540424 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:38.540395 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:38.558804 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:38.558779 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:36:38.619297 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:38.619269 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559855db94-szvb4"] Jul 28 11:36:39.247322 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:39.247285 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:39.346128 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:39.346088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:40.138763 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.138734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:40.241970 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.241904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:40.576256 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.576228 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerStarted","Data":"6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720"} Jul 28 11:36:40.576530 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.576508 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerStarted","Data":"731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8"} Jul 28 11:36:40.576668 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.576655 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerStarted","Data":"aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe"} Jul 28 11:36:40.576804 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.576789 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerStarted","Data":"8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38"} Jul 28 11:36:40.580219 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.580194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerStarted","Data":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} Jul 28 11:36:40.580502 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.580484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerStarted","Data":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} Jul 28 11:36:40.581074 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.581050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerStarted","Data":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} Jul 28 11:36:40.581232 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.581103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerStarted","Data":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} Jul 28 11:36:40.582744 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.582721 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" event={"ID":"70f28518-1cbf-4f2c-adcc-e1aa104bf510","Type":"ContainerStarted","Data":"0437889c2936463bba2f1589514c86c8abe22f9a1613e5399bc83b0d6bb35f86"} Jul 28 11:36:40.585427 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.585268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" event={"ID":"cc29749f-c6aa-44d3-8271-b9a6ce50e8c0","Type":"ContainerStarted","Data":"ba1129c37ffbe55c89891bd0f6ee1e4eba6f2022752acae98a3c0be97817e4c9"} Jul 28 11:36:40.585720 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.585539 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:40.588846 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.588814 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" event={"ID":"2948cd7a-a676-4ef5-960c-137f45ca3e88","Type":"ContainerStarted","Data":"eaa548d43936ed586857b228f253ac7d9825fa686b2a43abd2bf7501b470aa39"} Jul 28 11:36:40.588935 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.588897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" event={"ID":"2948cd7a-a676-4ef5-960c-137f45ca3e88","Type":"ContainerStarted","Data":"62bfe2d0f3430675e43b0aca9265ed0a2350c0e9e16074aa11a7de0526ee9e8a"} Jul 28 11:36:40.589002 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.588942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" event={"ID":"2948cd7a-a676-4ef5-960c-137f45ca3e88","Type":"ContainerStarted","Data":"6c63a2f8657ea56732edeffa28d88938ddafc27b040756d7c737bd7b91f16179"} Jul 28 11:36:40.593308 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.593286 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" Jul 28 11:36:40.604458 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.603532 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" podStartSLOduration=3.264732231 podStartE2EDuration="7.603510669s" totalImagesPullingTime="4.338778438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:40.60073797 +0000 UTC m=+77.064935106" watchObservedRunningTime="2026-07-28 11:36:40.603510669 +0000 UTC m=+77.067707810" Jul 28 11:36:40.619844 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:40.619251 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-pn67k" podStartSLOduration=3.33995066 podStartE2EDuration="7.61922797s" totalImagesPullingTime="4.27927731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:40.617469585 +0000 UTC m=+77.081666735" watchObservedRunningTime="2026-07-28 11:36:40.61922797 +0000 UTC m=+77.083425110" Jul 28 11:36:41.176837 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.176806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:41.276925 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.276866 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:41.596407 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.596365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" event={"ID":"2948cd7a-a676-4ef5-960c-137f45ca3e88","Type":"ContainerStarted","Data":"e319a4be9f542736bf26a64409d07aabcd2fda184dc44d0f609f3f458392cf90"} Jul 28 11:36:41.596577 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.596449 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" event={"ID":"2948cd7a-a676-4ef5-960c-137f45ca3e88","Type":"ContainerStarted","Data":"02eabf053e972c7b828e780624465fa392009033f3666d504c5cb953607a0b2b"} Jul 28 11:36:41.596577 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.596489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" event={"ID":"2948cd7a-a676-4ef5-960c-137f45ca3e88","Type":"ContainerStarted","Data":"0026be45b550d6366a2e8e5d98fb3d578c1270b08a5c21e784c8a3bccb18e0f2"} Jul 28 11:36:41.596577 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.596529 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:41.599686 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.599659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerStarted","Data":"dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de"} Jul 28 11:36:41.599801 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.599778 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerStarted","Data":"c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557"} Jul 28 11:36:41.602982 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.602957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerStarted","Data":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} Jul 28 11:36:41.603073 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.603013 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerStarted","Data":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} Jul 28 11:36:41.620669 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.620623 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" podStartSLOduration=5.436305831 podStartE2EDuration="10.620607989s" totalImagesPullingTime="5.184302158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:41.619232203 +0000 UTC m=+78.083429343" watchObservedRunningTime="2026-07-28 11:36:41.620607989 +0000 UTC m=+78.084805128" Jul 28 11:36:41.646131 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.646079 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.673099324 podStartE2EDuration="11.646062077s" totalImagesPullingTime="8.945114439s" totalInitContainerRuntime="27.848314ms" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:41.645184231 +0000 UTC m=+78.109381368" watchObservedRunningTime="2026-07-28 11:36:41.646062077 +0000 UTC m=+78.110259460" Jul 28 11:36:41.675216 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:41.675125 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.070255375 podStartE2EDuration="6.675108694s" totalImagesPullingTime="3.581919202s" totalInitContainerRuntime="22.934117ms" isStatefulPod=false podCreationTimestamp="2026-07-28 11:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:36:41.673043156 +0000 UTC m=+78.137240299" watchObservedRunningTime="2026-07-28 11:36:41.675108694 +0000 UTC m=+78.139305832" Jul 28 11:36:42.195881 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:42.195853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:45.757257 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:45.757126 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:36:47.613207 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:47.613177 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84bc9d64fc-cb9nv" Jul 28 11:36:48.097502 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:48.097462 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:48.197325 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:48.197289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:48.299072 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:48.299038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:50.311088 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:50.311032 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d78fc447c-qwjv9"] Jul 28 11:36:50.445289 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:50.445234 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:50.546760 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:50.546725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:50.612416 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:50.612311 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:53.704345 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:53.704307 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:53.704766 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:53.704400 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:36:56.183289 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:56.183258 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:36:56.284721 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:36:56.284688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:03.645597 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:03.645553 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559855db94-szvb4" podUID="0d9fdb11-b416-4ac1-a497-9e146ad1235c" containerName="console" containerID="cri-o://debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398" gracePeriod=15 Jul 28 11:37:04.418323 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.418295 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:37:04.439313 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.439279 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:04.439454 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.439410 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-oauth-config\") pod \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " Jul 28 11:37:04.439511 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.439451 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9nth\" (UniqueName: \"kubernetes.io/projected/0d9fdb11-b416-4ac1-a497-9e146ad1235c-kube-api-access-r9nth\") pod \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " Jul 28 11:37:04.439511 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.439483 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-oauth-serving-cert\") pod \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " Jul 28 11:37:04.439603 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.439567 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-serving-cert\") pod \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " Jul 28 11:37:04.439651 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.439612 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-service-ca\") pod \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " Jul 28 11:37:04.439651 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.439640 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-config\") pod \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\" (UID: \"0d9fdb11-b416-4ac1-a497-9e146ad1235c\") " Jul 28 11:37:04.440197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.440137 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d9fdb11-b416-4ac1-a497-9e146ad1235c" (UID: "0d9fdb11-b416-4ac1-a497-9e146ad1235c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:04.440343 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.440226 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-config" (OuterVolumeSpecName: "console-config") pod "0d9fdb11-b416-4ac1-a497-9e146ad1235c" (UID: "0d9fdb11-b416-4ac1-a497-9e146ad1235c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:04.440409 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.440336 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d9fdb11-b416-4ac1-a497-9e146ad1235c" (UID: "0d9fdb11-b416-4ac1-a497-9e146ad1235c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:04.442176 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.442122 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d9fdb11-b416-4ac1-a497-9e146ad1235c" (UID: "0d9fdb11-b416-4ac1-a497-9e146ad1235c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:04.442290 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.442124 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9fdb11-b416-4ac1-a497-9e146ad1235c-kube-api-access-r9nth" (OuterVolumeSpecName: "kube-api-access-r9nth") pod "0d9fdb11-b416-4ac1-a497-9e146ad1235c" (UID: "0d9fdb11-b416-4ac1-a497-9e146ad1235c"). InnerVolumeSpecName "kube-api-access-r9nth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:37:04.442290 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.442217 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d9fdb11-b416-4ac1-a497-9e146ad1235c" (UID: "0d9fdb11-b416-4ac1-a497-9e146ad1235c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:04.540011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.539975 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:04.541138 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.541118 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-serving-cert\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:04.541252 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.541141 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-service-ca\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:04.541252 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.541175 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:04.541252 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.541183 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d9fdb11-b416-4ac1-a497-9e146ad1235c-console-oauth-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:04.541252 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.541192 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9nth\" (UniqueName: \"kubernetes.io/projected/0d9fdb11-b416-4ac1-a497-9e146ad1235c-kube-api-access-r9nth\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:04.541252 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.541201 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d9fdb11-b416-4ac1-a497-9e146ad1235c-oauth-serving-cert\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:04.641477 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.641391 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:04.702340 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.702305 2559 generic.go:356] "Generic (PLEG): container finished" podID="0d9fdb11-b416-4ac1-a497-9e146ad1235c" containerID="debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398" exitCode=0 Jul 28 11:37:04.702739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.702353 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559855db94-szvb4" Jul 28 11:37:04.702739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.702393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559855db94-szvb4" event={"ID":"0d9fdb11-b416-4ac1-a497-9e146ad1235c","Type":"ContainerDied","Data":"debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398"} Jul 28 11:37:04.702739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.702444 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559855db94-szvb4" event={"ID":"0d9fdb11-b416-4ac1-a497-9e146ad1235c","Type":"ContainerDied","Data":"869a53ccc58824ddbc789ed7f1b7699930fcda30e6bfa5d5c68cd9cb4e95e0c5"} Jul 28 11:37:04.702739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.702473 2559 scope.go:117] "RemoveContainer" containerID="debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398" Jul 28 11:37:04.711316 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.711300 2559 scope.go:117] "RemoveContainer" containerID="debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398" Jul 28 11:37:04.711593 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:04.711572 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398\": container with ID starting with debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398 not found: ID does not exist" containerID="debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398" Jul 28 11:37:04.711642 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.711602 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398"} err="failed to get container status \"debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398\": rpc error: code = NotFound desc = could not find container \"debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398\": container with ID starting with debcf74cfc0bfb5909f81837a214e8721d3f4db31c8401a58122321cc5400398 not found: ID does not exist" Jul 28 11:37:04.730652 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.730624 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559855db94-szvb4"] Jul 28 11:37:04.735011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:04.734985 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559855db94-szvb4"] Jul 28 11:37:06.124816 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:06.124785 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9fdb11-b416-4ac1-a497-9e146ad1235c" path="/var/lib/kubelet/pods/0d9fdb11-b416-4ac1-a497-9e146ad1235c/volumes" Jul 28 11:37:08.555750 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:08.555709 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7bkvm" Jul 28 11:37:08.884172 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:08.884063 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:08.968350 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:08.968320 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:13.709063 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:13.709032 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:37:13.713011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:13.712985 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-754bbc95c7-ntkw2" Jul 28 11:37:15.338960 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.338911 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d78fc447c-qwjv9" podUID="123ed147-7e82-4ac3-9c71-b35d4aee695d" containerName="console" containerID="cri-o://27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7" gracePeriod=15 Jul 28 11:37:15.595762 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.595692 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:37:15.638878 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.638849 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-trusted-ca-bundle\") pod \"123ed147-7e82-4ac3-9c71-b35d4aee695d\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " Jul 28 11:37:15.639062 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.638893 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-config\") pod \"123ed147-7e82-4ac3-9c71-b35d4aee695d\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " Jul 28 11:37:15.639062 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.638984 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-oauth-serving-cert\") pod \"123ed147-7e82-4ac3-9c71-b35d4aee695d\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " Jul 28 11:37:15.639062 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639011 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-927r5\" (UniqueName: \"kubernetes.io/projected/123ed147-7e82-4ac3-9c71-b35d4aee695d-kube-api-access-927r5\") pod \"123ed147-7e82-4ac3-9c71-b35d4aee695d\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " Jul 28 11:37:15.639062 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639047 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-serving-cert\") pod \"123ed147-7e82-4ac3-9c71-b35d4aee695d\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " Jul 28 11:37:15.639307 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639074 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-oauth-config\") pod \"123ed147-7e82-4ac3-9c71-b35d4aee695d\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " Jul 28 11:37:15.639307 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639119 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-service-ca\") pod \"123ed147-7e82-4ac3-9c71-b35d4aee695d\" (UID: \"123ed147-7e82-4ac3-9c71-b35d4aee695d\") " Jul 28 11:37:15.639407 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639375 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-config" (OuterVolumeSpecName: "console-config") pod "123ed147-7e82-4ac3-9c71-b35d4aee695d" (UID: "123ed147-7e82-4ac3-9c71-b35d4aee695d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:15.639453 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639418 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "123ed147-7e82-4ac3-9c71-b35d4aee695d" (UID: "123ed147-7e82-4ac3-9c71-b35d4aee695d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:15.639485 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639435 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "123ed147-7e82-4ac3-9c71-b35d4aee695d" (UID: "123ed147-7e82-4ac3-9c71-b35d4aee695d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:15.639754 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.639711 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-service-ca" (OuterVolumeSpecName: "service-ca") pod "123ed147-7e82-4ac3-9c71-b35d4aee695d" (UID: "123ed147-7e82-4ac3-9c71-b35d4aee695d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:15.641488 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.641447 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "123ed147-7e82-4ac3-9c71-b35d4aee695d" (UID: "123ed147-7e82-4ac3-9c71-b35d4aee695d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:15.641766 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.641746 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "123ed147-7e82-4ac3-9c71-b35d4aee695d" (UID: "123ed147-7e82-4ac3-9c71-b35d4aee695d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:15.641847 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.641793 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123ed147-7e82-4ac3-9c71-b35d4aee695d-kube-api-access-927r5" (OuterVolumeSpecName: "kube-api-access-927r5") pod "123ed147-7e82-4ac3-9c71-b35d4aee695d" (UID: "123ed147-7e82-4ac3-9c71-b35d4aee695d"). InnerVolumeSpecName "kube-api-access-927r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:37:15.739945 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.739910 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-trusted-ca-bundle\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:15.739945 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.739941 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:15.739945 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.739953 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-oauth-serving-cert\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:15.740277 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.739961 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-927r5\" (UniqueName: \"kubernetes.io/projected/123ed147-7e82-4ac3-9c71-b35d4aee695d-kube-api-access-927r5\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:15.740277 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.739970 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-serving-cert\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:15.740277 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.739978 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/123ed147-7e82-4ac3-9c71-b35d4aee695d-console-oauth-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:15.740277 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.739986 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/123ed147-7e82-4ac3-9c71-b35d4aee695d-service-ca\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:15.752562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.752532 2559 generic.go:356] "Generic (PLEG): container finished" podID="123ed147-7e82-4ac3-9c71-b35d4aee695d" containerID="27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7" exitCode=0 Jul 28 11:37:15.752725 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.752573 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d78fc447c-qwjv9" Jul 28 11:37:15.752725 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.752607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78fc447c-qwjv9" event={"ID":"123ed147-7e82-4ac3-9c71-b35d4aee695d","Type":"ContainerDied","Data":"27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7"} Jul 28 11:37:15.752725 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.752656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d78fc447c-qwjv9" event={"ID":"123ed147-7e82-4ac3-9c71-b35d4aee695d","Type":"ContainerDied","Data":"41806a1251d81505edfbc515e812aea8e5d5753b85982bc3e5464589340c1c5f"} Jul 28 11:37:15.752725 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.752678 2559 scope.go:117] "RemoveContainer" containerID="27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7" Jul 28 11:37:15.761890 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.761865 2559 scope.go:117] "RemoveContainer" containerID="27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7" Jul 28 11:37:15.762203 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:15.762180 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7\": container with ID starting with 27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7 not found: ID does not exist" containerID="27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7" Jul 28 11:37:15.762284 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.762217 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7"} err="failed to get container status \"27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7\": rpc error: code = NotFound desc = could not find container \"27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7\": container with ID starting with 27b33d7673818e637c43ab98c2e6677994d36eee59029b9bc056f3ac035337f7 not found: ID does not exist" Jul 28 11:37:15.774593 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.774565 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d78fc447c-qwjv9"] Jul 28 11:37:15.775903 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:15.775873 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d78fc447c-qwjv9"] Jul 28 11:37:16.124296 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:16.124266 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="123ed147-7e82-4ac3-9c71-b35d4aee695d" path="/var/lib/kubelet/pods/123ed147-7e82-4ac3-9c71-b35d4aee695d/volumes" Jul 28 11:37:35.757066 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:35.757021 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:35.776586 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:35.776558 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:35.858741 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:35.858710 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:48.418885 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:48.418852 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:48.620062 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:48.620025 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:37:49.507724 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.507686 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:37:49.508126 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.508018 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="alertmanager" containerID="cri-o://8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38" gracePeriod=120 Jul 28 11:37:49.508126 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.508086 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-metric" containerID="cri-o://c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557" gracePeriod=120 Jul 28 11:37:49.508126 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.508113 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="prom-label-proxy" containerID="cri-o://dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de" gracePeriod=120 Jul 28 11:37:49.508329 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.508120 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="config-reloader" containerID="cri-o://aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe" gracePeriod=120 Jul 28 11:37:49.508329 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.508195 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy" containerID="cri-o://6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720" gracePeriod=120 Jul 28 11:37:49.508329 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.508081 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-web" containerID="cri-o://731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8" gracePeriod=120 Jul 28 11:37:49.898756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898657 2559 generic.go:356] "Generic (PLEG): container finished" podID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerID="dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de" exitCode=0 Jul 28 11:37:49.898756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898684 2559 generic.go:356] "Generic (PLEG): container finished" podID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerID="c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557" exitCode=0 Jul 28 11:37:49.898756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898693 2559 generic.go:356] "Generic (PLEG): container finished" podID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerID="6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720" exitCode=0 Jul 28 11:37:49.898756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898700 2559 generic.go:356] "Generic (PLEG): container finished" podID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerID="aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe" exitCode=0 Jul 28 11:37:49.898756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898707 2559 generic.go:356] "Generic (PLEG): container finished" podID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerID="8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38" exitCode=0 Jul 28 11:37:49.898756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de"} Jul 28 11:37:49.899055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898818 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557"} Jul 28 11:37:49.899055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720"} Jul 28 11:37:49.899055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe"} Jul 28 11:37:49.899055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:49.898901 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38"} Jul 28 11:37:50.757623 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.757597 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:50.863000 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.862924 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-web\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863000 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.862982 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-volume\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863015 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-metrics-client-ca\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863043 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863094 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-main-tls\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863149 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-trusted-ca-bundle\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863193 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-cluster-tls-config\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863254 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863230 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-main-db\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863560 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863262 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863560 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863298 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-tls-assets\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863560 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863322 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-web-config\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863560 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863344 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-out\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863560 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863378 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrd6w\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-kube-api-access-qrd6w\") pod \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\" (UID: \"c2dda13d-295a-41af-8ebd-5f0a9f6c482b\") " Jul 28 11:37:50.863560 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863441 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:50.863850 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863666 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-metrics-client-ca\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.863906 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.863844 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:50.864238 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.864185 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 11:37:50.866022 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.865982 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:50.866954 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.866927 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-volume" (OuterVolumeSpecName: "config-volume") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:50.866954 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.866944 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-kube-api-access-qrd6w" (OuterVolumeSpecName: "kube-api-access-qrd6w") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "kube-api-access-qrd6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:37:50.867335 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.867305 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:50.867438 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.867412 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:37:50.867495 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.867437 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:50.867495 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.867472 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-out" (OuterVolumeSpecName: "config-out") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 11:37:50.867589 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.867570 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:50.870999 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.870980 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:50.878687 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.878662 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-web-config" (OuterVolumeSpecName: "web-config") pod "c2dda13d-295a-41af-8ebd-5f0a9f6c482b" (UID: "c2dda13d-295a-41af-8ebd-5f0a9f6c482b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:50.905684 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.905650 2559 generic.go:356] "Generic (PLEG): container finished" podID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerID="731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8" exitCode=0 Jul 28 11:37:50.905832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.905726 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:50.905832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.905741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8"} Jul 28 11:37:50.905832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.905810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2dda13d-295a-41af-8ebd-5f0a9f6c482b","Type":"ContainerDied","Data":"a69d9ed05203dbe2e2b9b26d53ffdfd9f233afd2db15eaa6205181cdd7e3e227"} Jul 28 11:37:50.905954 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.905846 2559 scope.go:117] "RemoveContainer" containerID="dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de" Jul 28 11:37:50.913802 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.913782 2559 scope.go:117] "RemoveContainer" containerID="c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557" Jul 28 11:37:50.920679 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.920658 2559 scope.go:117] "RemoveContainer" containerID="6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720" Jul 28 11:37:50.927055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.927038 2559 scope.go:117] "RemoveContainer" containerID="731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8" Jul 28 11:37:50.930340 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.930315 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:37:50.934590 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.934567 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:37:50.935984 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.935964 2559 scope.go:117] "RemoveContainer" containerID="aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe" Jul 28 11:37:50.943440 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.943421 2559 scope.go:117] "RemoveContainer" containerID="8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38" Jul 28 11:37:50.950553 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.950536 2559 scope.go:117] "RemoveContainer" containerID="847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6" Jul 28 11:37:50.957797 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.957777 2559 scope.go:117] "RemoveContainer" containerID="dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de" Jul 28 11:37:50.958052 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:50.958028 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de\": container with ID starting with dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de not found: ID does not exist" containerID="dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de" Jul 28 11:37:50.958139 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958060 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de"} err="failed to get container status \"dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de\": rpc error: code = NotFound desc = could not find container \"dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de\": container with ID starting with dc9e43c929afce451fe0984bc2430c3f7a86e99231984af31e5b2d075b68c0de not found: ID does not exist" Jul 28 11:37:50.958139 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958080 2559 scope.go:117] "RemoveContainer" containerID="c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557" Jul 28 11:37:50.958376 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:50.958356 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557\": container with ID starting with c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557 not found: ID does not exist" containerID="c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557" Jul 28 11:37:50.958458 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958387 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557"} err="failed to get container status \"c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557\": rpc error: code = NotFound desc = could not find container \"c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557\": container with ID starting with c5e2a1cdff7bb29fe1f7ebe3c240ddb9a37cbd0b1e19917a0961af6271040557 not found: ID does not exist" Jul 28 11:37:50.958458 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958411 2559 scope.go:117] "RemoveContainer" containerID="6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720" Jul 28 11:37:50.958656 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:50.958640 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720\": container with ID starting with 6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720 not found: ID does not exist" containerID="6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720" Jul 28 11:37:50.958717 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958662 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720"} err="failed to get container status \"6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720\": rpc error: code = NotFound desc = could not find container \"6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720\": container with ID starting with 6d16da3ac69a9599502c7a0221b62f78c4a5b7958ea3b969c0a32fdbd932a720 not found: ID does not exist" Jul 28 11:37:50.958717 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958681 2559 scope.go:117] "RemoveContainer" containerID="731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8" Jul 28 11:37:50.958907 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:50.958889 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8\": container with ID starting with 731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8 not found: ID does not exist" containerID="731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8" Jul 28 11:37:50.958947 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958913 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8"} err="failed to get container status \"731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8\": rpc error: code = NotFound desc = could not find container \"731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8\": container with ID starting with 731a896eb07af00f77577cb5c8e34a1b2c25eaee79dd6086cad1a13d14a920c8 not found: ID does not exist" Jul 28 11:37:50.958947 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.958927 2559 scope.go:117] "RemoveContainer" containerID="aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe" Jul 28 11:37:50.959134 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:50.959118 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe\": container with ID starting with aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe not found: ID does not exist" containerID="aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe" Jul 28 11:37:50.959229 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.959141 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe"} err="failed to get container status \"aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe\": rpc error: code = NotFound desc = could not find container \"aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe\": container with ID starting with aa4d6dc0e2797f5ee5493ad4475195a2394d24da8ced667fd5b3a0076f9399fe not found: ID does not exist" Jul 28 11:37:50.959229 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.959185 2559 scope.go:117] "RemoveContainer" containerID="8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38" Jul 28 11:37:50.959396 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:50.959381 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38\": container with ID starting with 8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38 not found: ID does not exist" containerID="8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38" Jul 28 11:37:50.959456 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.959402 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38"} err="failed to get container status \"8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38\": rpc error: code = NotFound desc = could not find container \"8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38\": container with ID starting with 8221daf82d8fb6a2a5b4ca628434ce5c478ed8a9b09aaa10a415b0bcb2f6cf38 not found: ID does not exist" Jul 28 11:37:50.959456 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.959420 2559 scope.go:117] "RemoveContainer" containerID="847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6" Jul 28 11:37:50.959643 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:50.959626 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6\": container with ID starting with 847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6 not found: ID does not exist" containerID="847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6" Jul 28 11:37:50.959685 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.959649 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6"} err="failed to get container status \"847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6\": rpc error: code = NotFound desc = could not find container \"847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6\": container with ID starting with 847d48b61b22b452d7f587fe851f2989bdc2c28adf16c9646a3935f36774a2a6 not found: ID does not exist" Jul 28 11:37:50.964229 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964211 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-main-db\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964232 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964244 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-tls-assets\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964252 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-web-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964260 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-out\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964268 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrd6w\" (UniqueName: \"kubernetes.io/projected/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-kube-api-access-qrd6w\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964277 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964286 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-config-volume\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964295 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964305 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-secret-alertmanager-main-tls\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964317 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.964637 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.964331 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2dda13d-295a-41af-8ebd-5f0a9f6c482b-cluster-tls-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:50.965404 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965388 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:37:50.965675 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965664 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="alertmanager" Jul 28 11:37:50.965713 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965677 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="alertmanager" Jul 28 11:37:50.965713 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965685 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9fdb11-b416-4ac1-a497-9e146ad1235c" containerName="console" Jul 28 11:37:50.965713 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965691 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9fdb11-b416-4ac1-a497-9e146ad1235c" containerName="console" Jul 28 11:37:50.965713 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965704 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="init-config-reloader" Jul 28 11:37:50.965713 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965709 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="init-config-reloader" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965719 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-web" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965724 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-web" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965734 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-metric" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965739 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-metric" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965747 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="123ed147-7e82-4ac3-9c71-b35d4aee695d" containerName="console" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965751 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="123ed147-7e82-4ac3-9c71-b35d4aee695d" containerName="console" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965759 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="prom-label-proxy" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965763 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="prom-label-proxy" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965770 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="config-reloader" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965775 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="config-reloader" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965781 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965786 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965834 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9fdb11-b416-4ac1-a497-9e146ad1235c" containerName="console" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965845 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965853 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-metric" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965861 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="config-reloader" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965870 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="kube-rbac-proxy-web" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965878 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="alertmanager" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965887 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="123ed147-7e82-4ac3-9c71-b35d4aee695d" containerName="console" Jul 28 11:37:50.965937 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.965894 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" containerName="prom-label-proxy" Jul 28 11:37:50.969186 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.969150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:50.972197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.971656 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 11:37:50.972197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.971763 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 11:37:50.972197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.971875 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 11:37:50.972197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.972036 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 11:37:50.972197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.972077 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 11:37:50.972476 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.972231 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 11:37:50.972524 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.972504 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rlfn\"" Jul 28 11:37:50.972579 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.972532 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 11:37:50.972646 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.972621 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 11:37:50.977291 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.977273 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 11:37:50.983430 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:50.983408 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:37:51.065412 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c09dd0e-c23c-4266-9900-5c4f26b046ff-config-out\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065412 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c09dd0e-c23c-4266-9900-5c4f26b046ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065619 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065619 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065516 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065619 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c09dd0e-c23c-4266-9900-5c4f26b046ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065619 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065619 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065776 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c09dd0e-c23c-4266-9900-5c4f26b046ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065776 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065776 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c09dd0e-c23c-4266-9900-5c4f26b046ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065776 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-web-config\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065776 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.065921 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.065779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nx25\" (UniqueName: \"kubernetes.io/projected/6c09dd0e-c23c-4266-9900-5c4f26b046ff-kube-api-access-6nx25\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.166872 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.166780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c09dd0e-c23c-4266-9900-5c4f26b046ff-config-out\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.166872 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.166829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c09dd0e-c23c-4266-9900-5c4f26b046ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.166872 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.166851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167039 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.166973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167039 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c09dd0e-c23c-4266-9900-5c4f26b046ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167135 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167135 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167135 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c09dd0e-c23c-4266-9900-5c4f26b046ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167346 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167346 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c09dd0e-c23c-4266-9900-5c4f26b046ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167346 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-web-config\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167346 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167352 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c09dd0e-c23c-4266-9900-5c4f26b046ff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.167543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.167370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nx25\" (UniqueName: \"kubernetes.io/projected/6c09dd0e-c23c-4266-9900-5c4f26b046ff-kube-api-access-6nx25\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.168104 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.168073 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c09dd0e-c23c-4266-9900-5c4f26b046ff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.168350 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.168328 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c09dd0e-c23c-4266-9900-5c4f26b046ff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.169994 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.169861 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c09dd0e-c23c-4266-9900-5c4f26b046ff-config-out\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.169994 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.169977 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.170175 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.170011 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.170175 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.170118 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.170175 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.170121 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.170326 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.170260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-web-config\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.170667 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.170644 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c09dd0e-c23c-4266-9900-5c4f26b046ff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.170835 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.170816 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.171965 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.171946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c09dd0e-c23c-4266-9900-5c4f26b046ff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.175358 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.175342 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nx25\" (UniqueName: \"kubernetes.io/projected/6c09dd0e-c23c-4266-9900-5c4f26b046ff-kube-api-access-6nx25\") pod \"alertmanager-main-0\" (UID: \"6c09dd0e-c23c-4266-9900-5c4f26b046ff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.279554 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.279522 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 11:37:51.415656 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.415625 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 11:37:51.418034 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:37:51.417984 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c09dd0e_c23c_4266_9900_5c4f26b046ff.slice/crio-8b1cf684fc0866984e3264dbabf412e7452ca3abd55842dca673a1c0af4bb81c WatchSource:0}: Error finding container 8b1cf684fc0866984e3264dbabf412e7452ca3abd55842dca673a1c0af4bb81c: Status 404 returned error can't find the container with id 8b1cf684fc0866984e3264dbabf412e7452ca3abd55842dca673a1c0af4bb81c Jul 28 11:37:51.912129 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.912095 2559 generic.go:356] "Generic (PLEG): container finished" podID="6c09dd0e-c23c-4266-9900-5c4f26b046ff" containerID="fcd677423555440de554e6a84de805979e41791db664ae52a4718fc8b406ca8c" exitCode=0 Jul 28 11:37:51.912509 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.912146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerDied","Data":"fcd677423555440de554e6a84de805979e41791db664ae52a4718fc8b406ca8c"} Jul 28 11:37:51.912509 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:51.912222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerStarted","Data":"8b1cf684fc0866984e3264dbabf412e7452ca3abd55842dca673a1c0af4bb81c"} Jul 28 11:37:52.124640 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.124611 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2dda13d-295a-41af-8ebd-5f0a9f6c482b" path="/var/lib/kubelet/pods/c2dda13d-295a-41af-8ebd-5f0a9f6c482b/volumes" Jul 28 11:37:52.918956 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.918915 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerStarted","Data":"9cb6016257693d426182c49e08d7272b751cba0f002c065ba11347c585738043"} Jul 28 11:37:52.919360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.918984 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerStarted","Data":"878bf8e17b66b3d3b2d0297e92eab8ea072d768e9b74267dffe39a7ac98ffc43"} Jul 28 11:37:52.919360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.919011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerStarted","Data":"1ce1a4189e0a65a7fc41b023da269f56fe41f1d0da3a246376868a7fbba250b5"} Jul 28 11:37:52.919360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.919044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerStarted","Data":"91c96921fe4f48bdd18d7402c8aaace4501182ecd916d8a9b375d1845d919cce"} Jul 28 11:37:52.919360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.919070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerStarted","Data":"f152bcec3eb807da1731945cc3eef09169680c69dce79124ddc60c1adad1078f"} Jul 28 11:37:52.919360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.919103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c09dd0e-c23c-4266-9900-5c4f26b046ff","Type":"ContainerStarted","Data":"bb891a82c07185b3bc2df47b5ae38c10b77556f9e99a6d5e484f4c36b37b348e"} Jul 28 11:37:52.951837 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:52.951777 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9362540839999998 podStartE2EDuration="2.951759333s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.505249ms" isStatefulPod=false podCreationTimestamp="2026-07-28 11:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:37:52.948757143 +0000 UTC m=+149.412954285" watchObservedRunningTime="2026-07-28 11:37:52.951759333 +0000 UTC m=+149.415956472" Jul 28 11:37:53.836334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:53.836300 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:37:53.836734 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:53.836645 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy" containerID="cri-o://d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" gracePeriod=600 Jul 28 11:37:53.836734 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:53.836674 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="config-reloader" containerID="cri-o://6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" gracePeriod=600 Jul 28 11:37:53.836734 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:53.836704 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-web" containerID="cri-o://ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" gracePeriod=600 Jul 28 11:37:53.836734 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:53.836714 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="thanos-sidecar" containerID="cri-o://065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" gracePeriod=600 Jul 28 11:37:53.836970 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:53.836650 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="prometheus" containerID="cri-o://6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" gracePeriod=600 Jul 28 11:37:53.836970 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:53.836698 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" gracePeriod=600 Jul 28 11:37:54.099016 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.098990 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:54.196980 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.196946 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-kubelet-serving-ca-bundle\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.196980 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.196987 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-kube-rbac-proxy\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197022 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197040 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-tls-assets\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197076 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq9dq\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-kube-api-access-jq9dq\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197099 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-db\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197127 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-thanos-prometheus-http-client-file\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197167 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-metrics-client-certs\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197208 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-2\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197232 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-serving-certs-ca-bundle\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197265 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197271 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-config-out\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197706 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197306 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-tls\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197706 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197333 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-grpc-tls\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.197706 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197476 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:54.197706 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.197667 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198265 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198275 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198330 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-config\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198366 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-web-config\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198391 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198430 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-trusted-ca-bundle\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198465 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-0\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198490 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-1\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.198520 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-metrics-client-ca\") pod \"b2f63f3f-1704-4986-8844-38994c1aeeb3\" (UID: \"b2f63f3f-1704-4986-8844-38994c1aeeb3\") " Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199088 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199110 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-db\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199128 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199143 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199246 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:54.199674 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199495 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:54.200611 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199693 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:54.200611 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.199808 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.200611 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.200214 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.200779 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.200698 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:37:54.200835 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.200785 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.201001 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.200970 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 11:37:54.201685 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.201659 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.201810 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.201774 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.201880 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.201844 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.201946 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.201928 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-config" (OuterVolumeSpecName: "config") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.201986 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.201967 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.202860 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.202836 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-config-out" (OuterVolumeSpecName: "config-out") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 11:37:54.203306 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.203278 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-kube-api-access-jq9dq" (OuterVolumeSpecName: "kube-api-access-jq9dq") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "kube-api-access-jq9dq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:37:54.212959 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.212932 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-web-config" (OuterVolumeSpecName: "web-config") pod "b2f63f3f-1704-4986-8844-38994c1aeeb3" (UID: "b2f63f3f-1704-4986-8844-38994c1aeeb3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 11:37:54.299938 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299903 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.299938 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299931 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-grpc-tls\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.299938 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299943 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299952 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-web-config\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299961 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299970 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299979 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299988 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.299996 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f63f3f-1704-4986-8844-38994c1aeeb3-configmap-metrics-client-ca\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.300004 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-kube-rbac-proxy\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.300012 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.300022 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-tls-assets\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.300030 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq9dq\" (UniqueName: \"kubernetes.io/projected/b2f63f3f-1704-4986-8844-38994c1aeeb3-kube-api-access-jq9dq\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.300038 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.300048 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2f63f3f-1704-4986-8844-38994c1aeeb3-secret-metrics-client-certs\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.300196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.300057 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2f63f3f-1704-4986-8844-38994c1aeeb3-config-out\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:37:54.931434 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931401 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" exitCode=0 Jul 28 11:37:54.931434 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931428 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" exitCode=0 Jul 28 11:37:54.931434 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931434 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" exitCode=0 Jul 28 11:37:54.931434 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931439 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" exitCode=0 Jul 28 11:37:54.931434 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931445 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" exitCode=0 Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931451 2559 generic.go:356] "Generic (PLEG): container finished" podID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" exitCode=0 Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931487 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931580 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931646 2559 scope.go:117] "RemoveContainer" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931684 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} Jul 28 11:37:54.931800 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.931707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2f63f3f-1704-4986-8844-38994c1aeeb3","Type":"ContainerDied","Data":"509e2cfb32c8d5f0eecf60c20d3a5091659a33d1157432230989903f814e1365"} Jul 28 11:37:54.939269 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.939248 2559 scope.go:117] "RemoveContainer" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.946698 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.946679 2559 scope.go:117] "RemoveContainer" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.953561 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.953544 2559 scope.go:117] "RemoveContainer" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.957623 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.957600 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:37:54.960780 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.960763 2559 scope.go:117] "RemoveContainer" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.963462 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.963444 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:37:54.968321 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.968300 2559 scope.go:117] "RemoveContainer" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.975546 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.975531 2559 scope.go:117] "RemoveContainer" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.981983 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.981968 2559 scope.go:117] "RemoveContainer" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.982271 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:54.982216 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": container with ID starting with b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100 not found: ID does not exist" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.982271 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.982248 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} err="failed to get container status \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": rpc error: code = NotFound desc = could not find container \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": container with ID starting with b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100 not found: ID does not exist" Jul 28 11:37:54.982271 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.982267 2559 scope.go:117] "RemoveContainer" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.982668 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:54.982627 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": container with ID starting with d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b not found: ID does not exist" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.982764 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.982676 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} err="failed to get container status \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": rpc error: code = NotFound desc = could not find container \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": container with ID starting with d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b not found: ID does not exist" Jul 28 11:37:54.982764 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.982700 2559 scope.go:117] "RemoveContainer" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.983091 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:54.983075 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": container with ID starting with ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f not found: ID does not exist" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.983139 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983096 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} err="failed to get container status \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": rpc error: code = NotFound desc = could not find container \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": container with ID starting with ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f not found: ID does not exist" Jul 28 11:37:54.983139 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983112 2559 scope.go:117] "RemoveContainer" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.983394 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:54.983376 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": container with ID starting with 065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7 not found: ID does not exist" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.983444 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983398 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} err="failed to get container status \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": rpc error: code = NotFound desc = could not find container \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": container with ID starting with 065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7 not found: ID does not exist" Jul 28 11:37:54.983444 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983412 2559 scope.go:117] "RemoveContainer" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.983668 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:54.983650 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": container with ID starting with 6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9 not found: ID does not exist" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.983738 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983677 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} err="failed to get container status \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": rpc error: code = NotFound desc = could not find container \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": container with ID starting with 6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9 not found: ID does not exist" Jul 28 11:37:54.983738 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983697 2559 scope.go:117] "RemoveContainer" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.983923 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:54.983907 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": container with ID starting with 6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d not found: ID does not exist" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.983980 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983927 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} err="failed to get container status \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": rpc error: code = NotFound desc = could not find container \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": container with ID starting with 6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d not found: ID does not exist" Jul 28 11:37:54.983980 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.983940 2559 scope.go:117] "RemoveContainer" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.984137 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:37:54.984120 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": container with ID starting with fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a not found: ID does not exist" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.984225 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984143 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a"} err="failed to get container status \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": rpc error: code = NotFound desc = could not find container \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": container with ID starting with fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a not found: ID does not exist" Jul 28 11:37:54.984225 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984183 2559 scope.go:117] "RemoveContainer" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.984404 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984388 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} err="failed to get container status \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": rpc error: code = NotFound desc = could not find container \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": container with ID starting with b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100 not found: ID does not exist" Jul 28 11:37:54.984454 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984404 2559 scope.go:117] "RemoveContainer" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.984592 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984577 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} err="failed to get container status \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": rpc error: code = NotFound desc = could not find container \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": container with ID starting with d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b not found: ID does not exist" Jul 28 11:37:54.984636 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984592 2559 scope.go:117] "RemoveContainer" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.984768 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984752 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} err="failed to get container status \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": rpc error: code = NotFound desc = could not find container \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": container with ID starting with ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f not found: ID does not exist" Jul 28 11:37:54.984828 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984767 2559 scope.go:117] "RemoveContainer" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.984944 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984929 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} err="failed to get container status \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": rpc error: code = NotFound desc = could not find container \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": container with ID starting with 065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7 not found: ID does not exist" Jul 28 11:37:54.984989 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.984944 2559 scope.go:117] "RemoveContainer" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.985138 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985121 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} err="failed to get container status \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": rpc error: code = NotFound desc = could not find container \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": container with ID starting with 6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9 not found: ID does not exist" Jul 28 11:37:54.985296 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985140 2559 scope.go:117] "RemoveContainer" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.985380 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985364 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} err="failed to get container status \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": rpc error: code = NotFound desc = could not find container \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": container with ID starting with 6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d not found: ID does not exist" Jul 28 11:37:54.985425 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985381 2559 scope.go:117] "RemoveContainer" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.985623 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985608 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a"} err="failed to get container status \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": rpc error: code = NotFound desc = could not find container \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": container with ID starting with fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a not found: ID does not exist" Jul 28 11:37:54.985623 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985623 2559 scope.go:117] "RemoveContainer" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.985795 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985780 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} err="failed to get container status \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": rpc error: code = NotFound desc = could not find container \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": container with ID starting with b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100 not found: ID does not exist" Jul 28 11:37:54.985836 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985795 2559 scope.go:117] "RemoveContainer" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.986006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.985983 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} err="failed to get container status \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": rpc error: code = NotFound desc = could not find container \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": container with ID starting with d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b not found: ID does not exist" Jul 28 11:37:54.986056 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986009 2559 scope.go:117] "RemoveContainer" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.986228 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986212 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} err="failed to get container status \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": rpc error: code = NotFound desc = could not find container \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": container with ID starting with ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f not found: ID does not exist" Jul 28 11:37:54.986280 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986229 2559 scope.go:117] "RemoveContainer" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.986427 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986412 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} err="failed to get container status \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": rpc error: code = NotFound desc = could not find container \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": container with ID starting with 065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7 not found: ID does not exist" Jul 28 11:37:54.986465 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986427 2559 scope.go:117] "RemoveContainer" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.986635 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986618 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} err="failed to get container status \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": rpc error: code = NotFound desc = could not find container \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": container with ID starting with 6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9 not found: ID does not exist" Jul 28 11:37:54.986687 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986635 2559 scope.go:117] "RemoveContainer" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.986854 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986835 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} err="failed to get container status \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": rpc error: code = NotFound desc = could not find container \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": container with ID starting with 6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d not found: ID does not exist" Jul 28 11:37:54.986897 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.986855 2559 scope.go:117] "RemoveContainer" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.987066 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987047 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a"} err="failed to get container status \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": rpc error: code = NotFound desc = could not find container \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": container with ID starting with fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a not found: ID does not exist" Jul 28 11:37:54.987119 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987066 2559 scope.go:117] "RemoveContainer" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.987306 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987289 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} err="failed to get container status \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": rpc error: code = NotFound desc = could not find container \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": container with ID starting with b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100 not found: ID does not exist" Jul 28 11:37:54.987306 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987308 2559 scope.go:117] "RemoveContainer" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.987527 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987509 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} err="failed to get container status \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": rpc error: code = NotFound desc = could not find container \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": container with ID starting with d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b not found: ID does not exist" Jul 28 11:37:54.987575 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987528 2559 scope.go:117] "RemoveContainer" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.987750 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987734 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} err="failed to get container status \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": rpc error: code = NotFound desc = could not find container \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": container with ID starting with ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f not found: ID does not exist" Jul 28 11:37:54.987808 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987751 2559 scope.go:117] "RemoveContainer" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.987961 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987943 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} err="failed to get container status \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": rpc error: code = NotFound desc = could not find container \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": container with ID starting with 065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7 not found: ID does not exist" Jul 28 11:37:54.988007 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.987960 2559 scope.go:117] "RemoveContainer" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.988140 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988125 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} err="failed to get container status \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": rpc error: code = NotFound desc = could not find container \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": container with ID starting with 6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9 not found: ID does not exist" Jul 28 11:37:54.988209 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988142 2559 scope.go:117] "RemoveContainer" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.988372 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988355 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} err="failed to get container status \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": rpc error: code = NotFound desc = could not find container \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": container with ID starting with 6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d not found: ID does not exist" Jul 28 11:37:54.988418 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988372 2559 scope.go:117] "RemoveContainer" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.988597 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988579 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a"} err="failed to get container status \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": rpc error: code = NotFound desc = could not find container \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": container with ID starting with fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a not found: ID does not exist" Jul 28 11:37:54.988643 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988597 2559 scope.go:117] "RemoveContainer" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.988788 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988772 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} err="failed to get container status \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": rpc error: code = NotFound desc = could not find container \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": container with ID starting with b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100 not found: ID does not exist" Jul 28 11:37:54.988826 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988787 2559 scope.go:117] "RemoveContainer" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.988981 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988965 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} err="failed to get container status \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": rpc error: code = NotFound desc = could not find container \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": container with ID starting with d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b not found: ID does not exist" Jul 28 11:37:54.989026 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.988981 2559 scope.go:117] "RemoveContainer" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.989205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989178 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} err="failed to get container status \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": rpc error: code = NotFound desc = could not find container \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": container with ID starting with ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f not found: ID does not exist" Jul 28 11:37:54.989205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989205 2559 scope.go:117] "RemoveContainer" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.989397 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989381 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} err="failed to get container status \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": rpc error: code = NotFound desc = could not find container \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": container with ID starting with 065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7 not found: ID does not exist" Jul 28 11:37:54.989438 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989397 2559 scope.go:117] "RemoveContainer" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.989583 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989564 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} err="failed to get container status \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": rpc error: code = NotFound desc = could not find container \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": container with ID starting with 6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9 not found: ID does not exist" Jul 28 11:37:54.989637 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989584 2559 scope.go:117] "RemoveContainer" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.989783 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989767 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} err="failed to get container status \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": rpc error: code = NotFound desc = could not find container \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": container with ID starting with 6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d not found: ID does not exist" Jul 28 11:37:54.989826 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989783 2559 scope.go:117] "RemoveContainer" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.989979 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989958 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a"} err="failed to get container status \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": rpc error: code = NotFound desc = could not find container \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": container with ID starting with fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a not found: ID does not exist" Jul 28 11:37:54.989979 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.989977 2559 scope.go:117] "RemoveContainer" containerID="b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100" Jul 28 11:37:54.990199 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990183 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100"} err="failed to get container status \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": rpc error: code = NotFound desc = could not find container \"b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100\": container with ID starting with b96fd75f7688c29b01d91d41fcea75fa135226fc9c2f3dcc285c52455e869100 not found: ID does not exist" Jul 28 11:37:54.990199 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990199 2559 scope.go:117] "RemoveContainer" containerID="d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b" Jul 28 11:37:54.990400 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990383 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b"} err="failed to get container status \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": rpc error: code = NotFound desc = could not find container \"d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b\": container with ID starting with d22f538a514cc2d103df826a477e64024feaaf7ff685c15443e04cee14587a8b not found: ID does not exist" Jul 28 11:37:54.990474 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990402 2559 scope.go:117] "RemoveContainer" containerID="ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f" Jul 28 11:37:54.990612 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990597 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f"} err="failed to get container status \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": rpc error: code = NotFound desc = could not find container \"ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f\": container with ID starting with ed59f9466284e151d39437fe4662ba9259c056e36304a4e328db21a5fe7b805f not found: ID does not exist" Jul 28 11:37:54.990679 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990614 2559 scope.go:117] "RemoveContainer" containerID="065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7" Jul 28 11:37:54.990872 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990814 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7"} err="failed to get container status \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": rpc error: code = NotFound desc = could not find container \"065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7\": container with ID starting with 065810cb41b7ee4c5a444615d81eb6e76d7d90cbd016b8a7b449ef5fe8daaea7 not found: ID does not exist" Jul 28 11:37:54.990872 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.990870 2559 scope.go:117] "RemoveContainer" containerID="6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9" Jul 28 11:37:54.991146 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.991122 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9"} err="failed to get container status \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": rpc error: code = NotFound desc = could not find container \"6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9\": container with ID starting with 6731cf1f83b26aa75d2a1f1d2ac65476dab96b1f1f21f8e4b9f64f650dac22c9 not found: ID does not exist" Jul 28 11:37:54.991242 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.991169 2559 scope.go:117] "RemoveContainer" containerID="6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d" Jul 28 11:37:54.991505 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.991471 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d"} err="failed to get container status \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": rpc error: code = NotFound desc = could not find container \"6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d\": container with ID starting with 6a6ca067c000cd2dfabd191bc69f1a1684ca16a529249bf54d3dcd97413d461d not found: ID does not exist" Jul 28 11:37:54.991606 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.991499 2559 scope.go:117] "RemoveContainer" containerID="fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a" Jul 28 11:37:54.991871 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.991836 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a"} err="failed to get container status \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": rpc error: code = NotFound desc = could not find container \"fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a\": container with ID starting with fc990f2b39e39872ff2c074af013428de15ab086e5cb880c3dbab42acbcc163a not found: ID does not exist" Jul 28 11:37:54.993202 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993184 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:37:54.993493 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993481 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="init-config-reloader" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993495 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="init-config-reloader" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993505 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="thanos-sidecar" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993511 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="thanos-sidecar" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993520 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="config-reloader" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993525 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="config-reloader" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993532 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993538 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy" Jul 28 11:37:54.993543 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993545 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="prometheus" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993551 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="prometheus" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993563 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-thanos" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993569 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-thanos" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993578 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-web" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993583 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-web" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993626 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="config-reloader" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993634 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993641 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="thanos-sidecar" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993646 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-web" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993651 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="prometheus" Jul 28 11:37:54.993799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:54.993657 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" containerName="kube-rbac-proxy-thanos" Jul 28 11:37:55.000428 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.000410 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.002871 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.002850 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fxlmc\"" Jul 28 11:37:55.002987 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.002872 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3bul0198rceov\"" Jul 28 11:37:55.002987 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.002850 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 11:37:55.002987 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.002934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 11:37:55.003344 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003147 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 11:37:55.003344 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003226 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 11:37:55.003344 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003233 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 11:37:55.003497 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003346 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 11:37:55.003637 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003595 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 11:37:55.003637 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003623 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 11:37:55.003768 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003641 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 11:37:55.003768 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003697 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 11:37:55.003848 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.003841 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 11:37:55.004242 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.004227 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 11:37:55.005787 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.005739 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 11:37:55.009717 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.009696 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 11:37:55.017090 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.017069 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:37:55.107413 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107413 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107413 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107413 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-config\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9wvx\" (UniqueName: \"kubernetes.io/projected/e3b3cc17-6aa3-495a-9727-8f0272c92fce-kube-api-access-h9wvx\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3b3cc17-6aa3-495a-9727-8f0272c92fce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3b3cc17-6aa3-495a-9727-8f0272c92fce-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.107977 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.107980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209149 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209149 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-config\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9wvx\" (UniqueName: \"kubernetes.io/projected/e3b3cc17-6aa3-495a-9727-8f0272c92fce-kube-api-access-h9wvx\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209420 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3b3cc17-6aa3-495a-9727-8f0272c92fce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3b3cc17-6aa3-495a-9727-8f0272c92fce-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209656 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.209823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.209719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.210345 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.210050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.210903 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.210876 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.211075 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.210935 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.211198 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.210935 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.211580 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.211550 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.212114 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.212086 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.212612 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.212584 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.213026 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.213004 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.213500 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.213472 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.213596 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.213568 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.213659 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.213612 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e3b3cc17-6aa3-495a-9727-8f0272c92fce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.214065 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.214029 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.214065 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.214041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-config\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.214260 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.214218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.214745 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.214722 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-web-config\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.215284 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.215268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3b3cc17-6aa3-495a-9727-8f0272c92fce-config-out\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.215446 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.215428 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.215503 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.215479 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3b3cc17-6aa3-495a-9727-8f0272c92fce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.215608 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.215595 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3b3cc17-6aa3-495a-9727-8f0272c92fce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.221806 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.221785 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9wvx\" (UniqueName: \"kubernetes.io/projected/e3b3cc17-6aa3-495a-9727-8f0272c92fce-kube-api-access-h9wvx\") pod \"prometheus-k8s-0\" (UID: \"e3b3cc17-6aa3-495a-9727-8f0272c92fce\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.311080 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.311038 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:37:55.448913 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.448888 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 11:37:55.451142 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:37:55.451112 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b3cc17_6aa3_495a_9727_8f0272c92fce.slice/crio-8609e4fb0a752a19f5616b7bc37e9baf656ca6d0396dd29550034bcea08d06b7 WatchSource:0}: Error finding container 8609e4fb0a752a19f5616b7bc37e9baf656ca6d0396dd29550034bcea08d06b7: Status 404 returned error can't find the container with id 8609e4fb0a752a19f5616b7bc37e9baf656ca6d0396dd29550034bcea08d06b7 Jul 28 11:37:55.938531 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.938496 2559 generic.go:356] "Generic (PLEG): container finished" podID="e3b3cc17-6aa3-495a-9727-8f0272c92fce" containerID="85eb87c352305be33619ce186d758d69c8205017cb0ce359141278ab008c5203" exitCode=0 Jul 28 11:37:55.938686 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.938545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerDied","Data":"85eb87c352305be33619ce186d758d69c8205017cb0ce359141278ab008c5203"} Jul 28 11:37:55.938686 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:55.938609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerStarted","Data":"8609e4fb0a752a19f5616b7bc37e9baf656ca6d0396dd29550034bcea08d06b7"} Jul 28 11:37:56.127600 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.127561 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f63f3f-1704-4986-8844-38994c1aeeb3" path="/var/lib/kubelet/pods/b2f63f3f-1704-4986-8844-38994c1aeeb3/volumes" Jul 28 11:37:56.948325 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.948293 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerStarted","Data":"60002e441862c06bb0862a351c4299d21da5b1029bdba21f6d13693a6e249956"} Jul 28 11:37:56.948513 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.948358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerStarted","Data":"379e4a5a85fb075363f1722ed0f5835bc5afe918ea596164f03217dde2db9ccf"} Jul 28 11:37:56.948513 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.948386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerStarted","Data":"d3e39f4f4dc41a081dbabf3fb8957301ba25e2dba23827c22d6e20112087ead6"} Jul 28 11:37:56.948513 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.948412 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerStarted","Data":"418577e3a4e56a53cf685870782f9873d90306a32a11771e0d076f187983389e"} Jul 28 11:37:56.948513 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.948443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerStarted","Data":"d7596af78c9362c6fba88e0f59b4938681d4640ce22d8a104400b4115ccdc3aa"} Jul 28 11:37:56.948513 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.948471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e3b3cc17-6aa3-495a-9727-8f0272c92fce","Type":"ContainerStarted","Data":"bea3688768e8580999973627d204733296f8a0568f4e465521643b69ab9e2fdc"} Jul 28 11:37:56.984359 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:56.984309 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.964757591 podStartE2EDuration="2.984292711s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.53512ms" isStatefulPod=false podCreationTimestamp="2026-07-28 11:37:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:37:56.981538965 +0000 UTC m=+153.445736136" watchObservedRunningTime="2026-07-28 11:37:56.984292711 +0000 UTC m=+153.448489850" Jul 28 11:37:58.445619 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:37:58.445584 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:00.312022 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:00.311984 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:38:09.735380 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:09.735349 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:09.836201 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:09.836145 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:09.897202 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:09.897142 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:21.645974 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:21.645876 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:34.538092 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:34.538047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:34.597296 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:34.597266 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:38:55.311905 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:55.311853 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:38:55.327397 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:55.327371 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:38:56.186976 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:38:56.186951 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 11:39:03.691767 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:03.691727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:03.764751 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:03.764712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:04.109402 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:04.109367 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:04.174603 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:04.174569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:10.950894 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:10.950853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:14.968562 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:14.968524 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:15.062316 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:15.062288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:15.118607 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:15.118581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:15.639868 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:15.639835 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:15.741923 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:15.741893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:26.184250 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:26.184218 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:26.285343 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:26.285310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:39:26.352891 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:39:26.352847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:40:23.905995 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:40:23.905969 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 11:40:28.129387 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:40:28.129340 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:42:55.230828 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:42:55.230736 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:43:03.757926 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:43:03.757889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:43:14.856852 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:43:14.856817 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:43:14.956820 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:43:14.956790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:43:15.033403 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:43:15.033366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:43:50.353722 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:43:50.353685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:44:26.616807 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:44:26.616718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:44:36.386779 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:44:36.386743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:45:38.889595 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:45:38.889550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:45:40.468698 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:45:40.468668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:11.747644 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:11.747606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:13.134119 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:13.134068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:15.365951 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:15.365921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:15.426866 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:15.426842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:17.171310 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:17.171278 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:17.271245 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:17.271207 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:19.176419 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:19.176385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:19.573954 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:19.573921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:19.970933 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:19.970852 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:20.038770 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:20.038740 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:25.765345 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:25.765304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:25.829978 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:25.829943 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:28.378952 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.378916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:28.599334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.599300 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9q7qj"] Jul 28 11:46:28.602782 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.602762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:28.605307 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.605288 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 11:46:28.605307 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.605286 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 11:46:28.605537 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.605304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6cnjt\"" Jul 28 11:46:28.611822 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.611802 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9q7qj"] Jul 28 11:46:28.685448 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.685357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f02cb6-5536-4b25-b16e-f76d1794d8a0-bound-sa-token\") pod \"cert-manager-55b4d954d5-9q7qj\" (UID: \"94f02cb6-5536-4b25-b16e-f76d1794d8a0\") " pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:28.685448 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.685421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5xc9\" (UniqueName: \"kubernetes.io/projected/94f02cb6-5536-4b25-b16e-f76d1794d8a0-kube-api-access-p5xc9\") pod \"cert-manager-55b4d954d5-9q7qj\" (UID: \"94f02cb6-5536-4b25-b16e-f76d1794d8a0\") " pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:28.785940 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.785902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5xc9\" (UniqueName: \"kubernetes.io/projected/94f02cb6-5536-4b25-b16e-f76d1794d8a0-kube-api-access-p5xc9\") pod \"cert-manager-55b4d954d5-9q7qj\" (UID: \"94f02cb6-5536-4b25-b16e-f76d1794d8a0\") " pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:28.786091 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.785966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f02cb6-5536-4b25-b16e-f76d1794d8a0-bound-sa-token\") pod \"cert-manager-55b4d954d5-9q7qj\" (UID: \"94f02cb6-5536-4b25-b16e-f76d1794d8a0\") " pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:28.794785 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.794737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f02cb6-5536-4b25-b16e-f76d1794d8a0-bound-sa-token\") pod \"cert-manager-55b4d954d5-9q7qj\" (UID: \"94f02cb6-5536-4b25-b16e-f76d1794d8a0\") " pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:28.794914 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.794806 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5xc9\" (UniqueName: \"kubernetes.io/projected/94f02cb6-5536-4b25-b16e-f76d1794d8a0-kube-api-access-p5xc9\") pod \"cert-manager-55b4d954d5-9q7qj\" (UID: \"94f02cb6-5536-4b25-b16e-f76d1794d8a0\") " pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:28.932686 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:28.932653 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9q7qj" Jul 28 11:46:29.067470 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:29.067370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9q7qj"] Jul 28 11:46:29.070259 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:46:29.070230 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94f02cb6_5536_4b25_b16e_f76d1794d8a0.slice/crio-174a2c3c922c381e3a1f1274eed4e4b6d9a81b6867acfdc5ab633f8b9a126a32 WatchSource:0}: Error finding container 174a2c3c922c381e3a1f1274eed4e4b6d9a81b6867acfdc5ab633f8b9a126a32: Status 404 returned error can't find the container with id 174a2c3c922c381e3a1f1274eed4e4b6d9a81b6867acfdc5ab633f8b9a126a32 Jul 28 11:46:29.072250 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:29.072234 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 11:46:29.915500 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:29.915460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9q7qj" event={"ID":"94f02cb6-5536-4b25-b16e-f76d1794d8a0","Type":"ContainerStarted","Data":"174a2c3c922c381e3a1f1274eed4e4b6d9a81b6867acfdc5ab633f8b9a126a32"} Jul 28 11:46:32.928630 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:32.928600 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9q7qj" event={"ID":"94f02cb6-5536-4b25-b16e-f76d1794d8a0","Type":"ContainerStarted","Data":"eddcc45c35f80608a76a2978950932970b9f04bc92ba51155636c8ade5d519b1"} Jul 28 11:46:32.945011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:32.944937 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9q7qj" podStartSLOduration=1.9467828040000001 podStartE2EDuration="4.944918495s" totalImagesPullingTime="2.998135691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:46:32.944345195 +0000 UTC m=+669.408542335" watchObservedRunningTime="2026-07-28 11:46:32.944918495 +0000 UTC m=+669.409115645" Jul 28 11:46:33.157006 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:33.156976 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:33.253870 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:33.253741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:43.540869 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:43.540825 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:43.641633 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:43.641600 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:44.857001 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.856967 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-mhww6"] Jul 28 11:46:44.863549 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.863514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:44.865996 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.865966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-v7szc\"" Jul 28 11:46:44.866755 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.866705 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 28 11:46:44.866755 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.866723 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 28 11:46:44.869648 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.869626 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-mhww6"] Jul 28 11:46:44.935128 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.935096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6n2\" (UniqueName: \"kubernetes.io/projected/5be2f67b-ae80-46cb-882e-fc0bb96c25a0-kube-api-access-gk6n2\") pod \"jobset-operator-5bc45f897-mhww6\" (UID: \"5be2f67b-ae80-46cb-882e-fc0bb96c25a0\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:44.935322 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:44.935179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5be2f67b-ae80-46cb-882e-fc0bb96c25a0-tmp\") pod \"jobset-operator-5bc45f897-mhww6\" (UID: \"5be2f67b-ae80-46cb-882e-fc0bb96c25a0\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:45.036056 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:45.036021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5be2f67b-ae80-46cb-882e-fc0bb96c25a0-tmp\") pod \"jobset-operator-5bc45f897-mhww6\" (UID: \"5be2f67b-ae80-46cb-882e-fc0bb96c25a0\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:45.036266 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:45.036086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6n2\" (UniqueName: \"kubernetes.io/projected/5be2f67b-ae80-46cb-882e-fc0bb96c25a0-kube-api-access-gk6n2\") pod \"jobset-operator-5bc45f897-mhww6\" (UID: \"5be2f67b-ae80-46cb-882e-fc0bb96c25a0\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:45.036436 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:45.036417 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5be2f67b-ae80-46cb-882e-fc0bb96c25a0-tmp\") pod \"jobset-operator-5bc45f897-mhww6\" (UID: \"5be2f67b-ae80-46cb-882e-fc0bb96c25a0\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:45.043812 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:45.043789 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6n2\" (UniqueName: \"kubernetes.io/projected/5be2f67b-ae80-46cb-882e-fc0bb96c25a0-kube-api-access-gk6n2\") pod \"jobset-operator-5bc45f897-mhww6\" (UID: \"5be2f67b-ae80-46cb-882e-fc0bb96c25a0\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:45.175005 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:45.174916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" Jul 28 11:46:45.301940 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:45.301901 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-mhww6"] Jul 28 11:46:45.304825 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:46:45.304800 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5be2f67b_ae80_46cb_882e_fc0bb96c25a0.slice/crio-f72daca9a8e4789710ac1c5a5c15c8be2ac1eb58d2e2a5f369a5007e391cd42a WatchSource:0}: Error finding container f72daca9a8e4789710ac1c5a5c15c8be2ac1eb58d2e2a5f369a5007e391cd42a: Status 404 returned error can't find the container with id f72daca9a8e4789710ac1c5a5c15c8be2ac1eb58d2e2a5f369a5007e391cd42a Jul 28 11:46:45.983816 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:45.983778 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" event={"ID":"5be2f67b-ae80-46cb-882e-fc0bb96c25a0","Type":"ContainerStarted","Data":"f72daca9a8e4789710ac1c5a5c15c8be2ac1eb58d2e2a5f369a5007e391cd42a"} Jul 28 11:46:48.998064 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:48.998029 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" event={"ID":"5be2f67b-ae80-46cb-882e-fc0bb96c25a0","Type":"ContainerStarted","Data":"1b5ec74b147eaa9c17c6328930ace857e856fd17b6d0917e5d342ab14cfddbd0"} Jul 28 11:46:49.016710 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:49.016656 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mhww6" podStartSLOduration=2.325249513 podStartE2EDuration="5.016641001s" totalImagesPullingTime="2.691391488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:46:49.01448893 +0000 UTC m=+685.478686070" watchObservedRunningTime="2026-07-28 11:46:49.016641001 +0000 UTC m=+685.480838139" Jul 28 11:46:53.915913 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:53.915878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:54.316842 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:54.316798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:54.426302 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:54.426263 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:46:56.931328 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:46:56.931288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:11.021360 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:11.021328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:11.120370 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:11.120333 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:13.910438 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.910382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:13.928136 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.928098 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz"] Jul 28 11:47:13.933412 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.933396 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:13.935796 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.935772 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 28 11:47:13.935921 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.935815 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 28 11:47:13.936617 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.936597 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-h7zmn\"" Jul 28 11:47:13.936739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.936606 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 11:47:13.936739 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.936647 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 11:47:13.941949 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.941930 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz"] Jul 28 11:47:13.985879 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.985847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvb9q\" (UniqueName: \"kubernetes.io/projected/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-kube-api-access-pvb9q\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:13.986027 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.985892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-cert\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:13.986027 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:13.985940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.086968 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.086936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvb9q\" (UniqueName: \"kubernetes.io/projected/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-kube-api-access-pvb9q\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.087147 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.086996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-cert\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.087147 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.087031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.087745 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.087720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.089441 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.089416 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-cert\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.095149 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.095130 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvb9q\" (UniqueName: \"kubernetes.io/projected/6f7cc64e-e7ff-4905-9ca3-fa10e84afed8-kube-api-access-pvb9q\") pod \"kubeflow-trainer-controller-manager-75b6dd666-ff4pz\" (UID: \"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8\") " pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.181481 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.181402 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:14.243489 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.243451 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:14.372718 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:14.372637 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz"] Jul 28 11:47:14.375600 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:47:14.375574 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f7cc64e_e7ff_4905_9ca3_fa10e84afed8.slice/crio-9f15c9896c444290555a87c242807a6ea55b875866c7acaeafbc9960ab3c44e2 WatchSource:0}: Error finding container 9f15c9896c444290555a87c242807a6ea55b875866c7acaeafbc9960ab3c44e2: Status 404 returned error can't find the container with id 9f15c9896c444290555a87c242807a6ea55b875866c7acaeafbc9960ab3c44e2 Jul 28 11:47:15.105795 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:15.105679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" event={"ID":"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8","Type":"ContainerStarted","Data":"9f15c9896c444290555a87c242807a6ea55b875866c7acaeafbc9960ab3c44e2"} Jul 28 11:47:17.116069 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:17.116017 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" event={"ID":"6f7cc64e-e7ff-4905-9ca3-fa10e84afed8","Type":"ContainerStarted","Data":"3e43775bdd8dfc19a6bcbeb9ce31f6d21c1d6fa1d2b7570ed206d4b9bce6baca"} Jul 28 11:47:17.116530 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:17.116087 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:47:17.132404 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:17.132332 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" podStartSLOduration=1.8892741 podStartE2EDuration="4.132313428s" totalImagesPullingTime="2.243039328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:47:17.131638999 +0000 UTC m=+713.595836131" watchObservedRunningTime="2026-07-28 11:47:17.132313428 +0000 UTC m=+713.596510580" Jul 28 11:47:17.343647 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:17.343615 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:24.134175 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:24.132764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:24.191129 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:24.191093 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:47:33.131547 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:47:33.131513 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-75b6dd666-ff4pz" Jul 28 11:48:45.378596 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.378516 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:48:45.475177 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.475126 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:48:45.510038 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.510006 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw"] Jul 28 11:48:45.513404 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.513384 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:48:45.515780 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.515758 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"kube-root-ca.crt\"" Jul 28 11:48:45.515911 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.515755 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"openshift-service-ca.crt\"" Jul 28 11:48:45.516191 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.516175 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xstnp\"/\"default-dockercfg-892xw\"" Jul 28 11:48:45.526775 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.526747 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw"] Jul 28 11:48:45.550312 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.550285 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:48:45.567633 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.567607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgxxq\" (UniqueName: \"kubernetes.io/projected/2fd0c913-cd67-47f6-99a3-f06903c34862-kube-api-access-vgxxq\") pod \"progression-enabled-node-0-0-dgqtw\" (UID: \"2fd0c913-cd67-47f6-99a3-f06903c34862\") " pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:48:45.668362 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.668278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgxxq\" (UniqueName: \"kubernetes.io/projected/2fd0c913-cd67-47f6-99a3-f06903c34862-kube-api-access-vgxxq\") pod \"progression-enabled-node-0-0-dgqtw\" (UID: \"2fd0c913-cd67-47f6-99a3-f06903c34862\") " pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:48:45.677302 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.677270 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgxxq\" (UniqueName: \"kubernetes.io/projected/2fd0c913-cd67-47f6-99a3-f06903c34862-kube-api-access-vgxxq\") pod \"progression-enabled-node-0-0-dgqtw\" (UID: \"2fd0c913-cd67-47f6-99a3-f06903c34862\") " pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:48:45.823544 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.823506 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:48:45.961792 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:45.961651 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw"] Jul 28 11:48:45.964504 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:48:45.964476 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd0c913_cd67_47f6_99a3_f06903c34862.slice/crio-31dc29b8e49afe9991b704a583754c573cfe263ab47e5a8413ed70500563e2e8 WatchSource:0}: Error finding container 31dc29b8e49afe9991b704a583754c573cfe263ab47e5a8413ed70500563e2e8: Status 404 returned error can't find the container with id 31dc29b8e49afe9991b704a583754c573cfe263ab47e5a8413ed70500563e2e8 Jul 28 11:48:46.479952 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:48:46.479913 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" event={"ID":"2fd0c913-cd67-47f6-99a3-f06903c34862","Type":"ContainerStarted","Data":"31dc29b8e49afe9991b704a583754c573cfe263ab47e5a8413ed70500563e2e8"} Jul 28 11:50:33.987649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:33.987557 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" event={"ID":"2fd0c913-cd67-47f6-99a3-f06903c34862","Type":"ContainerStarted","Data":"d1500ffaff337d170390dd0e4b7407d2ecde46d4a57b96f2a676828d443e339c"} Jul 28 11:50:33.987649 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:33.987633 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:50:34.017378 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:34.017316 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" podStartSLOduration=1.312780899 podStartE2EDuration="1m49.017299313s" totalImagesPullingTime="1m47.704518414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:50:34.015079315 +0000 UTC m=+910.479276455" watchObservedRunningTime="2026-07-28 11:50:34.017299313 +0000 UTC m=+910.481496452" Jul 28 11:50:35.994578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:35.994547 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:50:56.992748 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:56.992702 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" podUID="2fd0c913-cd67-47f6-99a3-f06903c34862" containerName="node" probeResult="failure" output="Get \"http://10.134.0.24:28080/metrics\": dial tcp 10.134.0.24:28080: connect: connection refused" Jul 28 11:50:57.080888 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:57.080853 2559 generic.go:356] "Generic (PLEG): container finished" podID="2fd0c913-cd67-47f6-99a3-f06903c34862" containerID="d1500ffaff337d170390dd0e4b7407d2ecde46d4a57b96f2a676828d443e339c" exitCode=0 Jul 28 11:50:57.081053 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:57.080925 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" event={"ID":"2fd0c913-cd67-47f6-99a3-f06903c34862","Type":"ContainerDied","Data":"d1500ffaff337d170390dd0e4b7407d2ecde46d4a57b96f2a676828d443e339c"} Jul 28 11:50:58.239223 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:58.239191 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:50:58.253744 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:58.253717 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgxxq\" (UniqueName: \"kubernetes.io/projected/2fd0c913-cd67-47f6-99a3-f06903c34862-kube-api-access-vgxxq\") pod \"2fd0c913-cd67-47f6-99a3-f06903c34862\" (UID: \"2fd0c913-cd67-47f6-99a3-f06903c34862\") " Jul 28 11:50:58.255876 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:58.255846 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd0c913-cd67-47f6-99a3-f06903c34862-kube-api-access-vgxxq" (OuterVolumeSpecName: "kube-api-access-vgxxq") pod "2fd0c913-cd67-47f6-99a3-f06903c34862" (UID: "2fd0c913-cd67-47f6-99a3-f06903c34862"). InnerVolumeSpecName "kube-api-access-vgxxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:50:58.354269 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:58.354191 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgxxq\" (UniqueName: \"kubernetes.io/projected/2fd0c913-cd67-47f6-99a3-f06903c34862-kube-api-access-vgxxq\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:50:59.090653 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:59.090625 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" Jul 28 11:50:59.090653 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:59.090645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw" event={"ID":"2fd0c913-cd67-47f6-99a3-f06903c34862","Type":"ContainerDied","Data":"31dc29b8e49afe9991b704a583754c573cfe263ab47e5a8413ed70500563e2e8"} Jul 28 11:50:59.090864 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:59.090689 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31dc29b8e49afe9991b704a583754c573cfe263ab47e5a8413ed70500563e2e8" Jul 28 11:50:59.989025 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:50:59.988989 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:51:00.005639 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.005608 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm"] Jul 28 11:51:00.005931 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.005919 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd0c913-cd67-47f6-99a3-f06903c34862" containerName="node" Jul 28 11:51:00.005974 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.005933 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd0c913-cd67-47f6-99a3-f06903c34862" containerName="node" Jul 28 11:51:00.006018 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.006009 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd0c913-cd67-47f6-99a3-f06903c34862" containerName="node" Jul 28 11:51:00.021239 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.021212 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm"] Jul 28 11:51:00.021397 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.021323 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:00.023888 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.023866 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"openshift-service-ca.crt\"" Jul 28 11:51:00.024020 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.023921 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"kube-root-ca.crt\"" Jul 28 11:51:00.024020 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.023968 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xstnp\"/\"default-dockercfg-892xw\"" Jul 28 11:51:00.068713 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.068683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pwd\" (UniqueName: \"kubernetes.io/projected/415af7ec-c745-4f34-b603-41cf26c4482c-kube-api-access-r4pwd\") pod \"progression-disabled-node-0-0-hh4dm\" (UID: \"415af7ec-c745-4f34-b603-41cf26c4482c\") " pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:00.169520 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.169480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pwd\" (UniqueName: \"kubernetes.io/projected/415af7ec-c745-4f34-b603-41cf26c4482c-kube-api-access-r4pwd\") pod \"progression-disabled-node-0-0-hh4dm\" (UID: \"415af7ec-c745-4f34-b603-41cf26c4482c\") " pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:00.179468 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.179441 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pwd\" (UniqueName: \"kubernetes.io/projected/415af7ec-c745-4f34-b603-41cf26c4482c-kube-api-access-r4pwd\") pod \"progression-disabled-node-0-0-hh4dm\" (UID: \"415af7ec-c745-4f34-b603-41cf26c4482c\") " pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:00.330615 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.330588 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:00.478692 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:00.478619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm"] Jul 28 11:51:00.481654 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:51:00.481625 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415af7ec_c745_4f34_b603_41cf26c4482c.slice/crio-5be516ecbe9f43bd7a841164fd4423edcd693da6a1f65f03eff9943a2bcf349b WatchSource:0}: Error finding container 5be516ecbe9f43bd7a841164fd4423edcd693da6a1f65f03eff9943a2bcf349b: Status 404 returned error can't find the container with id 5be516ecbe9f43bd7a841164fd4423edcd693da6a1f65f03eff9943a2bcf349b Jul 28 11:51:01.102560 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:01.102527 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" event={"ID":"415af7ec-c745-4f34-b603-41cf26c4482c","Type":"ContainerStarted","Data":"a35ed1439fe5ff0e70a3421b93adfec53ad74fdec04ee43f3cd415e0de28b001"} Jul 28 11:51:01.102974 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:01.102575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" event={"ID":"415af7ec-c745-4f34-b603-41cf26c4482c","Type":"ContainerStarted","Data":"5be516ecbe9f43bd7a841164fd4423edcd693da6a1f65f03eff9943a2bcf349b"} Jul 28 11:51:01.102974 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:01.102641 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:01.121186 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:01.121121 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" podStartSLOduration=2.121106112 podStartE2EDuration="2.121106112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:51:01.119641445 +0000 UTC m=+937.583838585" watchObservedRunningTime="2026-07-28 11:51:01.121106112 +0000 UTC m=+937.585303250" Jul 28 11:51:02.104986 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:02.104941 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" podUID="415af7ec-c745-4f34-b603-41cf26c4482c" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": dial tcp 10.134.0.25:28080: connect: connection refused" Jul 28 11:51:02.107754 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:02.107725 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" podUID="415af7ec-c745-4f34-b603-41cf26c4482c" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": dial tcp 10.134.0.25:28080: connect: connection refused" Jul 28 11:51:03.109374 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:03.109347 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:24.108270 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:24.108225 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" podUID="415af7ec-c745-4f34-b603-41cf26c4482c" containerName="node" probeResult="failure" output="Get \"http://10.134.0.25:28080/metrics\": dial tcp 10.134.0.25:28080: connect: connection refused" Jul 28 11:51:24.203105 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:24.203070 2559 generic.go:356] "Generic (PLEG): container finished" podID="415af7ec-c745-4f34-b603-41cf26c4482c" containerID="a35ed1439fe5ff0e70a3421b93adfec53ad74fdec04ee43f3cd415e0de28b001" exitCode=0 Jul 28 11:51:24.203327 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:24.203125 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" event={"ID":"415af7ec-c745-4f34-b603-41cf26c4482c","Type":"ContainerDied","Data":"a35ed1439fe5ff0e70a3421b93adfec53ad74fdec04ee43f3cd415e0de28b001"} Jul 28 11:51:25.347761 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:25.347735 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:25.482305 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:25.482208 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4pwd\" (UniqueName: \"kubernetes.io/projected/415af7ec-c745-4f34-b603-41cf26c4482c-kube-api-access-r4pwd\") pod \"415af7ec-c745-4f34-b603-41cf26c4482c\" (UID: \"415af7ec-c745-4f34-b603-41cf26c4482c\") " Jul 28 11:51:25.484282 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:25.484258 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415af7ec-c745-4f34-b603-41cf26c4482c-kube-api-access-r4pwd" (OuterVolumeSpecName: "kube-api-access-r4pwd") pod "415af7ec-c745-4f34-b603-41cf26c4482c" (UID: "415af7ec-c745-4f34-b603-41cf26c4482c"). InnerVolumeSpecName "kube-api-access-r4pwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:51:25.583025 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:25.582987 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4pwd\" (UniqueName: \"kubernetes.io/projected/415af7ec-c745-4f34-b603-41cf26c4482c-kube-api-access-r4pwd\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:51:26.213771 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:26.213739 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" event={"ID":"415af7ec-c745-4f34-b603-41cf26c4482c","Type":"ContainerDied","Data":"5be516ecbe9f43bd7a841164fd4423edcd693da6a1f65f03eff9943a2bcf349b"} Jul 28 11:51:26.213954 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:26.213790 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5be516ecbe9f43bd7a841164fd4423edcd693da6a1f65f03eff9943a2bcf349b" Jul 28 11:51:26.213954 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:26.213747 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm" Jul 28 11:51:34.041607 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.041570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:51:34.143346 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.143309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:51:34.965920 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.965886 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4"] Jul 28 11:51:34.966237 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.966225 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415af7ec-c745-4f34-b603-41cf26c4482c" containerName="node" Jul 28 11:51:34.966285 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.966240 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="415af7ec-c745-4f34-b603-41cf26c4482c" containerName="node" Jul 28 11:51:34.966320 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.966308 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="415af7ec-c745-4f34-b603-41cf26c4482c" containerName="node" Jul 28 11:51:34.968379 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.968349 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:51:34.969407 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.969392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:34.971623 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.971601 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xstnp\"/\"default-dockercfg-892xw\"" Jul 28 11:51:34.971722 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.971636 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"kube-root-ca.crt\"" Jul 28 11:51:34.971722 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.971706 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"openshift-service-ca.crt\"" Jul 28 11:51:34.981390 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:34.981370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4"] Jul 28 11:51:35.063971 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:35.063922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkk8m\" (UniqueName: \"kubernetes.io/projected/c00aae71-1c23-4b3a-bb4e-da8d5fb8497a-kube-api-access-fkk8m\") pod \"progression-invalid-node-0-0-467k4\" (UID: \"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a\") " pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:35.165229 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:35.165188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkk8m\" (UniqueName: \"kubernetes.io/projected/c00aae71-1c23-4b3a-bb4e-da8d5fb8497a-kube-api-access-fkk8m\") pod \"progression-invalid-node-0-0-467k4\" (UID: \"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a\") " pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:35.173972 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:35.173952 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkk8m\" (UniqueName: \"kubernetes.io/projected/c00aae71-1c23-4b3a-bb4e-da8d5fb8497a-kube-api-access-fkk8m\") pod \"progression-invalid-node-0-0-467k4\" (UID: \"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a\") " pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:35.279211 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:35.279146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:35.411018 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:35.410954 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4"] Jul 28 11:51:35.413454 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:51:35.413431 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00aae71_1c23_4b3a_bb4e_da8d5fb8497a.slice/crio-bc5c7a6f64ce8931edbee3f39568950e449bdc688724408ca950b951183f85c8 WatchSource:0}: Error finding container bc5c7a6f64ce8931edbee3f39568950e449bdc688724408ca950b951183f85c8: Status 404 returned error can't find the container with id bc5c7a6f64ce8931edbee3f39568950e449bdc688724408ca950b951183f85c8 Jul 28 11:51:36.258612 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:36.258569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" event={"ID":"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a","Type":"ContainerStarted","Data":"a09bae13a498658078ba3143d752dbc73fa3d0697100397088edbe7acf4e4b46"} Jul 28 11:51:36.259049 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:36.258635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" event={"ID":"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a","Type":"ContainerStarted","Data":"bc5c7a6f64ce8931edbee3f39568950e449bdc688724408ca950b951183f85c8"} Jul 28 11:51:36.259049 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:36.258664 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:36.280978 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:36.280917 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" podStartSLOduration=2.280896588 podStartE2EDuration="2.280896588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:51:36.280456303 +0000 UTC m=+972.744653439" watchObservedRunningTime="2026-07-28 11:51:36.280896588 +0000 UTC m=+972.745093728" Jul 28 11:51:37.261334 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:37.261305 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:50.014555 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:50.014460 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:51:50.556025 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:50.555984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:51:58.556861 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:58.556820 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" podUID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" containerName="node" probeResult="failure" output="Get \"http://10.134.0.26:28080/metrics\": read tcp 10.134.0.2:43734->10.134.0.26:28080: read: connection reset by peer" Jul 28 11:51:59.259565 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:59.259522 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" podUID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" containerName="node" probeResult="failure" output="Get \"http://10.134.0.26:28080/metrics\": dial tcp 10.134.0.26:28080: connect: connection refused" Jul 28 11:51:59.259752 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:59.259635 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:51:59.260206 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:59.260179 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" podUID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" containerName="node" probeResult="failure" output="Get \"http://10.134.0.26:28080/metrics\": dial tcp 10.134.0.26:28080: connect: connection refused" Jul 28 11:51:59.364449 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:59.364419 2559 generic.go:356] "Generic (PLEG): container finished" podID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" containerID="a09bae13a498658078ba3143d752dbc73fa3d0697100397088edbe7acf4e4b46" exitCode=0 Jul 28 11:51:59.364615 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:51:59.364487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" event={"ID":"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a","Type":"ContainerDied","Data":"a09bae13a498658078ba3143d752dbc73fa3d0697100397088edbe7acf4e4b46"} Jul 28 11:52:00.504237 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:00.504214 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:52:00.573298 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:00.573262 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkk8m\" (UniqueName: \"kubernetes.io/projected/c00aae71-1c23-4b3a-bb4e-da8d5fb8497a-kube-api-access-fkk8m\") pod \"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a\" (UID: \"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a\") " Jul 28 11:52:00.575326 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:00.575298 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00aae71-1c23-4b3a-bb4e-da8d5fb8497a-kube-api-access-fkk8m" (OuterVolumeSpecName: "kube-api-access-fkk8m") pod "c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" (UID: "c00aae71-1c23-4b3a-bb4e-da8d5fb8497a"). InnerVolumeSpecName "kube-api-access-fkk8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:52:00.674180 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:00.674073 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkk8m\" (UniqueName: \"kubernetes.io/projected/c00aae71-1c23-4b3a-bb4e-da8d5fb8497a-kube-api-access-fkk8m\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:52:01.379949 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:01.379916 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" Jul 28 11:52:01.379949 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:01.379946 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4" event={"ID":"c00aae71-1c23-4b3a-bb4e-da8d5fb8497a","Type":"ContainerDied","Data":"bc5c7a6f64ce8931edbee3f39568950e449bdc688724408ca950b951183f85c8"} Jul 28 11:52:01.380199 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:01.379988 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc5c7a6f64ce8931edbee3f39568950e449bdc688724408ca950b951183f85c8" Jul 28 11:52:30.753685 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:52:30.753647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:53:44.660203 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.660102 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:53:44.667492 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.667465 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h"] Jul 28 11:53:44.667826 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.667811 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" containerName="node" Jul 28 11:53:44.667826 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.667826 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" containerName="node" Jul 28 11:53:44.667975 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.667882 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" containerName="node" Jul 28 11:53:44.670823 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.670805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" Jul 28 11:53:44.673090 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.673068 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"openshift-service-ca.crt\"" Jul 28 11:53:44.673196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.673105 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xstnp\"/\"kube-root-ca.crt\"" Jul 28 11:53:44.673196 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.673138 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xstnp\"/\"default-dockercfg-892xw\"" Jul 28 11:53:44.682698 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.682675 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h"] Jul 28 11:53:44.770197 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.770137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4fv8\" (UniqueName: \"kubernetes.io/projected/c992ae36-996b-4249-8b95-f515f75bbde5-kube-api-access-n4fv8\") pod \"progression-no-metrics-node-0-0-8dl4h\" (UID: \"c992ae36-996b-4249-8b95-f515f75bbde5\") " pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" Jul 28 11:53:44.871355 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.871316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4fv8\" (UniqueName: \"kubernetes.io/projected/c992ae36-996b-4249-8b95-f515f75bbde5-kube-api-access-n4fv8\") pod \"progression-no-metrics-node-0-0-8dl4h\" (UID: \"c992ae36-996b-4249-8b95-f515f75bbde5\") " pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" Jul 28 11:53:44.879876 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.879842 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4fv8\" (UniqueName: \"kubernetes.io/projected/c992ae36-996b-4249-8b95-f515f75bbde5-kube-api-access-n4fv8\") pod \"progression-no-metrics-node-0-0-8dl4h\" (UID: \"c992ae36-996b-4249-8b95-f515f75bbde5\") " pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" Jul 28 11:53:44.979671 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:44.979592 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" Jul 28 11:53:45.110140 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:45.110115 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h"] Jul 28 11:53:45.112708 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:53:45.112679 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc992ae36_996b_4249_8b95_f515f75bbde5.slice/crio-93f61e2efd421ab8e7c7fa7922c426e137c26ed26293b9da996a1f2eb9548350 WatchSource:0}: Error finding container 93f61e2efd421ab8e7c7fa7922c426e137c26ed26293b9da996a1f2eb9548350: Status 404 returned error can't find the container with id 93f61e2efd421ab8e7c7fa7922c426e137c26ed26293b9da996a1f2eb9548350 Jul 28 11:53:45.853756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:45.853724 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" event={"ID":"c992ae36-996b-4249-8b95-f515f75bbde5","Type":"ContainerStarted","Data":"9902bbdc1fe06caa70131ccef543bca1f56c0accf3150442c3b4b59da3732102"} Jul 28 11:53:45.853756 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:45.853770 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" event={"ID":"c992ae36-996b-4249-8b95-f515f75bbde5","Type":"ContainerStarted","Data":"93f61e2efd421ab8e7c7fa7922c426e137c26ed26293b9da996a1f2eb9548350"} Jul 28 11:53:45.871333 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:45.871284 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" podStartSLOduration=1.8712675619999999 podStartE2EDuration="1.871267562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:53:45.87085264 +0000 UTC m=+1102.335049779" watchObservedRunningTime="2026-07-28 11:53:45.871267562 +0000 UTC m=+1102.335464707" Jul 28 11:53:50.882943 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:50.882902 2559 generic.go:356] "Generic (PLEG): container finished" podID="c992ae36-996b-4249-8b95-f515f75bbde5" containerID="9902bbdc1fe06caa70131ccef543bca1f56c0accf3150442c3b4b59da3732102" exitCode=0 Jul 28 11:53:50.883442 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:50.882976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" event={"ID":"c992ae36-996b-4249-8b95-f515f75bbde5","Type":"ContainerDied","Data":"9902bbdc1fe06caa70131ccef543bca1f56c0accf3150442c3b4b59da3732102"} Jul 28 11:53:52.020061 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:52.020034 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" Jul 28 11:53:52.134531 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:52.134504 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4fv8\" (UniqueName: \"kubernetes.io/projected/c992ae36-996b-4249-8b95-f515f75bbde5-kube-api-access-n4fv8\") pod \"c992ae36-996b-4249-8b95-f515f75bbde5\" (UID: \"c992ae36-996b-4249-8b95-f515f75bbde5\") " Jul 28 11:53:52.136519 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:52.136496 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c992ae36-996b-4249-8b95-f515f75bbde5-kube-api-access-n4fv8" (OuterVolumeSpecName: "kube-api-access-n4fv8") pod "c992ae36-996b-4249-8b95-f515f75bbde5" (UID: "c992ae36-996b-4249-8b95-f515f75bbde5"). InnerVolumeSpecName "kube-api-access-n4fv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:53:52.235851 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:52.235819 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4fv8\" (UniqueName: \"kubernetes.io/projected/c992ae36-996b-4249-8b95-f515f75bbde5-kube-api-access-n4fv8\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:53:52.894503 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:52.894473 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" Jul 28 11:53:52.894503 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:52.894482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h" event={"ID":"c992ae36-996b-4249-8b95-f515f75bbde5","Type":"ContainerDied","Data":"93f61e2efd421ab8e7c7fa7922c426e137c26ed26293b9da996a1f2eb9548350"} Jul 28 11:53:52.894765 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:52.894520 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93f61e2efd421ab8e7c7fa7922c426e137c26ed26293b9da996a1f2eb9548350" Jul 28 11:53:56.743989 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:56.743948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:53:57.033149 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.033113 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h7prc/must-gather-kxcln"] Jul 28 11:53:57.033489 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.033473 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c992ae36-996b-4249-8b95-f515f75bbde5" containerName="node" Jul 28 11:53:57.033489 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.033490 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c992ae36-996b-4249-8b95-f515f75bbde5" containerName="node" Jul 28 11:53:57.033577 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.033548 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c992ae36-996b-4249-8b95-f515f75bbde5" containerName="node" Jul 28 11:53:57.036773 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.036751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.039112 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.039079 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h7prc\"/\"default-dockercfg-8dr6k\"" Jul 28 11:53:57.039305 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.039285 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h7prc\"/\"kube-root-ca.crt\"" Jul 28 11:53:57.039432 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.039368 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:53:57.039857 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.039837 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h7prc\"/\"openshift-service-ca.crt\"" Jul 28 11:53:57.044067 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.044043 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h7prc/must-gather-kxcln"] Jul 28 11:53:57.072713 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.072683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b046540d-8fa7-44e1-b707-c3c9a447d9a4-must-gather-output\") pod \"must-gather-kxcln\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.072864 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.072745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c782g\" (UniqueName: \"kubernetes.io/projected/b046540d-8fa7-44e1-b707-c3c9a447d9a4-kube-api-access-c782g\") pod \"must-gather-kxcln\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.101776 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.101735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:53:57.174138 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.174104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c782g\" (UniqueName: \"kubernetes.io/projected/b046540d-8fa7-44e1-b707-c3c9a447d9a4-kube-api-access-c782g\") pod \"must-gather-kxcln\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.174350 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.174212 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b046540d-8fa7-44e1-b707-c3c9a447d9a4-must-gather-output\") pod \"must-gather-kxcln\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.174521 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.174505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b046540d-8fa7-44e1-b707-c3c9a447d9a4-must-gather-output\") pod \"must-gather-kxcln\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.182333 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.182315 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c782g\" (UniqueName: \"kubernetes.io/projected/b046540d-8fa7-44e1-b707-c3c9a447d9a4-kube-api-access-c782g\") pod \"must-gather-kxcln\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.348193 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.348085 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:53:57.477028 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.477001 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h7prc/must-gather-kxcln"] Jul 28 11:53:57.478922 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:53:57.478897 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb046540d_8fa7_44e1_b707_c3c9a447d9a4.slice/crio-26e4927af70a297003288bef2c9e766a09b55913b23afc5b315d435df70a1de0 WatchSource:0}: Error finding container 26e4927af70a297003288bef2c9e766a09b55913b23afc5b315d435df70a1de0: Status 404 returned error can't find the container with id 26e4927af70a297003288bef2c9e766a09b55913b23afc5b315d435df70a1de0 Jul 28 11:53:57.481028 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.481008 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 11:53:57.920278 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:53:57.920243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h7prc/must-gather-kxcln" event={"ID":"b046540d-8fa7-44e1-b707-c3c9a447d9a4","Type":"ContainerStarted","Data":"26e4927af70a297003288bef2c9e766a09b55913b23afc5b315d435df70a1de0"} Jul 28 11:54:01.734421 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.734386 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm"] Jul 28 11:54:01.737246 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.737217 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xstnp/progression-disabled-node-0-0-hh4dm"] Jul 28 11:54:01.742487 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.742459 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw"] Jul 28 11:54:01.746115 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.746085 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xstnp/progression-enabled-node-0-0-dgqtw"] Jul 28 11:54:01.752830 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.752802 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4"] Jul 28 11:54:01.756226 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.756196 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xstnp/progression-invalid-node-0-0-467k4"] Jul 28 11:54:01.774574 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.774542 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h"] Jul 28 11:54:01.776716 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:01.776682 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xstnp/progression-no-metrics-node-0-0-8dl4h"] Jul 28 11:54:02.125637 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:02.125598 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd0c913-cd67-47f6-99a3-f06903c34862" path="/var/lib/kubelet/pods/2fd0c913-cd67-47f6-99a3-f06903c34862/volumes" Jul 28 11:54:02.126047 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:02.126027 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415af7ec-c745-4f34-b603-41cf26c4482c" path="/var/lib/kubelet/pods/415af7ec-c745-4f34-b603-41cf26c4482c/volumes" Jul 28 11:54:02.126464 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:02.126447 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00aae71-1c23-4b3a-bb4e-da8d5fb8497a" path="/var/lib/kubelet/pods/c00aae71-1c23-4b3a-bb4e-da8d5fb8497a/volumes" Jul 28 11:54:02.126806 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:02.126792 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c992ae36-996b-4249-8b95-f515f75bbde5" path="/var/lib/kubelet/pods/c992ae36-996b-4249-8b95-f515f75bbde5/volumes" Jul 28 11:54:02.282435 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:02.282392 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:02.382940 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:02.382836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:02.701417 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:02.701324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:03.956100 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:03.956064 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h7prc/must-gather-kxcln" event={"ID":"b046540d-8fa7-44e1-b707-c3c9a447d9a4","Type":"ContainerStarted","Data":"9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3"} Jul 28 11:54:03.956100 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:03.956105 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h7prc/must-gather-kxcln" event={"ID":"b046540d-8fa7-44e1-b707-c3c9a447d9a4","Type":"ContainerStarted","Data":"7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d"} Jul 28 11:54:03.974413 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:03.974361 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h7prc/must-gather-kxcln" podStartSLOduration=0.854209806 podStartE2EDuration="6.974340744s" totalImagesPullingTime="6.120130938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 11:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:54:03.972663123 +0000 UTC m=+1120.436860276" watchObservedRunningTime="2026-07-28 11:54:03.974340744 +0000 UTC m=+1120.438537883" Jul 28 11:54:08.295918 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:08.295883 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:08.357310 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:08.357276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:13.562206 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:13.562149 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-75b6dd666-ff4pz_6f7cc64e-e7ff-4905-9ca3-fa10e84afed8/manager/0.log" Jul 28 11:54:14.036692 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:14.036648 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-75b6dd666-ff4pz_6f7cc64e-e7ff-4905-9ca3-fa10e84afed8/manager/0.log" Jul 28 11:54:14.568234 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:14.568193 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-75b6dd666-ff4pz_6f7cc64e-e7ff-4905-9ca3-fa10e84afed8/manager/0.log" Jul 28 11:54:51.211631 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:51.211596 2559 generic.go:356] "Generic (PLEG): container finished" podID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerID="7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d" exitCode=0 Jul 28 11:54:51.212097 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:51.211675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h7prc/must-gather-kxcln" event={"ID":"b046540d-8fa7-44e1-b707-c3c9a447d9a4","Type":"ContainerDied","Data":"7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d"} Jul 28 11:54:51.212097 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:51.211993 2559 scope.go:117] "RemoveContainer" containerID="7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d" Jul 28 11:54:51.691604 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:51.691572 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h7prc_must-gather-kxcln_b046540d-8fa7-44e1-b707-c3c9a447d9a4/gather/0.log" Jul 28 11:54:52.153283 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:52.153248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:52.319681 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:52.319643 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:52.421085 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:52.420996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:54.935785 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:54.935751 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4bcsv_a1798509-7230-4963-a154-f42bc2f7e21b/global-pull-secret-syncer/0.log" Jul 28 11:54:55.109135 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:55.109102 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" Jul 28 11:54:55.239223 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:55.239195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-238.ec2.internal_7f112d9abde8daeb5837b42f75048eeb/haproxy/0.log" Jul 28 11:54:57.177687 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.177583 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-h7prc/must-gather-kxcln"] Jul 28 11:54:57.178301 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.177819 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-h7prc/must-gather-kxcln" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerName="copy" containerID="cri-o://9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3" gracePeriod=2 Jul 28 11:54:57.179269 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.179245 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-h7prc/must-gather-kxcln"] Jul 28 11:54:57.179854 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:54:57.179820 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kxcln\" is forbidden: User \"system:node:ip-10-0-132-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h7prc\": no relationship found between node 'ip-10-0-132-238.ec2.internal' and this object" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:54:57.414919 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.414893 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h7prc_must-gather-kxcln_b046540d-8fa7-44e1-b707-c3c9a447d9a4/copy/0.log" Jul 28 11:54:57.417480 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.417456 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:54:57.419508 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:54:57.419481 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kxcln\" is forbidden: User \"system:node:ip-10-0-132-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-h7prc\": no relationship found between node 'ip-10-0-132-238.ec2.internal' and this object" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:54:57.534330 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.534291 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c782g\" (UniqueName: \"kubernetes.io/projected/b046540d-8fa7-44e1-b707-c3c9a447d9a4-kube-api-access-c782g\") pod \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " Jul 28 11:54:57.534508 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.534350 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b046540d-8fa7-44e1-b707-c3c9a447d9a4-must-gather-output\") pod \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\" (UID: \"b046540d-8fa7-44e1-b707-c3c9a447d9a4\") " Jul 28 11:54:57.536534 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.536507 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b046540d-8fa7-44e1-b707-c3c9a447d9a4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b046540d-8fa7-44e1-b707-c3c9a447d9a4" (UID: "b046540d-8fa7-44e1-b707-c3c9a447d9a4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 11:54:57.536616 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.536539 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b046540d-8fa7-44e1-b707-c3c9a447d9a4-kube-api-access-c782g" (OuterVolumeSpecName: "kube-api-access-c782g") pod "b046540d-8fa7-44e1-b707-c3c9a447d9a4" (UID: "b046540d-8fa7-44e1-b707-c3c9a447d9a4"). InnerVolumeSpecName "kube-api-access-c782g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 11:54:57.635205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.635147 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c782g\" (UniqueName: \"kubernetes.io/projected/b046540d-8fa7-44e1-b707-c3c9a447d9a4-kube-api-access-c782g\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:54:57.635205 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.635202 2559 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b046540d-8fa7-44e1-b707-c3c9a447d9a4-must-gather-output\") on node \"ip-10-0-132-238.ec2.internal\" DevicePath \"\"" Jul 28 11:54:57.868936 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.868849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:57.928792 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:57.928749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4jcsx_4061bfa3-be9d-4daf-b83a-37ea9e7b8f05/konnectivity-agent/0.log" limit=1024 Jul 28 11:54:58.124206 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.124113 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" path="/var/lib/kubelet/pods/b046540d-8fa7-44e1-b707-c3c9a447d9a4/volumes" Jul 28 11:54:58.244224 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.244195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-h7prc_must-gather-kxcln_b046540d-8fa7-44e1-b707-c3c9a447d9a4/copy/0.log" Jul 28 11:54:58.244626 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.244537 2559 generic.go:356] "Generic (PLEG): container finished" podID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerID="9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3" exitCode=143 Jul 28 11:54:58.244626 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.244580 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h7prc/must-gather-kxcln" Jul 28 11:54:58.245056 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.244636 2559 scope.go:117] "RemoveContainer" containerID="9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3" Jul 28 11:54:58.252499 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.252481 2559 scope.go:117] "RemoveContainer" containerID="7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d" Jul 28 11:54:58.266477 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.266448 2559 scope.go:117] "RemoveContainer" containerID="9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3" Jul 28 11:54:58.266798 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:54:58.266773 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3\": container with ID starting with 9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3 not found: ID does not exist" containerID="9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3" Jul 28 11:54:58.266848 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.266810 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3"} err="failed to get container status \"9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3\": rpc error: code = NotFound desc = could not find container \"9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3\": container with ID starting with 9bb29e4b4c2f4bf1be1a405bdbe40bbb0bc0cea9eaffca3b5b67b0129c9528b3 not found: ID does not exist" Jul 28 11:54:58.266848 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.266831 2559 scope.go:117] "RemoveContainer" containerID="7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d" Jul 28 11:54:58.267115 ip-10-0-132-238 kubenswrapper[2559]: E0728 11:54:58.267095 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d\": container with ID starting with 7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d not found: ID does not exist" containerID="7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d" Jul 28 11:54:58.267174 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:58.267122 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d"} err="failed to get container status \"7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d\": rpc error: code = NotFound desc = could not find container \"7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d\": container with ID starting with 7c436be6e1d7decf3f8dd5da5491d299c8682bd3dba4eeaed0342b6adddf428d not found: ID does not exist" Jul 28 11:54:59.293035 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.293006 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c09dd0e-c23c-4266-9900-5c4f26b046ff/alertmanager/0.log" Jul 28 11:54:59.317395 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.317359 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c09dd0e-c23c-4266-9900-5c4f26b046ff/config-reloader/0.log" Jul 28 11:54:59.347730 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.347703 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c09dd0e-c23c-4266-9900-5c4f26b046ff/kube-rbac-proxy-web/0.log" Jul 28 11:54:59.372656 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.372631 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c09dd0e-c23c-4266-9900-5c4f26b046ff/kube-rbac-proxy/0.log" Jul 28 11:54:59.400566 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.400540 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c09dd0e-c23c-4266-9900-5c4f26b046ff/kube-rbac-proxy-metric/0.log" Jul 28 11:54:59.425207 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.425175 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c09dd0e-c23c-4266-9900-5c4f26b046ff/prom-label-proxy/0.log" Jul 28 11:54:59.451813 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.451786 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c09dd0e-c23c-4266-9900-5c4f26b046ff/init-config-reloader/0.log" Jul 28 11:54:59.573891 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.573810 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zhhrr_ec71652e-6c9e-4007-a92f-354a25b8bda2/kube-state-metrics/0.log" Jul 28 11:54:59.618743 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.618709 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zhhrr_ec71652e-6c9e-4007-a92f-354a25b8bda2/kube-rbac-proxy-main/0.log" Jul 28 11:54:59.645661 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.645630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zhhrr_ec71652e-6c9e-4007-a92f-354a25b8bda2/kube-rbac-proxy-self/0.log" Jul 28 11:54:59.678869 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.678841 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-754bbc95c7-ntkw2_70f28518-1cbf-4f2c-adcc-e1aa104bf510/metrics-server/0.log" Jul 28 11:54:59.715867 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.715837 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-pn67k_cc29749f-c6aa-44d3-8271-b9a6ce50e8c0/monitoring-plugin/0.log" Jul 28 11:54:59.847799 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.847725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dztz_e977f255-d8e9-46e0-906c-70505f0610fc/node-exporter/0.log" Jul 28 11:54:59.874471 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.874445 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dztz_e977f255-d8e9-46e0-906c-70505f0610fc/kube-rbac-proxy/0.log" Jul 28 11:54:59.901552 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:54:59.901528 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dztz_e977f255-d8e9-46e0-906c-70505f0610fc/init-textfile/0.log" Jul 28 11:55:00.026055 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.026018 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-t6v4m_196f824d-bdad-4c7b-b3d7-62522d631e64/kube-rbac-proxy-main/0.log" Jul 28 11:55:00.065732 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.065699 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-t6v4m_196f824d-bdad-4c7b-b3d7-62522d631e64/kube-rbac-proxy-self/0.log" Jul 28 11:55:00.095138 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.095105 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-t6v4m_196f824d-bdad-4c7b-b3d7-62522d631e64/openshift-state-metrics/0.log" Jul 28 11:55:00.163347 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.163263 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3b3cc17-6aa3-495a-9727-8f0272c92fce/prometheus/0.log" Jul 28 11:55:00.202492 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.202459 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3b3cc17-6aa3-495a-9727-8f0272c92fce/config-reloader/0.log" Jul 28 11:55:00.234106 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.234077 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3b3cc17-6aa3-495a-9727-8f0272c92fce/thanos-sidecar/0.log" Jul 28 11:55:00.273588 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.273565 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3b3cc17-6aa3-495a-9727-8f0272c92fce/kube-rbac-proxy-web/0.log" Jul 28 11:55:00.307510 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.307480 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3b3cc17-6aa3-495a-9727-8f0272c92fce/kube-rbac-proxy/0.log" Jul 28 11:55:00.337832 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.337802 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3b3cc17-6aa3-495a-9727-8f0272c92fce/kube-rbac-proxy-thanos/0.log" Jul 28 11:55:00.382079 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.382042 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e3b3cc17-6aa3-495a-9727-8f0272c92fce/init-config-reloader/0.log" Jul 28 11:55:00.418959 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.418869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-9k87k_a5deee8c-3a54-4aa0-b036-ae97b8934861/prometheus-operator/0.log" Jul 28 11:55:00.448228 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.448201 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-9k87k_a5deee8c-3a54-4aa0-b036-ae97b8934861/kube-rbac-proxy/0.log" Jul 28 11:55:00.621105 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.621070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84bc9d64fc-cb9nv_2948cd7a-a676-4ef5-960c-137f45ca3e88/thanos-query/0.log" Jul 28 11:55:00.647563 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.647538 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84bc9d64fc-cb9nv_2948cd7a-a676-4ef5-960c-137f45ca3e88/kube-rbac-proxy-web/0.log" Jul 28 11:55:00.676042 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.675966 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84bc9d64fc-cb9nv_2948cd7a-a676-4ef5-960c-137f45ca3e88/kube-rbac-proxy/0.log" Jul 28 11:55:00.698845 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.698816 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84bc9d64fc-cb9nv_2948cd7a-a676-4ef5-960c-137f45ca3e88/prom-label-proxy/0.log" Jul 28 11:55:00.727461 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.727430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84bc9d64fc-cb9nv_2948cd7a-a676-4ef5-960c-137f45ca3e88/kube-rbac-proxy-rules/0.log" Jul 28 11:55:00.750477 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:00.750455 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84bc9d64fc-cb9nv_2948cd7a-a676-4ef5-960c-137f45ca3e88/kube-rbac-proxy-metrics/0.log" Jul 28 11:55:02.824918 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.824874 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf"] Jul 28 11:55:02.825441 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.825370 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerName="gather" Jul 28 11:55:02.825441 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.825389 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerName="gather" Jul 28 11:55:02.825441 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.825416 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerName="copy" Jul 28 11:55:02.825441 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.825424 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerName="copy" Jul 28 11:55:02.825657 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.825513 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerName="gather" Jul 28 11:55:02.825657 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.825528 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b046540d-8fa7-44e1-b707-c3c9a447d9a4" containerName="copy" Jul 28 11:55:02.830788 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.830762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.833207 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.833185 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qn8hn\"/\"kube-root-ca.crt\"" Jul 28 11:55:02.834009 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.833978 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qn8hn\"/\"openshift-service-ca.crt\"" Jul 28 11:55:02.834120 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.833978 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qn8hn\"/\"default-dockercfg-krzlh\"" Jul 28 11:55:02.836526 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.836503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf"] Jul 28 11:55:02.880495 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.880458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-proc\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.880495 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.880501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-lib-modules\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.880715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.880523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-podres\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.880715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.880630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-sys\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.880715 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.880657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zqh5\" (UniqueName: \"kubernetes.io/projected/7739c74c-a68a-4eb6-aad1-ea155c34f952-kube-api-access-4zqh5\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.981782 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-proc\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.981782 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981787 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-lib-modules\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.982011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-podres\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.982011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981867 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-sys\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.982011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981882 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-proc\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.982011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zqh5\" (UniqueName: \"kubernetes.io/projected/7739c74c-a68a-4eb6-aad1-ea155c34f952-kube-api-access-4zqh5\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.982011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981953 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-sys\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.982011 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.981953 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-lib-modules\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.982257 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.982023 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7739c74c-a68a-4eb6-aad1-ea155c34f952-podres\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:02.989857 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:02.989838 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zqh5\" (UniqueName: \"kubernetes.io/projected/7739c74c-a68a-4eb6-aad1-ea155c34f952-kube-api-access-4zqh5\") pod \"perf-node-gather-daemonset-9cgtf\" (UID: \"7739c74c-a68a-4eb6-aad1-ea155c34f952\") " pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:03.141917 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:03.141826 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:03.275637 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:03.275606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf"] Jul 28 11:55:03.277971 ip-10-0-132-238 kubenswrapper[2559]: W0728 11:55:03.277945 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7739c74c_a68a_4eb6_aad1_ea155c34f952.slice/crio-ad69ae4d433caf3683c98ebbe51b16ab3ac9cff41e1b408c9e17f9cafa38e9fc WatchSource:0}: Error finding container ad69ae4d433caf3683c98ebbe51b16ab3ac9cff41e1b408c9e17f9cafa38e9fc: Status 404 returned error can't find the container with id ad69ae4d433caf3683c98ebbe51b16ab3ac9cff41e1b408c9e17f9cafa38e9fc Jul 28 11:55:04.071040 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.071011 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kgjrh_2a8c8966-86b1-4767-9e9b-27b2c10a80f8/dns/0.log" Jul 28 11:55:04.091431 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.091400 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kgjrh_2a8c8966-86b1-4767-9e9b-27b2c10a80f8/kube-rbac-proxy/0.log" Jul 28 11:55:04.157912 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.157884 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-544np_732aea48-b74a-4438-aa34-fafb50d63ca3/dns-node-resolver/0.log" Jul 28 11:55:04.275908 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.275857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" event={"ID":"7739c74c-a68a-4eb6-aad1-ea155c34f952","Type":"ContainerStarted","Data":"15beb2ef0242bf5db45797211bd64cb10b93faa8d689dadd7a92e19b3be6e5d2"} Jul 28 11:55:04.276113 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.276001 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:04.276113 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.276043 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" event={"ID":"7739c74c-a68a-4eb6-aad1-ea155c34f952","Type":"ContainerStarted","Data":"ad69ae4d433caf3683c98ebbe51b16ab3ac9cff41e1b408c9e17f9cafa38e9fc"} Jul 28 11:55:04.292207 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.292138 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" podStartSLOduration=2.292122241 podStartE2EDuration="2.292122241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 11:55:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 11:55:04.291525203 +0000 UTC m=+1180.755722344" watchObservedRunningTime="2026-07-28 11:55:04.292122241 +0000 UTC m=+1180.756319388" Jul 28 11:55:04.691922 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:04.691891 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfk5s_8c82ae1b-b46c-4697-bdb7-6bf5a09eae2c/node-ca/0.log" Jul 28 11:55:05.785045 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:05.785012 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brkml_bf7c1600-ee13-496d-83d0-fbcbfe084204/serve-healthcheck-canary/0.log" Jul 28 11:55:06.293452 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:06.293421 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xpndg_ce9a3f0b-af02-466a-a731-65c6f1c93e0b/kube-rbac-proxy/0.log" Jul 28 11:55:06.314759 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:06.314725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xpndg_ce9a3f0b-af02-466a-a731-65c6f1c93e0b/exporter/0.log" Jul 28 11:55:06.337483 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:06.337450 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xpndg_ce9a3f0b-af02-466a-a731-65c6f1c93e0b/extractor/0.log" Jul 28 11:55:07.979578 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:07.979547 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-mhww6_5be2f67b-ae80-46cb-882e-fc0bb96c25a0/jobset-operator/0.log" Jul 28 11:55:10.290426 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:10.290400 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qn8hn/perf-node-gather-daemonset-9cgtf" Jul 28 11:55:13.006317 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.006293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf2bz_041cee35-562a-4db0-a574-f6271c12f721/kube-multus-additional-cni-plugins/0.log" Jul 28 11:55:13.029995 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.029965 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf2bz_041cee35-562a-4db0-a574-f6271c12f721/egress-router-binary-copy/0.log" Jul 28 11:55:13.051660 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.051631 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf2bz_041cee35-562a-4db0-a574-f6271c12f721/cni-plugins/0.log" Jul 28 11:55:13.072530 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.072499 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf2bz_041cee35-562a-4db0-a574-f6271c12f721/bond-cni-plugin/0.log" Jul 28 11:55:13.102779 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.102750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf2bz_041cee35-562a-4db0-a574-f6271c12f721/routeoverride-cni/0.log" Jul 28 11:55:13.141894 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.141866 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf2bz_041cee35-562a-4db0-a574-f6271c12f721/whereabouts-cni-bincopy/0.log" Jul 28 11:55:13.176538 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.176506 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf2bz_041cee35-562a-4db0-a574-f6271c12f721/whereabouts-cni/0.log" Jul 28 11:55:13.587630 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.587537 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c5swf_57790825-368f-4eab-a1af-27e76d3c24ea/kube-multus/0.log" Jul 28 11:55:13.642798 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.642767 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27s5h_3861a753-509b-4421-9d6b-157dd144bfd1/network-metrics-daemon/0.log" Jul 28 11:55:13.664048 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:13.664018 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27s5h_3861a753-509b-4421-9d6b-157dd144bfd1/kube-rbac-proxy/0.log" Jul 28 11:55:14.603843 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.603813 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/ovn-controller/0.log" Jul 28 11:55:14.620120 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.620091 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/ovn-acl-logging/0.log" Jul 28 11:55:14.643745 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.643720 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/kube-rbac-proxy-node/0.log" Jul 28 11:55:14.665233 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.665203 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 11:55:14.685660 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.685630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/northd/0.log" Jul 28 11:55:14.708358 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.708328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/nbdb/0.log" Jul 28 11:55:14.729328 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.729297 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/sbdb/0.log" Jul 28 11:55:14.782796 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:14.782763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vjzj_f08dfc9d-9470-4c4b-b071-c0efd0794d6a/ovnkube-controller/0.log" Jul 28 11:55:16.343108 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:16.343080 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7bkvm_538e4919-e20e-46e3-8453-2702feeac868/network-check-target-container/0.log" Jul 28 11:55:17.478679 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:17.478642 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-p7z8f_eae05074-07f0-49ee-a307-2c481baa8e2e/iptables-alerter/0.log" Jul 28 11:55:18.255101 ip-10-0-132-238 kubenswrapper[2559]: I0728 11:55:18.255067 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gfpmh_b1fe3b6a-b2b7-4548-aede-62346dbcfd25/tuned/0.log"