Jul 07 02:15:48.070933 ip-10-0-133-208 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 02:15:48.070945 ip-10-0-133-208 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 02:15:48.070954 ip-10-0-133-208 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 02:15:48.071269 ip-10-0-133-208 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 02:15:58.150364 ip-10-0-133-208 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 02:15:58.150380 ip-10-0-133-208 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d10ab779fc13495e8506003355e646cb -- Jul 07 02:17:23.802816 ip-10-0-133-208 systemd[1]: Starting Kubernetes Kubelet... Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.263699 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270784 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270795 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270799 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270803 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270806 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270810 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270813 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:17:24.300273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270816 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270818 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270821 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270824 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270827 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270829 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270832 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270834 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270837 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270840 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270850 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270854 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270858 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270860 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270863 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270866 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270869 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270873 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270876 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:17:24.303691 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270879 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270882 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270885 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270888 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270892 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270895 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270898 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270901 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270904 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270907 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270910 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270912 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270915 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270918 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270920 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270924 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270926 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270929 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270932 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:17:24.316963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270934 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270937 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270939 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270942 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270945 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270947 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270950 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270952 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270955 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270957 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270960 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270962 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270965 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270968 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270970 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270973 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270975 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270978 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270980 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270983 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:17:24.318279 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270985 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270988 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270990 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270993 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270996 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.270998 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271002 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271005 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271007 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271011 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271014 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271016 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271019 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271021 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271024 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271027 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271029 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271032 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271035 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271037 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:17:24.332220 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271040 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271042 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271045 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271962 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271969 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271974 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271978 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271981 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271984 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271987 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271990 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271993 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271996 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.271999 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272663 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272669 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272674 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272677 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272680 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272683 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:17:24.335283 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272686 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272688 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272692 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272695 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272698 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272700 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272703 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272705 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272708 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272711 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272713 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272716 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272719 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272721 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272724 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272726 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272728 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272731 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272733 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:17:24.349904 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272737 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272740 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272743 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272746 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272748 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272751 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272753 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272756 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272758 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272761 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272764 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272766 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272771 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272775 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272780 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272784 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272787 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272790 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272792 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:17:24.574173 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272795 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:17:24.348161 ip-10-0-133-208 systemd[1]: Started Kubernetes Kubelet. Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272798 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272801 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272804 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272806 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272809 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272811 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272814 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272816 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272819 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272821 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272823 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272826 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272828 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272831 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272834 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272836 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272839 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272841 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272844 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:17:24.591566 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272847 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272850 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272853 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272855 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272858 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272860 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272863 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272866 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272868 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272871 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272874 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272876 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272879 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272881 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272884 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272886 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272889 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272891 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272893 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272896 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:17:24.598554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272899 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272901 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272904 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272906 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272909 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272912 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272914 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272917 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272921 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272924 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272927 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272929 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272932 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272934 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.272937 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273273 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273278 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273281 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273283 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273286 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273289 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:17:24.599863 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273292 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273295 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273297 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273300 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273302 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273305 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273308 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273310 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273313 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273315 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273318 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273320 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273323 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273325 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273328 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273330 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273334 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273336 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273339 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273344 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:17:24.600977 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273347 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273350 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273352 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273355 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273357 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273360 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273363 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273365 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273368 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273371 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273373 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273376 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273379 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273381 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273384 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273387 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273391 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273394 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273397 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:17:24.602090 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273399 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273402 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273406 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273411 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273414 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273417 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273420 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273423 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273425 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273428 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273430 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273433 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273436 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273439 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273442 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273444 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273447 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273449 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273452 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:17:24.602988 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273454 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273457 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273459 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273462 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273464 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273468 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273472 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273475 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273477 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273480 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273484 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273486 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273489 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273491 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273494 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273498 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273500 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273502 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273505 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:17:24.603894 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273507 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273510 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273513 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273515 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273517 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273520 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273524 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273527 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273545 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273548 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273551 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273553 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273556 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273558 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273561 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.273563 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273626 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273633 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273643 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273656 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273660 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273663 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 02:17:24.604781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273668 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273671 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273674 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273677 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273680 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273684 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273688 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273691 2572 flags.go:64] FLAG: --cgroup-root="" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273694 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273697 2572 flags.go:64] FLAG: --client-ca-file="" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273700 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273703 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273707 2572 flags.go:64] FLAG: --cluster-domain="" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273709 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273712 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273715 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273720 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273724 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273726 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273729 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273732 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273736 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273738 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273741 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 02:17:24.605883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273744 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273747 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273751 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273754 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273757 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273760 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273762 2572 flags.go:64] FLAG: --enable-server="true" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273766 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273771 2572 flags.go:64] FLAG: --event-burst="100" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273774 2572 flags.go:64] FLAG: --event-qps="50" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273776 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273779 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273782 2572 flags.go:64] FLAG: --eviction-hard="" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273785 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273789 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273792 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273795 2572 flags.go:64] FLAG: --eviction-soft="" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273798 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273801 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273804 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273806 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273809 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273812 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273815 2572 flags.go:64] FLAG: --feature-gates="" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273820 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 02:17:24.606978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273823 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273826 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273829 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273832 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273835 2572 flags.go:64] FLAG: --help="false" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273838 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273841 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273844 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273847 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273850 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273854 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273856 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273859 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273862 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273865 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273868 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273871 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273873 2572 flags.go:64] FLAG: --kube-reserved="" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273876 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273879 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273882 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273886 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273889 2572 flags.go:64] FLAG: --lock-file="" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273891 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 02:17:24.608322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273895 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273897 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273902 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273905 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273908 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273911 2572 flags.go:64] FLAG: --logging-format="text" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273913 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273919 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273921 2572 flags.go:64] FLAG: --manifest-url="" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273924 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273928 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273931 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273935 2572 flags.go:64] FLAG: --max-pods="110" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273938 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273941 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273944 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273946 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273950 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273952 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273955 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273962 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273965 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273968 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 02:17:24.609445 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273971 2572 flags.go:64] FLAG: --pod-cidr="" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273974 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273979 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273982 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273985 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273988 2572 flags.go:64] FLAG: --port="10250" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273992 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273995 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef68dc82af919e3a" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.273998 2572 flags.go:64] FLAG: --qos-reserved="" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274001 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274004 2572 flags.go:64] FLAG: --register-node="true" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274007 2572 flags.go:64] FLAG: --register-with-taints="" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274010 2572 flags.go:64] FLAG: --registry-burst="10" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274013 2572 flags.go:64] FLAG: --registry-qps="5" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274016 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274019 2572 flags.go:64] FLAG: --reserved-memory="" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274022 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274027 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274030 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274033 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274036 2572 flags.go:64] FLAG: --runonce="false" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274038 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274041 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274044 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274047 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 02:17:24.610563 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274050 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274053 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274055 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274058 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274061 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274064 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274067 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274070 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274073 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274076 2572 flags.go:64] FLAG: --system-cgroups="" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274079 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274084 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274086 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274090 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274094 2572 flags.go:64] FLAG: --tls-min-version="" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274097 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274100 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274102 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274105 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274108 2572 flags.go:64] FLAG: --v="2" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274112 2572 flags.go:64] FLAG: --version="false" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274115 2572 flags.go:64] FLAG: --vmodule="" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274118 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.274122 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 02:17:24.611685 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274239 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274244 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274248 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274251 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274254 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274256 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274260 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274264 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274267 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274269 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274272 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274275 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274277 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274280 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274282 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274285 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274288 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274290 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274293 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:17:24.612791 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274296 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274298 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274302 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274305 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274307 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274310 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274312 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274315 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274318 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274320 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274323 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274325 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274328 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274332 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274334 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274337 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274339 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274342 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274345 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274347 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:17:24.613877 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274350 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274352 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274355 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274358 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274360 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274363 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274365 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274369 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274372 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274375 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274378 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274381 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274384 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274386 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274390 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274394 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274397 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274400 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274403 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:17:24.614766 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274405 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274408 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274411 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274413 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274416 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274418 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274422 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274425 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274427 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274430 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274432 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274435 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274437 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274440 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274443 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274445 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274448 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274450 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274453 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274456 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:17:24.615857 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274458 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274461 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274463 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274466 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274468 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274471 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274474 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274477 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274480 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274482 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274485 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274487 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274490 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274492 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274495 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274497 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274500 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274502 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274506 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274509 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:17:24.616753 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.274511 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.275199 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.281837 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.281849 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.282714 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.282721 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282775 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282780 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282783 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282786 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282789 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282791 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282794 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282797 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282800 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:17:24.617626 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282803 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282805 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282808 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282812 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282815 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282818 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282821 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282824 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282826 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282829 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282832 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282834 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282837 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282843 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282846 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282849 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282852 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282855 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282857 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282860 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:17:24.618285 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282862 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282867 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282869 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282872 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282874 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282877 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282879 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282882 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282884 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282887 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282889 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282892 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282897 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282900 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282903 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282906 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282910 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282912 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282916 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:17:24.621471 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282919 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282921 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282924 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282927 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282930 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282933 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282938 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282941 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282944 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282946 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282949 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282952 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282954 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282957 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282960 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282964 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282968 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282971 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282973 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282977 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:17:24.842061 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282979 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282982 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282984 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282987 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282989 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282992 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282994 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.282997 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283000 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283002 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283005 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283008 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283010 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283013 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283015 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283018 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283020 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283023 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283026 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283029 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:17:24.845955 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283031 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283034 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283036 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283039 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283042 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283044 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283048 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283050 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283055 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283058 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283062 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.283067 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283168 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283173 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 02:17:24.846579 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283177 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283180 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283183 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283186 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283189 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283192 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283194 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283196 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283199 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283202 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283204 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283207 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283210 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283212 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283215 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283217 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283229 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283233 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283237 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283241 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 02:17:24.846978 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283244 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283249 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283252 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283256 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283259 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283263 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283266 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283269 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283272 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283277 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283282 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283286 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283291 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283295 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283299 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283303 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283306 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283310 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283314 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 02:17:24.847572 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283318 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283322 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283325 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283330 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283334 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283338 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283342 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283345 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283349 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283354 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283357 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283361 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283365 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283369 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283373 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283377 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283381 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283384 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283389 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283393 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 02:17:24.848080 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283396 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283400 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283404 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283408 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283411 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283415 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283418 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283422 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283425 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283431 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283435 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283439 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283444 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283447 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283451 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283454 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283458 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283462 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283466 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 02:17:24.848656 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283470 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283473 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283478 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283482 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283486 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283489 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283493 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283496 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283498 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283501 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283504 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283509 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283513 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283516 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283520 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283524 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283528 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283550 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 02:17:24.849157 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:24.283554 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.283561 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.283690 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.286378 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.288012 2572 server.go:1019] "Starting client certificate rotation" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.288103 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.288133 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.293206 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.294323 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.309114 2572 log.go:25] "Validated CRI v1 runtime API" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.311463 2572 log.go:25] "Validated CRI v1 image API" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.312212 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 02:17:24.849694 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.317105 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 02:17:24.850041 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.317282 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a88b88ee-99cc-47fb-8cb8-e848da89f987:/dev/nvme0n1p4 fd365f54-8588-4154-a3d1-4ea731ff20bf:/dev/nvme0n1p3] Jul 07 02:17:24.850041 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.317296 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.324082 2572 manager.go:216] Machine: {Timestamp:2026-07-07 02:17:24.322681889 +0000 UTC m=+0.392770838 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098160 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bbbf6c7c9c8123840526f91f61b9c SystemUUID:ec2bbbf6-c7c9-c812-3840-526f91f61b9c BootID:d10ab779-fc13-495e-8506-003355e646cb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:3a:0a:04:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:3a:0a:04:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:1e:15:6a:9a:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.324172 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.324235 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.327600 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.327624 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-208.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.328484 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.328493 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.328500 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.328513 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.330473 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.335322 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.335492 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.335549 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.335572 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.335592 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.335605 2572 kubelet.go:398] "Adding apiserver pod source" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.335619 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 02:17:24.850209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.336022 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.336050 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.338508 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.341674 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.341703 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344582 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344597 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344603 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344608 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344617 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344622 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344630 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344635 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344641 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344646 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344654 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344660 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344684 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.344689 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.346562 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-208.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.346604 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.346645 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.347566 2572 server.go:1268] "Started kubelet" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.347875 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.349892 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.349981 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.350488 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.351387 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.356185 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.359305 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.359317 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.359403 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360072 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360088 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360071 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360089 2572 factory.go:55] Registering systemd factory Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360183 2572 factory.go:223] Registration of the systemd container factory successfully Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360196 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360203 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360407 2572 factory.go:153] Registering CRI-O factory Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360417 2572 factory.go:223] Registration of the crio container factory successfully Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360458 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360474 2572 factory.go:103] Registering Raw factory Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360483 2572 manager.go:1196] Started watching for new ooms in manager Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.360807 2572 manager.go:349] Starting recovery of all containers Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.364842 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6nhmd" Jul 07 02:17:24.850818 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.368029 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.368119 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.368737 2572 manager.go:354] Recovery completed Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.368175 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-208.ec2.internal.18bfe0579c16dac6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-208.ec2.internal,UID:ip-10-0-133-208.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-208.ec2.internal,},FirstTimestamp:2026-07-07 02:17:24.34752583 +0000 UTC m=+0.417614777,LastTimestamp:2026-07-07 02:17:24.34752583 +0000 UTC m=+0.417614777,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-208.ec2.internal,}" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.373321 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6nhmd" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.375881 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.377456 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.377477 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.377487 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.378012 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.378021 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.378023 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.378035 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.378631 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.378653 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.378662 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.380007 2572 policy_none.go:49] "None policy: Start" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.380020 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.380029 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.382548 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-208.ec2.internal.18bfe0579ddfb126 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-208.ec2.internal,UID:ip-10-0-133-208.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-208.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-208.ec2.internal,},FirstTimestamp:2026-07-07 02:17:24.377465126 +0000 UTC m=+0.447554073,LastTimestamp:2026-07-07 02:17:24.377465126 +0000 UTC m=+0.447554073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-208.ec2.internal,}" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.383424 2572 policy_none.go:47] "Start" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.435061 2572 manager.go:337] "Starting Device Plugin manager" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.435092 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.435101 2572 server.go:87] "Starting device plugin registration server" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.435288 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.435301 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.435368 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.435437 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.435445 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.435933 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.435975 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.447882 2572 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2605 into the system container \"/system.slice\": " Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.535793 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:17:24.852017 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.536507 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.536545 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.536557 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.536577 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.544243 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.544259 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-208.ec2.internal\": node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.575465 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.586760 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.587964 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.587999 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.588020 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.588053 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.589778 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.676043 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.688139 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal"] Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.688195 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.689920 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.689950 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.689963 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.692272 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.692373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.692409 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.692910 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.692929 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.692942 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.692989 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.693012 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.693021 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.695205 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.695240 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.695936 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientMemory" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.695955 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.695964 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeHasSufficientPID" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.712029 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-208.ec2.internal\" not found" node="ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.716344 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-208.ec2.internal\" not found" node="ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.762376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4543640466c227ebbf03ecd671a63604-config\") pod \"kube-apiserver-proxy-ip-10-0-133-208.ec2.internal\" (UID: \"4543640466c227ebbf03ecd671a63604\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.852948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.762401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ce5c02dbcd5a3d6c0da9867788a4490-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal\" (UID: \"7ce5c02dbcd5a3d6c0da9867788a4490\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.853888 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.762418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ce5c02dbcd5a3d6c0da9867788a4490-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal\" (UID: \"7ce5c02dbcd5a3d6c0da9867788a4490\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:24.853888 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.776466 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.862818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ce5c02dbcd5a3d6c0da9867788a4490-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal\" (UID: \"7ce5c02dbcd5a3d6c0da9867788a4490\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.862833 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ce5c02dbcd5a3d6c0da9867788a4490-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal\" (UID: \"7ce5c02dbcd5a3d6c0da9867788a4490\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.862852 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ce5c02dbcd5a3d6c0da9867788a4490-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal\" (UID: \"7ce5c02dbcd5a3d6c0da9867788a4490\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.862869 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4543640466c227ebbf03ecd671a63604-config\") pod \"kube-apiserver-proxy-ip-10-0-133-208.ec2.internal\" (UID: \"4543640466c227ebbf03ecd671a63604\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.862901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4543640466c227ebbf03ecd671a63604-config\") pod \"kube-apiserver-proxy-ip-10-0-133-208.ec2.internal\" (UID: \"4543640466c227ebbf03ecd671a63604\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:24.862936 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ce5c02dbcd5a3d6c0da9867788a4490-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal\" (UID: \"7ce5c02dbcd5a3d6c0da9867788a4490\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.876897 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:24.977787 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.016935 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.072785 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.020636 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" Jul 07 02:17:25.082044 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:25.078423 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.280620 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.168528 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:17:25.280620 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:25.179191 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.280620 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.222293 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:17:25.280620 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:25.280268 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.287413 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.287500 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.287525 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.287579 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.378312 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 02:12:25 +0000 UTC" deadline="2028-02-24 13:59:35.237815661 +0000 UTC" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.378331 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14339h42m9.859487391s" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:25.380442 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:25.480555 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-208.ec2.internal\" not found" Jul 07 02:17:25.504426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.482664 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:17:27.118019 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.559440 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" Jul 07 02:17:27.118019 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.577724 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 02:17:27.118019 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.578818 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" Jul 07 02:17:27.118019 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:25.590855 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 02:17:27.324528 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:27.186869 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4543640466c227ebbf03ecd671a63604.slice/crio-f9b27bb3d4f682b85f85242c7ae17392b07cd192dcfc95ea4e3366f08569c483 WatchSource:0}: Error finding container f9b27bb3d4f682b85f85242c7ae17392b07cd192dcfc95ea4e3366f08569c483: Status 404 returned error can't find the container with id f9b27bb3d4f682b85f85242c7ae17392b07cd192dcfc95ea4e3366f08569c483 Jul 07 02:17:27.324528 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:27.187106 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce5c02dbcd5a3d6c0da9867788a4490.slice/crio-8f00f2abec8aab69beda09fffd87978a87434e60b65a3de3de412fa9880d6e84 WatchSource:0}: Error finding container 8f00f2abec8aab69beda09fffd87978a87434e60b65a3de3de412fa9880d6e84: Status 404 returned error can't find the container with id 8f00f2abec8aab69beda09fffd87978a87434e60b65a3de3de412fa9880d6e84 Jul 07 02:17:27.324528 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.190475 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:17:27.779056 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.768104 2572 apiserver.go:52] "Watching apiserver" Jul 07 02:17:27.779056 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.777128 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 02:17:27.779056 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.777455 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hhx5t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq","openshift-image-registry/node-ca-9jnrc","openshift-multus/network-metrics-daemon-869ts","openshift-network-diagnostics/network-check-target-tn2cj","openshift-network-operator/iptables-alerter-h8l25","openshift-ovn-kubernetes/ovnkube-node-sgzqf","kube-system/global-pull-secret-syncer-fzdbj","kube-system/konnectivity-agent-jhfnf","kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal","openshift-cluster-node-tuning-operator/tuned-66qmz","openshift-dns/node-resolver-gp8l5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal","openshift-multus/multus-additional-cni-plugins-zfmcp"] Jul 07 02:17:27.785535 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.781141 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.785535 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.783476 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.787046 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.785938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.789661 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.788007 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:27.789661 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.788047 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:27.792066 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.791064 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:27.792066 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.791120 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:27.792066 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.791231 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 02:17:27.792747 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.792517 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.795559 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.797122 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.797157 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.798569 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.798586 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.798606 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.798644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vbpwp\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.798661 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.798585 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.798736 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lmft8\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.807887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-systemd-units\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-var-lib-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-ovn\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-ovnkube-script-lib\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808902 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-etc-selinux\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808945 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809158 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809148 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.808942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-kubelet\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.873131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809214 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809250 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-node-log\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809281 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16079578-f1e9-414d-838b-7cb07834e773-tmp-dir\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809309 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809318 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qp6jm\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809352 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809172 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809316 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-cni-bin\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809938 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.809492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zjj8\" (UniqueName: \"kubernetes.io/projected/8dd1caaa-b679-4f57-b712-9aab423594e4-kube-api-access-9zjj8\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.810426 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-72qgq\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.810638 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.811511 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tlcsx\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.811529 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.810301 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16079578-f1e9-414d-838b-7cb07834e773-hosts-file\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.811881 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-klqwd\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.812155 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.812372 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.812432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.812590 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.812598 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-registration-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.874341 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-run-netns\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-ovnkube-config\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-env-overrides\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/b97e940f-a181-47cc-90a5-44d21de2d90a-kube-api-access-wdh62\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1af8dc78-2cb4-437b-998d-d6bfa205f150-iptables-alerter-script\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1af8dc78-2cb4-437b-998d-d6bfa205f150-host-slash\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49fdg\" (UniqueName: \"kubernetes.io/projected/1af8dc78-2cb4-437b-998d-d6bfa205f150-kube-api-access-49fdg\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74clc\" (UniqueName: \"kubernetes.io/projected/16079578-f1e9-414d-838b-7cb07834e773-kube-api-access-74clc\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-device-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-sys-fs\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5wl\" (UniqueName: \"kubernetes.io/projected/61456740-306c-4424-88c8-1035416e9ecd-kube-api-access-8l5wl\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.813949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-log-socket\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.814035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-socket-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.814066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-slash\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.814189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-systemd\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.814272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-etc-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.875679 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.814315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-cni-netd\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.814342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.814411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd1caaa-b679-4f57-b712-9aab423594e4-ovn-node-metrics-cert\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.816591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.827752 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.834816 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h2724\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.834876 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835008 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835088 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835100 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835242 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835264 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835263 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835462 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835597 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cb4gb\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.835911 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bkggk\"" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.836706 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2x9hl" Jul 07 02:17:27.876627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.853927 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2x9hl" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.892531 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915576 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-var-lib-kubelet\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-os-release\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-cni-multus\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915663 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-ovnkube-script-lib\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fde962a4-09b5-494a-8d92-0e3783334906-agent-certs\") pod \"konnectivity-agent-jhfnf\" (UID: \"fde962a4-09b5-494a-8d92-0e3783334906\") " pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1af8dc78-2cb4-437b-998d-d6bfa205f150-host-slash\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49fdg\" (UniqueName: \"kubernetes.io/projected/1af8dc78-2cb4-437b-998d-d6bfa205f150-kube-api-access-49fdg\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74clc\" (UniqueName: \"kubernetes.io/projected/16079578-f1e9-414d-838b-7cb07834e773-kube-api-access-74clc\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-device-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-cnibin\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927208 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-ovnkube-script-lib\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.915837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5wl\" (UniqueName: \"kubernetes.io/projected/61456740-306c-4424-88c8-1035416e9ecd-kube-api-access-8l5wl\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-systemd\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-cni-netd\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927473 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-systemd\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.951650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927554 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1af8dc78-2cb4-437b-998d-d6bfa205f150-host-slash\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd1caaa-b679-4f57-b712-9aab423594e4-ovn-node-metrics-cert\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7tr\" (UniqueName: \"kubernetes.io/projected/80db1736-a916-484e-a090-bb0632a9e8a3-kube-api-access-wd7tr\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927625 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927652 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-cni-netd\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927644 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/577de535-0a79-49c5-9b3c-0fb44fa3d22b-dbus\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927777 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abfbe780-e372-4c34-ae0e-dba02527d71b-host\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927808 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-device-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abfbe780-e372-4c34-ae0e-dba02527d71b-serviceca\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-cnibin\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927927 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.927974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-systemd-units\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928057 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-conf-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80db1736-a916-484e-a090-bb0632a9e8a3-multus-daemon-config\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-kubernetes\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.953763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-sys\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-kubelet\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928033 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-systemd-units\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-socket-dir-parent\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928016 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928231 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/577de535-0a79-49c5-9b3c-0fb44fa3d22b-kubelet-config\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928298 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-kubelet\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysconfig\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-systemd\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928358 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b40984f9-aaea-4596-9264-c68a0bb48920-tmp\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928415 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq992\" (UniqueName: \"kubernetes.io/projected/b40984f9-aaea-4596-9264-c68a0bb48920-kube-api-access-fq992\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928445 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-node-log\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-node-log\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zjj8\" (UniqueName: \"kubernetes.io/projected/8dd1caaa-b679-4f57-b712-9aab423594e4-kube-api-access-9zjj8\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fde962a4-09b5-494a-8d92-0e3783334906-konnectivity-ca\") pod \"konnectivity-agent-jhfnf\" (UID: \"fde962a4-09b5-494a-8d92-0e3783334906\") " pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-modprobe-d\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.954835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16079578-f1e9-414d-838b-7cb07834e773-hosts-file\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-ovnkube-config\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-env-overrides\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928869 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-cni-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-k8s-cni-cncf-io\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-kubelet\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-hostroot\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.928993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-multus-certs\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/b97e940f-a181-47cc-90a5-44d21de2d90a-kube-api-access-wdh62\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-system-cni-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-os-release\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-etc-kubernetes\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929129 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysctl-d\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysctl-conf\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929183 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-system-cni-dir\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1af8dc78-2cb4-437b-998d-d6bfa205f150-iptables-alerter-script\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.957042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-sys-fs\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929330 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-sys-fs\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-ovnkube-config\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929438 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-run\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929478 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16079578-f1e9-414d-838b-7cb07834e773-hosts-file\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkst5\" (UniqueName: \"kubernetes.io/projected/abfbe780-e372-4c34-ae0e-dba02527d71b-kube-api-access-wkst5\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.929480 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-log-socket\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-socket-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-slash\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929465 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8dd1caaa-b679-4f57-b712-9aab423594e4-env-overrides\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.929650 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:17:28.429606478 +0000 UTC m=+3.068153927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929689 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-socket-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-etc-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-host\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-netns\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929751 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-slash\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.957915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929756 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-log-socket\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-cni-bin\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929810 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-etc-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-var-lib-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-ovn\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80db1736-a916-484e-a090-bb0632a9e8a3-cni-binary-copy\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1af8dc78-2cb4-437b-998d-d6bfa205f150-iptables-alerter-script\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.929995 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-var-lib-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-lib-modules\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930042 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-ovn\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-etc-selinux\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930125 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b40984f9-aaea-4596-9264-c68a0bb48920-etc-tuned\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930181 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-etc-selinux\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.959210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16079578-f1e9-414d-838b-7cb07834e773-tmp-dir\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-cni-bin\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930464 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930489 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwn8r\" (UniqueName: \"kubernetes.io/projected/53272075-6b26-40a0-8fb5-b1ccf7a58747-kube-api-access-dwn8r\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-registration-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930593 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-run-openvswitch\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930620 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-run-netns\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930658 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-registration-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-cni-bin\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930855 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16079578-f1e9-414d-838b-7cb07834e773-tmp-dir\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930861 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61456740-306c-4424-88c8-1035416e9ecd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.930892 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dd1caaa-b679-4f57-b712-9aab423594e4-host-run-netns\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.932348 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd1caaa-b679-4f57-b712-9aab423594e4-ovn-node-metrics-cert\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.935824 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.935842 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:17:27.960340 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.935855 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ddmtj for pod openshift-network-diagnostics/network-check-target-tn2cj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:27.961683 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:27.935904 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj podName:b791375a-f6c8-4447-a56a-ddf0e0e81104 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:28.435889206 +0000 UTC m=+3.074436651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ddmtj" (UniqueName: "kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj") pod "network-check-target-tn2cj" (UID: "b791375a-f6c8-4447-a56a-ddf0e0e81104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:27.961683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.936941 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5wl\" (UniqueName: \"kubernetes.io/projected/61456740-306c-4424-88c8-1035416e9ecd-kube-api-access-8l5wl\") pod \"aws-ebs-csi-driver-node-577jq\" (UID: \"61456740-306c-4424-88c8-1035416e9ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:27.961683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.937036 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49fdg\" (UniqueName: \"kubernetes.io/projected/1af8dc78-2cb4-437b-998d-d6bfa205f150-kube-api-access-49fdg\") pod \"iptables-alerter-h8l25\" (UID: \"1af8dc78-2cb4-437b-998d-d6bfa205f150\") " pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:27.961683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.937352 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74clc\" (UniqueName: \"kubernetes.io/projected/16079578-f1e9-414d-838b-7cb07834e773-kube-api-access-74clc\") pod \"node-resolver-gp8l5\" (UID: \"16079578-f1e9-414d-838b-7cb07834e773\") " pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:27.961683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.938254 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zjj8\" (UniqueName: \"kubernetes.io/projected/8dd1caaa-b679-4f57-b712-9aab423594e4-kube-api-access-9zjj8\") pod \"ovnkube-node-sgzqf\" (UID: \"8dd1caaa-b679-4f57-b712-9aab423594e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:27.961683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:27.938956 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/b97e940f-a181-47cc-90a5-44d21de2d90a-kube-api-access-wdh62\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:28.029389 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.026055 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" event={"ID":"7ce5c02dbcd5a3d6c0da9867788a4490","Type":"ContainerStarted","Data":"8f00f2abec8aab69beda09fffd87978a87434e60b65a3de3de412fa9880d6e84"} Jul 07 02:17:28.029389 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.027579 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" event={"ID":"4543640466c227ebbf03ecd671a63604","Type":"ContainerStarted","Data":"f9b27bb3d4f682b85f85242c7ae17392b07cd192dcfc95ea4e3366f08569c483"} Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.031897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.031933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.031959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwn8r\" (UniqueName: \"kubernetes.io/projected/53272075-6b26-40a0-8fb5-b1ccf7a58747-kube-api-access-dwn8r\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.031986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-var-lib-kubelet\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-os-release\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-cni-multus\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032056 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fde962a4-09b5-494a-8d92-0e3783334906-agent-certs\") pod \"konnectivity-agent-jhfnf\" (UID: \"fde962a4-09b5-494a-8d92-0e3783334906\") " pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-cnibin\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7tr\" (UniqueName: \"kubernetes.io/projected/80db1736-a916-484e-a090-bb0632a9e8a3-kube-api-access-wd7tr\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032126 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/577de535-0a79-49c5-9b3c-0fb44fa3d22b-dbus\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abfbe780-e372-4c34-ae0e-dba02527d71b-host\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abfbe780-e372-4c34-ae0e-dba02527d71b-serviceca\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-cnibin\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-conf-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80db1736-a916-484e-a090-bb0632a9e8a3-multus-daemon-config\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.032677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032254 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-cnibin\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-kubernetes\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-sys\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-socket-dir-parent\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/577de535-0a79-49c5-9b3c-0fb44fa3d22b-kubelet-config\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysconfig\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032374 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-os-release\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-systemd\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b40984f9-aaea-4596-9264-c68a0bb48920-tmp\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq992\" (UniqueName: \"kubernetes.io/projected/b40984f9-aaea-4596-9264-c68a0bb48920-kube-api-access-fq992\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fde962a4-09b5-494a-8d92-0e3783334906-konnectivity-ca\") pod \"konnectivity-agent-jhfnf\" (UID: \"fde962a4-09b5-494a-8d92-0e3783334906\") " pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032499 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-modprobe-d\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032523 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-cni-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032559 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-cni-multus\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.033529 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-k8s-cni-cncf-io\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-kubelet\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032665 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/577de535-0a79-49c5-9b3c-0fb44fa3d22b-dbus\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-hostroot\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032710 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abfbe780-e372-4c34-ae0e-dba02527d71b-host\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-multus-certs\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032754 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-multus-certs\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032774 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-system-cni-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-kubelet\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-os-release\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-etc-kubernetes\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032850 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-os-release\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysctl-d\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysctl-conf\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032427 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-systemd\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-system-cni-dir\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032980 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-system-cni-dir\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.032992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-run\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.035555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033019 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-hostroot\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkst5\" (UniqueName: \"kubernetes.io/projected/abfbe780-e372-4c34-ae0e-dba02527d71b-kube-api-access-wkst5\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033055 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-etc-kubernetes\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033094 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fde962a4-09b5-494a-8d92-0e3783334906-konnectivity-ca\") pod \"konnectivity-agent-jhfnf\" (UID: \"fde962a4-09b5-494a-8d92-0e3783334906\") " pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysctl-d\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033194 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-modprobe-d\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033270 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abfbe780-e372-4c34-ae0e-dba02527d71b-serviceca\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033314 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-cnibin\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033401 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53272075-6b26-40a0-8fb5-b1ccf7a58747-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033430 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-conf-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-host\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033543 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysctl-conf\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-netns\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-cni-bin\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033613 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-cni-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033624 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80db1736-a916-484e-a090-bb0632a9e8a3-cni-binary-copy\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033660 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-var-lib-kubelet\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.036628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033662 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-multus-socket-dir-parent\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-lib-modules\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b40984f9-aaea-4596-9264-c68a0bb48920-etc-tuned\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033757 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80db1736-a916-484e-a090-bb0632a9e8a3-multus-daemon-config\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-k8s-cni-cncf-io\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033766 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-run\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033567 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53272075-6b26-40a0-8fb5-b1ccf7a58747-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033816 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-sysconfig\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033826 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-var-lib-cni-bin\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033616 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-sys\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.033865 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033897 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-lib-modules\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033908 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-host\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.033926 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret podName:577de535-0a79-49c5-9b3c-0fb44fa3d22b nodeName:}" failed. No retries permitted until 2026-07-07 02:17:28.53390995 +0000 UTC m=+3.172457392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret") pod "global-pull-secret-syncer-fzdbj" (UID: "577de535-0a79-49c5-9b3c-0fb44fa3d22b") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033799 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-system-cni-dir\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033960 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80db1736-a916-484e-a090-bb0632a9e8a3-host-run-netns\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.033994 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/577de535-0a79-49c5-9b3c-0fb44fa3d22b-kubelet-config\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.034022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b40984f9-aaea-4596-9264-c68a0bb48920-etc-kubernetes\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.039849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.034169 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80db1736-a916-484e-a090-bb0632a9e8a3-cni-binary-copy\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.040995 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.036396 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b40984f9-aaea-4596-9264-c68a0bb48920-etc-tuned\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.040995 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.038789 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b40984f9-aaea-4596-9264-c68a0bb48920-tmp\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.040995 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.040336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fde962a4-09b5-494a-8d92-0e3783334906-agent-certs\") pod \"konnectivity-agent-jhfnf\" (UID: \"fde962a4-09b5-494a-8d92-0e3783334906\") " pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:28.107600 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.068429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwn8r\" (UniqueName: \"kubernetes.io/projected/53272075-6b26-40a0-8fb5-b1ccf7a58747-kube-api-access-dwn8r\") pod \"multus-additional-cni-plugins-zfmcp\" (UID: \"53272075-6b26-40a0-8fb5-b1ccf7a58747\") " pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.107600 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.072062 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkst5\" (UniqueName: \"kubernetes.io/projected/abfbe780-e372-4c34-ae0e-dba02527d71b-kube-api-access-wkst5\") pod \"node-ca-9jnrc\" (UID: \"abfbe780-e372-4c34-ae0e-dba02527d71b\") " pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:28.107600 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.074621 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq992\" (UniqueName: \"kubernetes.io/projected/b40984f9-aaea-4596-9264-c68a0bb48920-kube-api-access-fq992\") pod \"tuned-66qmz\" (UID: \"b40984f9-aaea-4596-9264-c68a0bb48920\") " pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.107600 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.089878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gp8l5" Jul 07 02:17:28.107600 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.095286 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" Jul 07 02:17:28.109099 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.108744 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61456740_306c_4424_88c8_1035416e9ecd.slice/crio-adc0fcdd915f9f388c5e6773b3c77d162bb42159696bdf838e27f4f9aaa706d3 WatchSource:0}: Error finding container adc0fcdd915f9f388c5e6773b3c77d162bb42159696bdf838e27f4f9aaa706d3: Status 404 returned error can't find the container with id adc0fcdd915f9f388c5e6773b3c77d162bb42159696bdf838e27f4f9aaa706d3 Jul 07 02:17:28.111895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.110286 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:28.111895 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.111227 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16079578_f1e9_414d_838b_7cb07834e773.slice/crio-5cfef1e852b2f4ba66eb75bb341e1fc3b32577e52ed319bd697019d6b2cf9822 WatchSource:0}: Error finding container 5cfef1e852b2f4ba66eb75bb341e1fc3b32577e52ed319bd697019d6b2cf9822: Status 404 returned error can't find the container with id 5cfef1e852b2f4ba66eb75bb341e1fc3b32577e52ed319bd697019d6b2cf9822 Jul 07 02:17:28.123559 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.120293 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd1caaa_b679_4f57_b712_9aab423594e4.slice/crio-35530a808656931c158976b75c2617c2db6b4bba846817649b53f8e64acd931f WatchSource:0}: Error finding container 35530a808656931c158976b75c2617c2db6b4bba846817649b53f8e64acd931f: Status 404 returned error can't find the container with id 35530a808656931c158976b75c2617c2db6b4bba846817649b53f8e64acd931f Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.135031 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h8l25" Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.145213 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af8dc78_2cb4_437b_998d_d6bfa205f150.slice/crio-297852508d232c9230292a67a17e7228900b2f3100b91181a60ea96fbb425c11 WatchSource:0}: Error finding container 297852508d232c9230292a67a17e7228900b2f3100b91181a60ea96fbb425c11: Status 404 returned error can't find the container with id 297852508d232c9230292a67a17e7228900b2f3100b91181a60ea96fbb425c11 Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.145930 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.153860 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-66qmz" Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.159169 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde962a4_09b5_494a_8d92_0e3783334906.slice/crio-82134c890ce9ce0c0ecce10053ada86014969a2a4e17ea1d58379a1af0f7049f WatchSource:0}: Error finding container 82134c890ce9ce0c0ecce10053ada86014969a2a4e17ea1d58379a1af0f7049f: Status 404 returned error can't find the container with id 82134c890ce9ce0c0ecce10053ada86014969a2a4e17ea1d58379a1af0f7049f Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.159846 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9jnrc" Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.166384 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40984f9_aaea_4596_9264_c68a0bb48920.slice/crio-1a13930dda8cb13879c29f569bf5bf99323ce634c82487c180505c52a7db6e47 WatchSource:0}: Error finding container 1a13930dda8cb13879c29f569bf5bf99323ce634c82487c180505c52a7db6e47: Status 404 returned error can't find the container with id 1a13930dda8cb13879c29f569bf5bf99323ce634c82487c180505c52a7db6e47 Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.167364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.174771 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfbe780_e372_4c34_ae0e_dba02527d71b.slice/crio-2f9075870dac61054d3678c570e673ec22f51ace59a6437ce8bdb7ac59a962c4 WatchSource:0}: Error finding container 2f9075870dac61054d3678c570e673ec22f51ace59a6437ce8bdb7ac59a962c4: Status 404 returned error can't find the container with id 2f9075870dac61054d3678c570e673ec22f51ace59a6437ce8bdb7ac59a962c4 Jul 07 02:17:28.183415 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:17:28.182214 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53272075_6b26_40a0_8fb5_b1ccf7a58747.slice/crio-791326930c40be0d6e7d03bef057cb5dee26f450299413fcccc49f8581f0d9af WatchSource:0}: Error finding container 791326930c40be0d6e7d03bef057cb5dee26f450299413fcccc49f8581f0d9af: Status 404 returned error can't find the container with id 791326930c40be0d6e7d03bef057cb5dee26f450299413fcccc49f8581f0d9af Jul 07 02:17:28.259821 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.244873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7tr\" (UniqueName: \"kubernetes.io/projected/80db1736-a916-484e-a090-bb0632a9e8a3-kube-api-access-wd7tr\") pod \"multus-hhx5t\" (UID: \"80db1736-a916-484e-a090-bb0632a9e8a3\") " pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.437635 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.437558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:28.437635 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.437617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:28.437830 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.437727 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:28.437830 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.437741 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:17:28.437830 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.437758 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:17:28.437830 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.437769 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ddmtj for pod openshift-network-diagnostics/network-check-target-tn2cj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:28.437830 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.437797 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:17:29.437778956 +0000 UTC m=+4.076326412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:28.437830 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.437817 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj podName:b791375a-f6c8-4447-a56a-ddf0e0e81104 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:29.437808934 +0000 UTC m=+4.076356375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddmtj" (UniqueName: "kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj") pod "network-check-target-tn2cj" (UID: "b791375a-f6c8-4447-a56a-ddf0e0e81104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:28.438129 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.437880 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhx5t" Jul 07 02:17:28.537895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.537860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:28.538062 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.538048 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:28.538161 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:28.538136 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret podName:577de535-0a79-49c5-9b3c-0fb44fa3d22b nodeName:}" failed. No retries permitted until 2026-07-07 02:17:29.538104833 +0000 UTC m=+4.176652274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret") pod "global-pull-secret-syncer-fzdbj" (UID: "577de535-0a79-49c5-9b3c-0fb44fa3d22b") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:28.856857 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.856818 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:12:27 +0000 UTC" deadline="2028-04-11 03:25:03.50359929 +0000 UTC" Jul 07 02:17:28.856857 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:28.856852 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15457h7m34.646751372s" Jul 07 02:17:29.019963 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.019931 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:29.020494 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.020066 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:29.030599 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.030568 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-66qmz" event={"ID":"b40984f9-aaea-4596-9264-c68a0bb48920","Type":"ContainerStarted","Data":"1a13930dda8cb13879c29f569bf5bf99323ce634c82487c180505c52a7db6e47"} Jul 07 02:17:29.032044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.031987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhfnf" event={"ID":"fde962a4-09b5-494a-8d92-0e3783334906","Type":"ContainerStarted","Data":"82134c890ce9ce0c0ecce10053ada86014969a2a4e17ea1d58379a1af0f7049f"} Jul 07 02:17:29.033517 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.033458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h8l25" event={"ID":"1af8dc78-2cb4-437b-998d-d6bfa205f150","Type":"ContainerStarted","Data":"297852508d232c9230292a67a17e7228900b2f3100b91181a60ea96fbb425c11"} Jul 07 02:17:29.035053 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.035023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"35530a808656931c158976b75c2617c2db6b4bba846817649b53f8e64acd931f"} Jul 07 02:17:29.036369 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.036342 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" event={"ID":"61456740-306c-4424-88c8-1035416e9ecd","Type":"ContainerStarted","Data":"adc0fcdd915f9f388c5e6773b3c77d162bb42159696bdf838e27f4f9aaa706d3"} Jul 07 02:17:29.037681 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.037633 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerStarted","Data":"791326930c40be0d6e7d03bef057cb5dee26f450299413fcccc49f8581f0d9af"} Jul 07 02:17:29.038902 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.038869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9jnrc" event={"ID":"abfbe780-e372-4c34-ae0e-dba02527d71b","Type":"ContainerStarted","Data":"2f9075870dac61054d3678c570e673ec22f51ace59a6437ce8bdb7ac59a962c4"} Jul 07 02:17:29.040106 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.040067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gp8l5" event={"ID":"16079578-f1e9-414d-838b-7cb07834e773","Type":"ContainerStarted","Data":"5cfef1e852b2f4ba66eb75bb341e1fc3b32577e52ed319bd697019d6b2cf9822"} Jul 07 02:17:29.346467 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.344225 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:17:29.445356 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.445308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:29.445513 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.445388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:29.445585 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.445531 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:17:29.445585 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.445552 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:17:29.445585 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.445566 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ddmtj for pod openshift-network-diagnostics/network-check-target-tn2cj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:29.445737 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.445626 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj podName:b791375a-f6c8-4447-a56a-ddf0e0e81104 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:31.44560617 +0000 UTC m=+6.084153616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddmtj" (UniqueName: "kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj") pod "network-check-target-tn2cj" (UID: "b791375a-f6c8-4447-a56a-ddf0e0e81104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:29.445798 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.445780 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:29.445849 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.445830 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:17:31.445814929 +0000 UTC m=+6.084362371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:29.546366 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.546330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:29.546540 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.546503 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:29.546601 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:29.546561 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret podName:577de535-0a79-49c5-9b3c-0fb44fa3d22b nodeName:}" failed. No retries permitted until 2026-07-07 02:17:31.546543182 +0000 UTC m=+6.185090636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret") pod "global-pull-secret-syncer-fzdbj" (UID: "577de535-0a79-49c5-9b3c-0fb44fa3d22b") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:29.802550 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.802385 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 02:17:29.857227 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.857167 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:12:27 +0000 UTC" deadline="2028-04-03 09:32:10.536526888 +0000 UTC" Jul 07 02:17:29.857227 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:29.857222 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15271h14m40.679308607s" Jul 07 02:17:30.021380 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:30.021284 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:30.021790 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:30.021404 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:30.021864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:30.021792 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:30.021913 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:30.021897 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:30.055891 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:30.055691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" event={"ID":"4543640466c227ebbf03ecd671a63604","Type":"ContainerStarted","Data":"5865cfa72caf0076d6089299dc7f53af0f2e1d5b562e588b81556b6ac4003933"} Jul 07 02:17:30.059703 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:30.059641 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhx5t" event={"ID":"80db1736-a916-484e-a090-bb0632a9e8a3","Type":"ContainerStarted","Data":"00ebac2fd1791cafda3d4d03e251cdd2fcee54ddb48889ac6d39c548859e3952"} Jul 07 02:17:31.020449 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:31.020416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:31.020634 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.020564 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:31.068992 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:31.068958 2572 generic.go:356] "Generic (PLEG): container finished" podID="7ce5c02dbcd5a3d6c0da9867788a4490" containerID="df3cd8b3ff885915fa4028a281cd74a66130ef08e5277989b62affe56726ca54" exitCode=0 Jul 07 02:17:31.069482 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:31.069298 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" event={"ID":"7ce5c02dbcd5a3d6c0da9867788a4490","Type":"ContainerDied","Data":"df3cd8b3ff885915fa4028a281cd74a66130ef08e5277989b62affe56726ca54"} Jul 07 02:17:31.086087 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:31.085875 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-208.ec2.internal" podStartSLOduration=5.085856492 podStartE2EDuration="5.085856492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:30.071131235 +0000 UTC m=+4.709678700" watchObservedRunningTime="2026-07-07 02:17:31.085856492 +0000 UTC m=+5.724403955" Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:31.467531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:31.467592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.467747 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.467769 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.467784 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ddmtj for pod openshift-network-diagnostics/network-check-target-tn2cj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.467834 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj podName:b791375a-f6c8-4447-a56a-ddf0e0e81104 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:35.467816881 +0000 UTC m=+10.106364326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddmtj" (UniqueName: "kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj") pod "network-check-target-tn2cj" (UID: "b791375a-f6c8-4447-a56a-ddf0e0e81104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.468225 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:31.468306 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.468276 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:17:35.468260452 +0000 UTC m=+10.106807910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:31.568673 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:31.568167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:31.568673 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.568289 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:31.568673 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:31.568344 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret podName:577de535-0a79-49c5-9b3c-0fb44fa3d22b nodeName:}" failed. No retries permitted until 2026-07-07 02:17:35.56832831 +0000 UTC m=+10.206875753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret") pod "global-pull-secret-syncer-fzdbj" (UID: "577de535-0a79-49c5-9b3c-0fb44fa3d22b") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:32.021196 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:32.021164 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:32.021384 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:32.021292 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:32.023099 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:32.023016 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:32.023225 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:32.023147 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:33.019970 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:33.019928 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:33.020396 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:33.020061 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:34.020978 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:34.020946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:34.021442 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:34.020946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:34.021442 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:34.021103 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:34.021442 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:34.021217 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:35.019879 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:35.019829 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:35.020156 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.019956 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:35.499173 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:35.499126 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:35.499664 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:35.499197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:35.499664 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.499303 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:35.499664 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.499343 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:17:35.499664 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.499360 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:17:35.499664 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.499372 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ddmtj for pod openshift-network-diagnostics/network-check-target-tn2cj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:35.499664 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.499377 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:17:43.499356333 +0000 UTC m=+18.137903778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:35.499664 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.499449 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj podName:b791375a-f6c8-4447-a56a-ddf0e0e81104 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:43.499432289 +0000 UTC m=+18.137979732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddmtj" (UniqueName: "kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj") pod "network-check-target-tn2cj" (UID: "b791375a-f6c8-4447-a56a-ddf0e0e81104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:35.600116 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:35.599719 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:35.600116 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.599855 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:35.600116 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:35.599917 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret podName:577de535-0a79-49c5-9b3c-0fb44fa3d22b nodeName:}" failed. No retries permitted until 2026-07-07 02:17:43.599899765 +0000 UTC m=+18.238447222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret") pod "global-pull-secret-syncer-fzdbj" (UID: "577de535-0a79-49c5-9b3c-0fb44fa3d22b") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:36.020861 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:36.020807 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:36.021141 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:36.020935 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:36.021141 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:36.020967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:36.021141 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:36.021046 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:37.020468 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:37.020431 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:37.020918 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:37.020559 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:38.020441 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:38.020407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:38.020626 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:38.020461 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:38.020626 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:38.020536 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:38.021060 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:38.020624 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:39.020573 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:39.020550 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:39.020701 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:39.020673 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:39.105397 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:39.105305 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" event={"ID":"7ce5c02dbcd5a3d6c0da9867788a4490","Type":"ContainerStarted","Data":"3284dbbd998f27e1852c4bc6fba162ec6c71b42ccbc5f680e8ad183199584ac2"} Jul 07 02:17:39.129622 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:39.129571 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-208.ec2.internal" podStartSLOduration=12.1295533 podStartE2EDuration="12.1295533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:39.129293462 +0000 UTC m=+13.767840925" watchObservedRunningTime="2026-07-07 02:17:39.1295533 +0000 UTC m=+13.768100764" Jul 07 02:17:40.019951 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.019725 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:40.020116 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.019725 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:40.020116 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:40.019994 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:40.020116 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:40.020063 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:40.109850 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.109815 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" event={"ID":"61456740-306c-4424-88c8-1035416e9ecd","Type":"ContainerStarted","Data":"3f96b6eea23ede3f7de65b42f42c9ea424a9791fad63c6c6672a0352c06972f7"} Jul 07 02:17:40.111841 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.111792 2572 generic.go:356] "Generic (PLEG): container finished" podID="53272075-6b26-40a0-8fb5-b1ccf7a58747" containerID="8ca362d9225864b42240c8a03a83416896c0ffdcc05f00e1afce9374511e313c" exitCode=0 Jul 07 02:17:40.111951 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.111866 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerDied","Data":"8ca362d9225864b42240c8a03a83416896c0ffdcc05f00e1afce9374511e313c"} Jul 07 02:17:40.114530 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.114188 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9jnrc" event={"ID":"abfbe780-e372-4c34-ae0e-dba02527d71b","Type":"ContainerStarted","Data":"a60bd7a32f590e7abcdba635af1dd67339c11d24653fc9a845ef0362dddd6b49"} Jul 07 02:17:40.117026 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.116503 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gp8l5" event={"ID":"16079578-f1e9-414d-838b-7cb07834e773","Type":"ContainerStarted","Data":"befe2bb5372deeebf04e035bf77916ceb9d518236789c7c2abf73bfd80b396e5"} Jul 07 02:17:40.119015 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.118990 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-66qmz" event={"ID":"b40984f9-aaea-4596-9264-c68a0bb48920","Type":"ContainerStarted","Data":"53a07f894105e6f1b0dd44c4dfad3c337f2e6b8119e3d29cc0f8d69c01fca749"} Jul 07 02:17:40.120842 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.120797 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jhfnf" event={"ID":"fde962a4-09b5-494a-8d92-0e3783334906","Type":"ContainerStarted","Data":"ee237320d9e5a912ab71957835acb28bfd897440a6ac5095276b7125d5b32252"} Jul 07 02:17:40.165918 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.165873 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jhfnf" podStartSLOduration=3.626579884 podStartE2EDuration="14.165855939s" totalImagesPullingTime="10.539276055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:40.149056768 +0000 UTC m=+14.787604232" watchObservedRunningTime="2026-07-07 02:17:40.165855939 +0000 UTC m=+14.804403402" Jul 07 02:17:40.166022 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.165995 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-66qmz" podStartSLOduration=3.356384474 podStartE2EDuration="14.165989057s" totalImagesPullingTime="10.809604583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:40.16597997 +0000 UTC m=+14.804527434" watchObservedRunningTime="2026-07-07 02:17:40.165989057 +0000 UTC m=+14.804536520" Jul 07 02:17:40.179242 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:40.179202 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9jnrc" podStartSLOduration=3.670869517 podStartE2EDuration="14.179194473s" totalImagesPullingTime="10.508324956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:40.178669595 +0000 UTC m=+14.817217057" watchObservedRunningTime="2026-07-07 02:17:40.179194473 +0000 UTC m=+14.817741936" Jul 07 02:17:41.020419 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:41.020382 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:41.020606 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:41.020492 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:41.127314 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:41.127273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h8l25" event={"ID":"1af8dc78-2cb4-437b-998d-d6bfa205f150","Type":"ContainerStarted","Data":"760493789ad26ad7721ffde5c4c8cf4035487990f3f4ffe7d4f37b41f125dbf3"} Jul 07 02:17:41.142022 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:41.141972 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gp8l5" podStartSLOduration=5.534220638 podStartE2EDuration="16.141955792s" totalImagesPullingTime="10.607735154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:40.203241226 +0000 UTC m=+14.841788688" watchObservedRunningTime="2026-07-07 02:17:41.141955792 +0000 UTC m=+15.780503256" Jul 07 02:17:41.142668 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:41.142633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h8l25" podStartSLOduration=4.607434147 podStartE2EDuration="15.142617852s" totalImagesPullingTime="10.535183705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:41.14170238 +0000 UTC m=+15.780249843" watchObservedRunningTime="2026-07-07 02:17:41.142617852 +0000 UTC m=+15.781165315" Jul 07 02:17:42.024380 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:42.024348 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:42.024544 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:42.024390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:42.024544 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:42.024485 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:42.024624 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:42.024594 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:43.020044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:43.020005 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:43.020655 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.020146 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:43.564681 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:43.564644 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:43.564850 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:43.564710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:43.564850 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.564810 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:43.564955 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.564849 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:17:43.564955 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.564867 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:17:43.564955 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.564880 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ddmtj for pod openshift-network-diagnostics/network-check-target-tn2cj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:43.564955 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.564887 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:17:59.564865166 +0000 UTC m=+34.203412617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:43.564955 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.564924 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj podName:b791375a-f6c8-4447-a56a-ddf0e0e81104 nodeName:}" failed. No retries permitted until 2026-07-07 02:17:59.564913652 +0000 UTC m=+34.203461092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddmtj" (UniqueName: "kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj") pod "network-check-target-tn2cj" (UID: "b791375a-f6c8-4447-a56a-ddf0e0e81104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:43.665526 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:43.665481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:43.665694 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.665604 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:43.665694 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:43.665665 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret podName:577de535-0a79-49c5-9b3c-0fb44fa3d22b nodeName:}" failed. No retries permitted until 2026-07-07 02:17:59.665649749 +0000 UTC m=+34.304197203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret") pod "global-pull-secret-syncer-fzdbj" (UID: "577de535-0a79-49c5-9b3c-0fb44fa3d22b") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:44.020738 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:44.020702 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:44.020738 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:44.020730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:44.021197 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:44.020859 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:44.021197 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:44.021002 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:44.378156 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:44.377294 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:44.378326 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:44.378226 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:45.020480 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:45.020444 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:45.020648 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:45.020576 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:46.021617 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:46.021585 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:46.022118 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:46.021702 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:46.022118 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:46.021741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:46.022118 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:46.021805 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:47.020031 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:47.020003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:47.020206 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:47.020113 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:47.875963 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:47.875919 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:47.876449 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:47.876037 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 02:17:47.876830 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:47.876796 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jhfnf" Jul 07 02:17:48.020536 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:48.020402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:48.020536 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:48.020447 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:48.020780 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:48.020548 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:48.020780 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:48.020663 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:49.020314 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:49.020232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:49.020755 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:49.020359 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:50.020296 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:50.020262 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:50.020296 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:50.020280 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:50.020887 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:50.020397 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:50.020887 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:50.020519 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:50.402334 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:50.402289 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 02:17:50.878946 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:50.878687 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T02:17:50.402317347Z","UUID":"247cc575-8761-4239-a2ac-3943e9fc0ede","Handler":null,"Name":"","Endpoint":""} Jul 07 02:17:50.879878 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:50.879863 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 02:17:50.879979 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:50.879901 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 02:17:51.020279 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.020259 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:51.020385 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:51.020343 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:51.147654 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.147622 2572 generic.go:356] "Generic (PLEG): container finished" podID="53272075-6b26-40a0-8fb5-b1ccf7a58747" containerID="3b28a5c2460b4f8c50c063e98366f9c605580557e2e61d602272bf639c4f54b0" exitCode=0 Jul 07 02:17:51.147807 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.147705 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerDied","Data":"3b28a5c2460b4f8c50c063e98366f9c605580557e2e61d602272bf639c4f54b0"} Jul 07 02:17:51.150366 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.150337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhx5t" event={"ID":"80db1736-a916-484e-a090-bb0632a9e8a3","Type":"ContainerStarted","Data":"b749a42db1e56b9142137bb7873e83c211527ffb0d8324faf8813d90fe080651"} Jul 07 02:17:51.156353 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.156327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"af8bb7f314b3b01267317b35a8ad924f6117d40fb851d411ae3112179ecfb32d"} Jul 07 02:17:51.156478 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.156442 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"833d1f3c1dfefe9ac78ab7852358662276042c7f48f55ef9ca0f1cd65cb82552"} Jul 07 02:17:51.156533 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.156490 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"86539195c98c10799623c15ce490bd018e56c5aa4739a56398418cdae2fc8f8c"} Jul 07 02:17:51.156569 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.156557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"67dbc6ae6666cb2f623218a46ccbd0a3ae4796f86dfaac4b6596de1d45456d64"} Jul 07 02:17:51.156615 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.156600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"32d8926a81689df47855129acb35f65a825f4bc110ae9bc7e6d1a2a85d1fd297"} Jul 07 02:17:51.156668 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.156642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"8b3e60ddf6593467c1a98d911384e02c0c453a420bd2e2d6ab693161b8836c50"} Jul 07 02:17:51.158293 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:51.158273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" event={"ID":"61456740-306c-4424-88c8-1035416e9ecd","Type":"ContainerStarted","Data":"71b4eb21ebef3aeb2e45a1d1fcb77ca1410c81bee7cc9f50502eed26f72abd29"} Jul 07 02:17:52.020056 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:52.020030 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:52.020214 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:52.020182 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:52.020275 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:52.020235 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:52.020383 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:52.020361 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:52.163149 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:52.163110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" event={"ID":"61456740-306c-4424-88c8-1035416e9ecd","Type":"ContainerStarted","Data":"5ca56730040bb2ebe080ec8ba357daa5cd458af8900df9df4c79fa6d89d42dd5"} Jul 07 02:17:52.182762 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:52.182717 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hhx5t" podStartSLOduration=5.6206223269999995 podStartE2EDuration="26.182702947s" totalImagesPullingTime="20.56208062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:51.186112129 +0000 UTC m=+25.824659592" watchObservedRunningTime="2026-07-07 02:17:52.182702947 +0000 UTC m=+26.821250387" Jul 07 02:17:52.182914 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:52.182858 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-577jq" podStartSLOduration=5.5751280560000005 podStartE2EDuration="27.182845445s" totalImagesPullingTime="21.607717389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:52.182335699 +0000 UTC m=+26.820883161" watchObservedRunningTime="2026-07-07 02:17:52.182845445 +0000 UTC m=+26.821392918" Jul 07 02:17:53.020135 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:53.020114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:53.020248 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:53.020208 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:53.170384 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:53.170354 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"65acf9d6d9307a746151fcde38d1d0a2186a82d4acbd7b7eba6fb01e1b4cbab1"} Jul 07 02:17:53.172294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:53.172265 2572 generic.go:356] "Generic (PLEG): container finished" podID="53272075-6b26-40a0-8fb5-b1ccf7a58747" containerID="c96d4fe9fd2ff003f223687d2a292648cc23e2444d9d45755e6b0a142cd39003" exitCode=0 Jul 07 02:17:53.172385 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:53.172337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerDied","Data":"c96d4fe9fd2ff003f223687d2a292648cc23e2444d9d45755e6b0a142cd39003"} Jul 07 02:17:54.020275 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:54.020247 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:54.020430 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:54.020343 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:54.020430 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:54.020390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:54.020500 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:54.020434 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:55.020013 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:55.019954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:55.020404 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:55.020041 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:55.178738 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:55.178713 2572 generic.go:356] "Generic (PLEG): container finished" podID="53272075-6b26-40a0-8fb5-b1ccf7a58747" containerID="4ceaa79d648927236ed626398317bc00d71f71b0275e7063c910a21dd40e0756" exitCode=0 Jul 07 02:17:55.178861 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:55.178752 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerDied","Data":"4ceaa79d648927236ed626398317bc00d71f71b0275e7063c910a21dd40e0756"} Jul 07 02:17:56.020783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.020633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:56.021213 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.020702 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:56.021213 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:56.020861 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:56.021213 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:56.020918 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:56.186505 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.186470 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" event={"ID":"8dd1caaa-b679-4f57-b712-9aab423594e4","Type":"ContainerStarted","Data":"479b6cb383b44546a6afff73533fc45ed4676544382701abec0248f7e2be62f3"} Jul 07 02:17:56.186921 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.186716 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:56.186921 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.186779 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:56.186921 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.186829 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:56.203126 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.203011 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:56.203758 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.203740 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:17:56.214695 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:56.214648 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" podStartSLOduration=8.086336189 podStartE2EDuration="30.214637278s" totalImagesPullingTime="22.128301089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:56.214575094 +0000 UTC m=+30.853122547" watchObservedRunningTime="2026-07-07 02:17:56.214637278 +0000 UTC m=+30.853184739" Jul 07 02:17:57.019945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:57.019922 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:57.020094 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:57.020018 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:57.225144 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:57.225110 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tn2cj"] Jul 07 02:17:57.225629 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:57.225225 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:57.225629 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:57.225306 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:57.231000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:57.230714 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzdbj"] Jul 07 02:17:57.231000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:57.230834 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:57.231000 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:57.230931 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:57.231457 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:57.231438 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-869ts"] Jul 07 02:17:57.231551 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:57.231538 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:57.231654 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:57.231636 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:59.020763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:59.020730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:59.021194 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:59.020770 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:59.021194 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:59.020772 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:59.021194 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.020842 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:17:59.021194 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.020915 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:17:59.021194 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.020989 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:17:59.588924 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:59.588894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:17:59.589082 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:59.588948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:17:59.589082 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.589040 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:59.589082 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.589059 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 02:17:59.589256 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.589095 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 02:17:59.589256 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.589106 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ddmtj for pod openshift-network-diagnostics/network-check-target-tn2cj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:59.589256 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.589109 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:18:31.589091267 +0000 UTC m=+66.227638709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 02:17:59.589256 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.589142 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj podName:b791375a-f6c8-4447-a56a-ddf0e0e81104 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:31.58913072 +0000 UTC m=+66.227678160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddmtj" (UniqueName: "kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj") pod "network-check-target-tn2cj" (UID: "b791375a-f6c8-4447-a56a-ddf0e0e81104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 02:17:59.689569 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:17:59.689528 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:17:59.689740 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.689639 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 02:17:59.689740 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:17:59.689696 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret podName:577de535-0a79-49c5-9b3c-0fb44fa3d22b nodeName:}" failed. No retries permitted until 2026-07-07 02:18:31.689683274 +0000 UTC m=+66.328230718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret") pod "global-pull-secret-syncer-fzdbj" (UID: "577de535-0a79-49c5-9b3c-0fb44fa3d22b") : object "kube-system"/"original-pull-secret" not registered Jul 07 02:18:01.020419 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:01.020389 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:18:01.020871 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:01.020525 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:18:01.020871 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:01.020526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:18:01.020871 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:01.020634 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:18:01.020871 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:01.020523 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:18:01.020871 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:01.020733 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:18:03.020244 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:03.020216 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:18:03.020589 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:03.020317 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tn2cj" podUID="b791375a-f6c8-4447-a56a-ddf0e0e81104" Jul 07 02:18:03.020589 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:03.020331 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:18:03.020589 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:03.020372 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:18:03.020589 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:03.020447 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-869ts" podUID="b97e940f-a181-47cc-90a5-44d21de2d90a" Jul 07 02:18:03.020589 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:03.020569 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzdbj" podUID="577de535-0a79-49c5-9b3c-0fb44fa3d22b" Jul 07 02:18:03.203888 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:03.203865 2572 generic.go:356] "Generic (PLEG): container finished" podID="53272075-6b26-40a0-8fb5-b1ccf7a58747" containerID="c7f8f7f5a43e3c68ed65840945384c3c800429108640e554d3bac41064ba1b46" exitCode=0 Jul 07 02:18:03.203990 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:03.203894 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerDied","Data":"c7f8f7f5a43e3c68ed65840945384c3c800429108640e554d3bac41064ba1b46"} Jul 07 02:18:04.150202 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.150181 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-208.ec2.internal" event="NodeReady" Jul 07 02:18:04.150595 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.150261 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 02:18:04.184733 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.184708 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d95f94b89-svvmz"] Jul 07 02:18:04.205202 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.205179 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-79pqc"] Jul 07 02:18:04.205333 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.205312 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.207711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.207679 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 02:18:04.207711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.207687 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 02:18:04.207878 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.207697 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lwxwm\"" Jul 07 02:18:04.207953 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.207936 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 02:18:04.209300 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.209270 2572 generic.go:356] "Generic (PLEG): container finished" podID="53272075-6b26-40a0-8fb5-b1ccf7a58747" containerID="9e4b30a070e97fa7febbab5699d5ecf9ef03df55bb699d0bd4c6e0dd2ed94f85" exitCode=0 Jul 07 02:18:04.215242 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.215221 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 02:18:04.225364 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.225341 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerDied","Data":"9e4b30a070e97fa7febbab5699d5ecf9ef03df55bb699d0bd4c6e0dd2ed94f85"} Jul 07 02:18:04.225451 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.225376 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d95f94b89-svvmz"] Jul 07 02:18:04.225451 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.225396 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zptq2"] Jul 07 02:18:04.225521 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.225455 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.228367 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.228350 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 02:18:04.228656 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.228638 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc8t9\"" Jul 07 02:18:04.229047 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.229033 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 02:18:04.249460 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.249441 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79pqc"] Jul 07 02:18:04.249545 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.249494 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zptq2"] Jul 07 02:18:04.249602 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.249589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.252440 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.252423 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 02:18:04.252596 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.252581 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mfm2n\"" Jul 07 02:18:04.252662 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.252597 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 02:18:04.252804 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.252716 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 02:18:04.328565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328543 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4694dda2-8a20-4adf-8784-0b8b5ae18853-ca-trust-extracted\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.328656 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.328656 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-image-registry-private-configuration\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.328745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-trusted-ca\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.328779 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-certificates\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.328824 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-installation-pull-secrets\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.328824 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.328892 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsn45\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-kube-api-access-zsn45\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.328928 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62fb499-e7dd-4581-b2ac-7134d43885d6-tmp-dir\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.328997 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.328983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f62fb499-e7dd-4581-b2ac-7134d43885d6-config-volume\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.329048 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.329018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvx6p\" (UniqueName: \"kubernetes.io/projected/f62fb499-e7dd-4581-b2ac-7134d43885d6-kube-api-access-zvx6p\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.329120 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.329046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-bound-sa-token\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.429793 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.429730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsn45\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-kube-api-access-zsn45\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.429793 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.429779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62fb499-e7dd-4581-b2ac-7134d43885d6-tmp-dir\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.429940 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.429812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f62fb499-e7dd-4581-b2ac-7134d43885d6-config-volume\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.429940 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.429851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvx6p\" (UniqueName: \"kubernetes.io/projected/f62fb499-e7dd-4581-b2ac-7134d43885d6-kube-api-access-zvx6p\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.430044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.429974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-bound-sa-token\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4694dda2-8a20-4adf-8784-0b8b5ae18853-ca-trust-extracted\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430181 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430181 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430106 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-image-registry-private-configuration\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430181 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62fb499-e7dd-4581-b2ac-7134d43885d6-tmp-dir\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.430305 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.430172 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 02:18:04.430305 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.430238 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d95f94b89-svvmz: secret "image-registry-tls" not found Jul 07 02:18:04.430305 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.430290 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls podName:4694dda2-8a20-4adf-8784-0b8b5ae18853 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:04.930274525 +0000 UTC m=+39.568821966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls") pod "image-registry-d95f94b89-svvmz" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853") : secret "image-registry-tls" not found Jul 07 02:18:04.430305 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-trusted-ca\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5-cert\") pod \"ingress-canary-zptq2\" (UID: \"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5\") " pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.430477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-certificates\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-installation-pull-secrets\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.430477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430418 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4694dda2-8a20-4adf-8784-0b8b5ae18853-ca-trust-extracted\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.430477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430430 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f62fb499-e7dd-4581-b2ac-7134d43885d6-config-volume\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.430477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430438 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzv9w\" (UniqueName: \"kubernetes.io/projected/c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5-kube-api-access-gzv9w\") pod \"ingress-canary-zptq2\" (UID: \"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5\") " pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.430816 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.430584 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:18:04.430816 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.430634 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls podName:f62fb499-e7dd-4581-b2ac-7134d43885d6 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:04.930619105 +0000 UTC m=+39.569166571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls") pod "dns-default-79pqc" (UID: "f62fb499-e7dd-4581-b2ac-7134d43885d6") : secret "dns-default-metrics-tls" not found Jul 07 02:18:04.430887 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.430877 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-certificates\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.431020 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.431001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-trusted-ca\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.433799 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.433779 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-installation-pull-secrets\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.433884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.433833 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-image-registry-private-configuration\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.438536 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.438512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-bound-sa-token\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.438710 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.438690 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvx6p\" (UniqueName: \"kubernetes.io/projected/f62fb499-e7dd-4581-b2ac-7134d43885d6-kube-api-access-zvx6p\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.438928 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.438911 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsn45\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-kube-api-access-zsn45\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.531506 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.531482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5-cert\") pod \"ingress-canary-zptq2\" (UID: \"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5\") " pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.531591 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.531531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzv9w\" (UniqueName: \"kubernetes.io/projected/c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5-kube-api-access-gzv9w\") pod \"ingress-canary-zptq2\" (UID: \"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5\") " pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.533450 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.533434 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5-cert\") pod \"ingress-canary-zptq2\" (UID: \"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5\") " pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.539407 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.539388 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzv9w\" (UniqueName: \"kubernetes.io/projected/c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5-kube-api-access-gzv9w\") pod \"ingress-canary-zptq2\" (UID: \"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5\") " pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.560237 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.560218 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zptq2" Jul 07 02:18:04.738908 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.738755 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zptq2"] Jul 07 02:18:04.741865 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:18:04.741840 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b89d83_0fe9_4373_8bd8_968b7cf5d7c5.slice/crio-a28bd2dad96f4955433fa102ae44654d9d44704e33c20b1c94bf48ba3bd2d2c3 WatchSource:0}: Error finding container a28bd2dad96f4955433fa102ae44654d9d44704e33c20b1c94bf48ba3bd2d2c3: Status 404 returned error can't find the container with id a28bd2dad96f4955433fa102ae44654d9d44704e33c20b1c94bf48ba3bd2d2c3 Jul 07 02:18:04.933905 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.933883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:04.934028 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:04.933938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:04.934028 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.934019 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 02:18:04.934163 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.934035 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d95f94b89-svvmz: secret "image-registry-tls" not found Jul 07 02:18:04.934163 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.934105 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:18:04.934163 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.934109 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls podName:4694dda2-8a20-4adf-8784-0b8b5ae18853 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:05.934068316 +0000 UTC m=+40.572615770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls") pod "image-registry-d95f94b89-svvmz" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853") : secret "image-registry-tls" not found Jul 07 02:18:04.934274 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:04.934171 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls podName:f62fb499-e7dd-4581-b2ac-7134d43885d6 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:05.934154501 +0000 UTC m=+40.572701946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls") pod "dns-default-79pqc" (UID: "f62fb499-e7dd-4581-b2ac-7134d43885d6") : secret "dns-default-metrics-tls" not found Jul 07 02:18:05.020116 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.020057 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:18:05.020116 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.020070 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:18:05.020266 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.020247 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:18:05.022668 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.022647 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 02:18:05.022852 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.022729 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 02:18:05.022852 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.022650 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 02:18:05.022852 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.022757 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 02:18:05.022852 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.022789 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hf7w2\"" Jul 07 02:18:05.022852 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.022793 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ggshj\"" Jul 07 02:18:05.214664 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.214634 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" event={"ID":"53272075-6b26-40a0-8fb5-b1ccf7a58747","Type":"ContainerStarted","Data":"c5e50ff0df7bc5a90ce6c9e44b246ea0ee6514d3cbab1edff062ea85d3452ceb"} Jul 07 02:18:05.215710 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.215691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zptq2" event={"ID":"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5","Type":"ContainerStarted","Data":"a28bd2dad96f4955433fa102ae44654d9d44704e33c20b1c94bf48ba3bd2d2c3"} Jul 07 02:18:05.237624 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.237583 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zfmcp" podStartSLOduration=8.060645314 podStartE2EDuration="39.237571315s" totalImagesPullingTime="31.176926001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:05.236542536 +0000 UTC m=+39.875089997" watchObservedRunningTime="2026-07-07 02:18:05.237571315 +0000 UTC m=+39.876118774" Jul 07 02:18:05.393090 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.393048 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:05.941559 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.941524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:05.941715 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:05.941591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:05.941715 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:05.941701 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 02:18:05.941862 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:05.941722 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d95f94b89-svvmz: secret "image-registry-tls" not found Jul 07 02:18:05.941862 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:05.941749 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:18:05.941862 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:05.941796 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls podName:4694dda2-8a20-4adf-8784-0b8b5ae18853 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:07.941776598 +0000 UTC m=+42.580324060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls") pod "image-registry-d95f94b89-svvmz" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853") : secret "image-registry-tls" not found Jul 07 02:18:05.941862 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:05.941815 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls podName:f62fb499-e7dd-4581-b2ac-7134d43885d6 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:07.941805828 +0000 UTC m=+42.580353273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls") pod "dns-default-79pqc" (UID: "f62fb499-e7dd-4581-b2ac-7134d43885d6") : secret "dns-default-metrics-tls" not found Jul 07 02:18:06.490039 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:06.490004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:07.183696 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:07.183657 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:07.282386 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:07.282350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:07.383770 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:07.383718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:07.954940 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:07.954913 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:07.955257 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:07.954992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:07.955257 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:07.955039 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 02:18:07.955257 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:07.955053 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d95f94b89-svvmz: secret "image-registry-tls" not found Jul 07 02:18:07.955257 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:07.955128 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls podName:4694dda2-8a20-4adf-8784-0b8b5ae18853 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:11.955114831 +0000 UTC m=+46.593662271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls") pod "image-registry-d95f94b89-svvmz" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853") : secret "image-registry-tls" not found Jul 07 02:18:07.955257 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:07.955162 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:18:07.955257 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:07.955217 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls podName:f62fb499-e7dd-4581-b2ac-7134d43885d6 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:11.955202512 +0000 UTC m=+46.593749967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls") pod "dns-default-79pqc" (UID: "f62fb499-e7dd-4581-b2ac-7134d43885d6") : secret "dns-default-metrics-tls" not found Jul 07 02:18:08.177739 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:08.177661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:08.224665 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:08.224634 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zptq2" event={"ID":"c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5","Type":"ContainerStarted","Data":"bf14d23066b1b669e94dc856334af4c008dd05fdb2a22fad9d3996135ad60b28"} Jul 07 02:18:08.246338 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:08.246296 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zptq2" podStartSLOduration=1.062368116 podStartE2EDuration="4.246281862s" totalImagesPullingTime="3.183913746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:08.245240222 +0000 UTC m=+42.883787735" watchObservedRunningTime="2026-07-07 02:18:08.246281862 +0000 UTC m=+42.884829365" Jul 07 02:18:08.279068 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:08.279023 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:10.694348 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:10.694184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:10.746450 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:10.746417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:11.988466 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:11.988432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:11.988870 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:11.988478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:11.988870 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:11.988610 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 02:18:11.988870 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:11.988629 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:18:11.988870 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:11.988681 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls podName:f62fb499-e7dd-4581-b2ac-7134d43885d6 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:19.988668016 +0000 UTC m=+54.627215468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls") pod "dns-default-79pqc" (UID: "f62fb499-e7dd-4581-b2ac-7134d43885d6") : secret "dns-default-metrics-tls" not found Jul 07 02:18:11.988870 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:11.988630 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d95f94b89-svvmz: secret "image-registry-tls" not found Jul 07 02:18:11.988870 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:11.988785 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls podName:4694dda2-8a20-4adf-8784-0b8b5ae18853 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:19.988768383 +0000 UTC m=+54.627315840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls") pod "image-registry-d95f94b89-svvmz" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853") : secret "image-registry-tls" not found Jul 07 02:18:12.161356 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:12.161323 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:13.455595 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:13.455560 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:15.689518 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:15.689487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:15.790742 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:15.790717 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:20.045202 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:20.045161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:20.045616 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:20.045216 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:20.045616 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:20.045293 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 02:18:20.045616 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:20.045307 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:18:20.045616 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:20.045350 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls podName:f62fb499-e7dd-4581-b2ac-7134d43885d6 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:36.045337105 +0000 UTC m=+70.683884557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls") pod "dns-default-79pqc" (UID: "f62fb499-e7dd-4581-b2ac-7134d43885d6") : secret "dns-default-metrics-tls" not found Jul 07 02:18:20.045616 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:20.045309 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d95f94b89-svvmz: secret "image-registry-tls" not found Jul 07 02:18:20.045616 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:20.045378 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls podName:4694dda2-8a20-4adf-8784-0b8b5ae18853 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:36.045372491 +0000 UTC m=+70.683919931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls") pod "image-registry-d95f94b89-svvmz" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853") : secret "image-registry-tls" not found Jul 07 02:18:20.733509 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:20.733478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:20.834771 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:20.834740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:22.407734 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:22.407700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:22.507613 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:22.507587 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:23.387884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:23.387858 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:23.486991 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:23.486966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:23.544016 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:23.543993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:24.905890 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:24.905853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:25.008000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:25.007968 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:25.275149 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:25.275086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:25.375787 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:25.375763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:27.353442 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:27.353409 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:28.200541 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:28.200515 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgzqf" Jul 07 02:18:28.371221 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:28.371192 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:28.441213 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:28.441170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:28.500256 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:28.500194 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:31.624742 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.624710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:18:31.625108 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.624768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:18:31.627562 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.627542 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 02:18:31.627604 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.627574 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 02:18:31.635520 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:31.635499 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 02:18:31.635591 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:31.635579 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs podName:b97e940f-a181-47cc-90a5-44d21de2d90a nodeName:}" failed. No retries permitted until 2026-07-07 02:19:35.635559353 +0000 UTC m=+130.274106810 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs") pod "network-metrics-daemon-869ts" (UID: "b97e940f-a181-47cc-90a5-44d21de2d90a") : secret "metrics-daemon-secret" not found Jul 07 02:18:31.637772 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.637760 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 02:18:31.648970 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.648945 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddmtj\" (UniqueName: \"kubernetes.io/projected/b791375a-f6c8-4447-a56a-ddf0e0e81104-kube-api-access-ddmtj\") pod \"network-check-target-tn2cj\" (UID: \"b791375a-f6c8-4447-a56a-ddf0e0e81104\") " pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:18:31.725153 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.725126 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:18:31.727277 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.727263 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 02:18:31.737762 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.737740 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/577de535-0a79-49c5-9b3c-0fb44fa3d22b-original-pull-secret\") pod \"global-pull-secret-syncer-fzdbj\" (UID: \"577de535-0a79-49c5-9b3c-0fb44fa3d22b\") " pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:18:31.738257 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.738243 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hf7w2\"" Jul 07 02:18:31.740952 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.740935 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzdbj" Jul 07 02:18:31.746202 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.746189 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:18:31.877038 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.876982 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tn2cj"] Jul 07 02:18:31.879992 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:18:31.879964 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb791375a_f6c8_4447_a56a_ddf0e0e81104.slice/crio-2c257a3016d75908d8cd63787c50d946d9c529e4e254fc4a9ddce23e8b3b03f0 WatchSource:0}: Error finding container 2c257a3016d75908d8cd63787c50d946d9c529e4e254fc4a9ddce23e8b3b03f0: Status 404 returned error can't find the container with id 2c257a3016d75908d8cd63787c50d946d9c529e4e254fc4a9ddce23e8b3b03f0 Jul 07 02:18:31.892102 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:31.892050 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzdbj"] Jul 07 02:18:31.895303 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:18:31.895273 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577de535_0a79_49c5_9b3c_0fb44fa3d22b.slice/crio-ccae3cdfece1444e6d082074f4bd261d6a8251404d9d3379ae72f7696d456251 WatchSource:0}: Error finding container ccae3cdfece1444e6d082074f4bd261d6a8251404d9d3379ae72f7696d456251: Status 404 returned error can't find the container with id ccae3cdfece1444e6d082074f4bd261d6a8251404d9d3379ae72f7696d456251 Jul 07 02:18:32.277436 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:32.277357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tn2cj" event={"ID":"b791375a-f6c8-4447-a56a-ddf0e0e81104","Type":"ContainerStarted","Data":"2c257a3016d75908d8cd63787c50d946d9c529e4e254fc4a9ddce23e8b3b03f0"} Jul 07 02:18:32.278370 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:32.278349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzdbj" event={"ID":"577de535-0a79-49c5-9b3c-0fb44fa3d22b","Type":"ContainerStarted","Data":"ccae3cdfece1444e6d082074f4bd261d6a8251404d9d3379ae72f7696d456251"} Jul 07 02:18:36.058682 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:36.058636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:18:36.059234 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:36.058723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:18:36.059234 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:36.058821 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 02:18:36.059234 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:36.058838 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 02:18:36.059234 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:36.058849 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d95f94b89-svvmz: secret "image-registry-tls" not found Jul 07 02:18:36.059234 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:36.058895 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls podName:f62fb499-e7dd-4581-b2ac-7134d43885d6 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:08.058880944 +0000 UTC m=+102.697428385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls") pod "dns-default-79pqc" (UID: "f62fb499-e7dd-4581-b2ac-7134d43885d6") : secret "dns-default-metrics-tls" not found Jul 07 02:18:36.059234 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:36.058930 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls podName:4694dda2-8a20-4adf-8784-0b8b5ae18853 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:08.058910117 +0000 UTC m=+102.697457562 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls") pod "image-registry-d95f94b89-svvmz" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853") : secret "image-registry-tls" not found Jul 07 02:18:36.119782 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:36.119697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:36.220066 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:36.220031 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:37.293486 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:37.293450 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tn2cj" event={"ID":"b791375a-f6c8-4447-a56a-ddf0e0e81104","Type":"ContainerStarted","Data":"afe62e5991b08107d6d403aff852a4ac2c793d8f2f2e269e616af682def58fa7"} Jul 07 02:18:37.293912 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:37.293508 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:18:37.294871 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:37.294847 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzdbj" event={"ID":"577de535-0a79-49c5-9b3c-0fb44fa3d22b","Type":"ContainerStarted","Data":"193ae07d0cd828a314ab163116e8ca9a0c3ab210c99a10ebbb8b3cceb66ccc5b"} Jul 07 02:18:37.311165 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:37.311122 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tn2cj" podStartSLOduration=66.518098281 podStartE2EDuration="1m11.311109849s" totalImagesPullingTime="4.793011568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:37.309818653 +0000 UTC m=+71.948366107" watchObservedRunningTime="2026-07-07 02:18:37.311109849 +0000 UTC m=+71.949657310" Jul 07 02:18:37.326336 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:37.326302 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fzdbj" podStartSLOduration=66.543827001 podStartE2EDuration="1m11.32629049s" totalImagesPullingTime="4.782463489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:37.325543851 +0000 UTC m=+71.964091314" watchObservedRunningTime="2026-07-07 02:18:37.32629049 +0000 UTC m=+71.964837944" Jul 07 02:18:39.057577 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.057542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:39.154036 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.154006 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:39.464294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.464268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:39.504692 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.504669 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck"] Jul 07 02:18:39.507578 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.507562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:39.510088 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.510058 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 02:18:39.510185 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.510058 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:18:39.510248 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.510177 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 02:18:39.510897 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.510878 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d7q82\"" Jul 07 02:18:39.518135 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.518116 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck"] Jul 07 02:18:39.551425 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.551402 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:39.584463 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.584443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:39.584522 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.584470 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc4rj\" (UniqueName: \"kubernetes.io/projected/6360a73c-534e-4ea2-bceb-5af51ec743d3-kube-api-access-vc4rj\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:39.650648 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.650624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:39.685741 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.685718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:39.685821 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.685743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc4rj\" (UniqueName: \"kubernetes.io/projected/6360a73c-534e-4ea2-bceb-5af51ec743d3-kube-api-access-vc4rj\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:39.685863 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:39.685847 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:18:39.685919 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:39.685908 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls podName:6360a73c-534e-4ea2-bceb-5af51ec743d3 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:40.185893725 +0000 UTC m=+74.824441165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lctck" (UID: "6360a73c-534e-4ea2-bceb-5af51ec743d3") : secret "samples-operator-tls" not found Jul 07 02:18:39.698966 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.698943 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc4rj\" (UniqueName: \"kubernetes.io/projected/6360a73c-534e-4ea2-bceb-5af51ec743d3-kube-api-access-vc4rj\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:39.718368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.718317 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4"] Jul 07 02:18:39.720258 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.720245 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.722437 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.722423 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 02:18:39.723119 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.723106 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:18:39.723193 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.723110 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pdjp8\"" Jul 07 02:18:39.723251 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.723110 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 02:18:39.723337 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.723316 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 02:18:39.735229 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.735204 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4"] Jul 07 02:18:39.786945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.786922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c7a8df0-afc0-433a-af09-fbe100857e12-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.787037 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.786955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7a8df0-afc0-433a-af09-fbe100857e12-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.787037 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.786993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rkkm\" (UniqueName: \"kubernetes.io/projected/5c7a8df0-afc0-433a-af09-fbe100857e12-kube-api-access-6rkkm\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.787774 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.787750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:39.809697 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.809675 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9"] Jul 07 02:18:39.811683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.811666 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" Jul 07 02:18:39.814069 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.814051 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 02:18:39.814180 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.814124 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fccz9\"" Jul 07 02:18:39.814180 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.814149 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 02:18:39.824120 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.824102 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9"] Jul 07 02:18:39.857989 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.857960 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:39.887995 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.887975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pwcg\" (UniqueName: \"kubernetes.io/projected/7fbabd1a-e6ce-4cc5-b226-05416f6b4414-kube-api-access-6pwcg\") pod \"volume-data-source-validator-5d456fdbcd-rqzq9\" (UID: \"7fbabd1a-e6ce-4cc5-b226-05416f6b4414\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" Jul 07 02:18:39.888069 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.888013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c7a8df0-afc0-433a-af09-fbe100857e12-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.888069 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.888039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7a8df0-afc0-433a-af09-fbe100857e12-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.888164 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.888121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rkkm\" (UniqueName: \"kubernetes.io/projected/5c7a8df0-afc0-433a-af09-fbe100857e12-kube-api-access-6rkkm\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.888456 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.888438 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c7a8df0-afc0-433a-af09-fbe100857e12-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.890054 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.890038 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7a8df0-afc0-433a-af09-fbe100857e12-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.896147 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.896129 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rkkm\" (UniqueName: \"kubernetes.io/projected/5c7a8df0-afc0-433a-af09-fbe100857e12-kube-api-access-6rkkm\") pod \"kube-storage-version-migrator-operator-846bf668f7-md2x4\" (UID: \"5c7a8df0-afc0-433a-af09-fbe100857e12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:39.989384 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:39.989337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pwcg\" (UniqueName: \"kubernetes.io/projected/7fbabd1a-e6ce-4cc5-b226-05416f6b4414-kube-api-access-6pwcg\") pod \"volume-data-source-validator-5d456fdbcd-rqzq9\" (UID: \"7fbabd1a-e6ce-4cc5-b226-05416f6b4414\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" Jul 07 02:18:40.007397 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.007370 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pwcg\" (UniqueName: \"kubernetes.io/projected/7fbabd1a-e6ce-4cc5-b226-05416f6b4414-kube-api-access-6pwcg\") pod \"volume-data-source-validator-5d456fdbcd-rqzq9\" (UID: \"7fbabd1a-e6ce-4cc5-b226-05416f6b4414\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" Jul 07 02:18:40.029027 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.029010 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" Jul 07 02:18:40.119808 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.119784 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" Jul 07 02:18:40.145890 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.145863 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4"] Jul 07 02:18:40.149273 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:18:40.149243 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7a8df0_afc0_433a_af09_fbe100857e12.slice/crio-ded841a861ac4bf83ffdfff61afcc8bb8f21f29e964aa61b86ddbcd7a95b6d0d WatchSource:0}: Error finding container ded841a861ac4bf83ffdfff61afcc8bb8f21f29e964aa61b86ddbcd7a95b6d0d: Status 404 returned error can't find the container with id ded841a861ac4bf83ffdfff61afcc8bb8f21f29e964aa61b86ddbcd7a95b6d0d Jul 07 02:18:40.191036 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.191010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:40.191178 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:40.191139 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:18:40.191239 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:40.191189 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls podName:6360a73c-534e-4ea2-bceb-5af51ec743d3 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:41.191175499 +0000 UTC m=+75.829722939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lctck" (UID: "6360a73c-534e-4ea2-bceb-5af51ec743d3") : secret "samples-operator-tls" not found Jul 07 02:18:40.237053 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.237030 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9"] Jul 07 02:18:40.239872 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:18:40.239819 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbabd1a_e6ce_4cc5_b226_05416f6b4414.slice/crio-8ddad23a6f7ff2b6c27edf6063c6b3ade06f74ee24a64934b6ed845d92900910 WatchSource:0}: Error finding container 8ddad23a6f7ff2b6c27edf6063c6b3ade06f74ee24a64934b6ed845d92900910: Status 404 returned error can't find the container with id 8ddad23a6f7ff2b6c27edf6063c6b3ade06f74ee24a64934b6ed845d92900910 Jul 07 02:18:40.302526 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.302486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" event={"ID":"5c7a8df0-afc0-433a-af09-fbe100857e12","Type":"ContainerStarted","Data":"ded841a861ac4bf83ffdfff61afcc8bb8f21f29e964aa61b86ddbcd7a95b6d0d"} Jul 07 02:18:40.303523 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:40.303502 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" event={"ID":"7fbabd1a-e6ce-4cc5-b226-05416f6b4414","Type":"ContainerStarted","Data":"8ddad23a6f7ff2b6c27edf6063c6b3ade06f74ee24a64934b6ed845d92900910"} Jul 07 02:18:41.199407 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:41.199375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:41.199833 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:41.199513 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:18:41.199833 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:41.199576 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls podName:6360a73c-534e-4ea2-bceb-5af51ec743d3 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:43.199561467 +0000 UTC m=+77.838108923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lctck" (UID: "6360a73c-534e-4ea2-bceb-5af51ec743d3") : secret "samples-operator-tls" not found Jul 07 02:18:42.310281 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:42.310242 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" event={"ID":"7fbabd1a-e6ce-4cc5-b226-05416f6b4414","Type":"ContainerStarted","Data":"d2a760cfd6b57c662a0cd8ea1dc2a84934f4b98d4894cdfea8d38d7f1c252498"} Jul 07 02:18:42.324565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:42.324520 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rqzq9" podStartSLOduration=2.208235747 podStartE2EDuration="3.324505916s" totalImagesPullingTime="1.116270169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:42.323661675 +0000 UTC m=+76.962209139" watchObservedRunningTime="2026-07-07 02:18:42.324505916 +0000 UTC m=+76.963053377" Jul 07 02:18:42.397089 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:42.397044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:42.451727 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:42.451694 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:43.214346 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:43.214316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:43.214513 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:43.214489 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:18:43.214586 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:43.214575 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls podName:6360a73c-534e-4ea2-bceb-5af51ec743d3 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:47.214554032 +0000 UTC m=+81.853101489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lctck" (UID: "6360a73c-534e-4ea2-bceb-5af51ec743d3") : secret "samples-operator-tls" not found Jul 07 02:18:43.314823 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:43.314781 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" event={"ID":"5c7a8df0-afc0-433a-af09-fbe100857e12","Type":"ContainerStarted","Data":"292da787d6a53aaa06a55ceff5721bf156f712d12130b4d23df9a10dca331520"} Jul 07 02:18:43.330550 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:43.330506 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" podStartSLOduration=2.191805906 podStartE2EDuration="4.330492784s" totalImagesPullingTime="2.138686878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:43.328949807 +0000 UTC m=+77.967497271" watchObservedRunningTime="2026-07-07 02:18:43.330492784 +0000 UTC m=+77.969040279" Jul 07 02:18:43.749029 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:43.748993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:43.856567 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:43.856522 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:43.956807 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:43.956777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:44.069861 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.069793 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p44zv"] Jul 07 02:18:44.072937 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.072917 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.075634 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.075615 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 02:18:44.075746 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.075619 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 02:18:44.078133 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.078112 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vqqxg\"" Jul 07 02:18:44.078248 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.078112 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 02:18:44.078248 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.078148 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 02:18:44.086869 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.086850 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p44zv"] Jul 07 02:18:44.104695 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.104664 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:44.121435 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.121411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebad2aed-7d71-47f9-b09f-1cd367e448c5-data-volume\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.121534 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.121439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.121534 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.121461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebad2aed-7d71-47f9-b09f-1cd367e448c5-crio-socket\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.121534 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.121477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.121645 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.121567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnkr8\" (UniqueName: \"kubernetes.io/projected/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-api-access-wnkr8\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.184183 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.184151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:44.222817 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.222787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebad2aed-7d71-47f9-b09f-1cd367e448c5-crio-socket\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.222899 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.222821 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.222899 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.222873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnkr8\" (UniqueName: \"kubernetes.io/projected/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-api-access-wnkr8\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.222974 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.222905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebad2aed-7d71-47f9-b09f-1cd367e448c5-crio-socket\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.222974 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.222957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebad2aed-7d71-47f9-b09f-1cd367e448c5-data-volume\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.223036 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.222975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.223068 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.223044 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:18:44.223145 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.223133 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:44.723116052 +0000 UTC m=+79.361663493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : configmap "kube-rbac-proxy" not found Jul 07 02:18:44.223195 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.223152 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:18:44.223232 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.223210 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:44.723197409 +0000 UTC m=+79.361744848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : secret "insights-runtime-extractor-tls" not found Jul 07 02:18:44.223289 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.223275 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebad2aed-7d71-47f9-b09f-1cd367e448c5-data-volume\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.234973 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.234952 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnkr8\" (UniqueName: \"kubernetes.io/projected/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-api-access-wnkr8\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.656163 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.656132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:44.716749 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.716721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:44.726710 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.726683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.726829 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:44.726716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:44.726829 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.726816 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:18:44.726949 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.726829 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:18:44.726949 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.726871 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:45.726856265 +0000 UTC m=+80.365403720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : configmap "kube-rbac-proxy" not found Jul 07 02:18:44.726949 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:44.726887 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:45.726880072 +0000 UTC m=+80.365427514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : secret "insights-runtime-extractor-tls" not found Jul 07 02:18:45.160006 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:45.159978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:45.306304 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:45.306281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:45.421836 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:45.421771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:45.733789 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:45.733736 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:45.733789 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:45.733769 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:45.734171 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:45.733832 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:18:45.734171 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:45.733865 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:18:45.734171 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:45.733884 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:47.733872376 +0000 UTC m=+82.372419816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : configmap "kube-rbac-proxy" not found Jul 07 02:18:45.734171 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:45.733908 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:47.733897238 +0000 UTC m=+82.372444678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : secret "insights-runtime-extractor-tls" not found Jul 07 02:18:46.239418 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:46.239388 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:46.308568 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:46.308534 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:46.408518 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:46.408481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:46.646773 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:46.646751 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gp8l5_16079578-f1e9-414d-838b-7cb07834e773/dns-node-resolver/0.log" Jul 07 02:18:46.991307 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:46.991242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:47.052896 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:47.052852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:47.245210 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:47.245162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:47.245297 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:47.245285 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 02:18:47.245365 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:47.245356 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls podName:6360a73c-534e-4ea2-bceb-5af51ec743d3 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:55.245343742 +0000 UTC m=+89.883891181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lctck" (UID: "6360a73c-534e-4ea2-bceb-5af51ec743d3") : secret "samples-operator-tls" not found Jul 07 02:18:47.646413 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:47.646392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9jnrc_abfbe780-e372-4c34-ae0e-dba02527d71b/node-ca/0.log" Jul 07 02:18:47.749809 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:47.749781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:47.749910 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:47.749812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:47.749910 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:47.749896 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:18:47.749979 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:47.749917 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:18:47.749979 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:47.749958 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:51.749943196 +0000 UTC m=+86.388490649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : configmap "kube-rbac-proxy" not found Jul 07 02:18:47.749979 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:47.749972 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:51.749966316 +0000 UTC m=+86.388513756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : secret "insights-runtime-extractor-tls" not found Jul 07 02:18:47.910300 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:47.910231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:48.307309 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:48.307244 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:48.437143 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:48.437112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:48.556274 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:48.556241 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:48.701433 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:48.701404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:48.801971 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:48.801939 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:48.846580 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:48.846555 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zptq2_c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5/serve-healthcheck-canary/0.log" Jul 07 02:18:48.976602 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:48.976527 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:49.448155 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:49.448126 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-md2x4_5c7a8df0-afc0-433a-af09-fbe100857e12/kube-storage-version-migrator-operator/0.log" Jul 07 02:18:49.759187 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:49.759113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:50.383568 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:50.383543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:50.554096 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:50.554059 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:50.748480 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:50.748423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:50.946755 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:50.946725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:51.147021 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:51.146996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:51.747955 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:51.747926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:51.778005 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:51.777981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:51.778104 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:51.778013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:51.778146 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:51.778127 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 02:18:51.778186 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:51.778176 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:59.778162968 +0000 UTC m=+94.416710413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : secret "insights-runtime-extractor-tls" not found Jul 07 02:18:51.778232 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:51.778128 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 02:18:51.778271 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:18:51.778244 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm podName:ebad2aed-7d71-47f9-b09f-1cd367e448c5 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:59.778233232 +0000 UTC m=+94.416780672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p44zv" (UID: "ebad2aed-7d71-47f9-b09f-1cd367e448c5") : configmap "kube-rbac-proxy" not found Jul 07 02:18:51.948214 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:51.948190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:52.094566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:52.094532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:52.354717 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:52.354637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:52.549316 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:52.549287 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:52.748027 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:52.747956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:52.806287 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:52.806265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:53.146741 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:53.146719 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:53.752739 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:53.752710 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:54.147533 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:54.147503 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:54.349895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:54.349866 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:54.630548 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:54.630523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:54.950969 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:54.950898 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:55.300324 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:55.300264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:55.302496 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:55.302468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6360a73c-534e-4ea2-bceb-5af51ec743d3-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lctck\" (UID: \"6360a73c-534e-4ea2-bceb-5af51ec743d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:55.349837 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:55.349808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:55.415754 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:55.415719 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" Jul 07 02:18:55.537655 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:55.537627 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck"] Jul 07 02:18:55.546674 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:55.546645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:55.944611 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:55.944581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:56.347177 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:56.347110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" event={"ID":"6360a73c-534e-4ea2-bceb-5af51ec743d3","Type":"ContainerStarted","Data":"2e0415023c1d9cd6fe53c0bbb3d88222ec713327ee1fd8b2c9795cce65a987f6"} Jul 07 02:18:56.551240 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:56.551203 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:56.920471 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:56.920432 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:57.022005 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:57.021961 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:57.150377 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:57.150350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:57.352964 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:57.352920 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" event={"ID":"6360a73c-534e-4ea2-bceb-5af51ec743d3","Type":"ContainerStarted","Data":"f3577cc64fcfa7f6aac8f6f31f35f35f1e62c2ff681ab0fcbbb5d2c53114d36d"} Jul 07 02:18:57.353388 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:57.353024 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" event={"ID":"6360a73c-534e-4ea2-bceb-5af51ec743d3","Type":"ContainerStarted","Data":"9292ce7504468761bc98b2b4d5a2b5b6126ae625ef8edc7350ddb8fa82e13027"} Jul 07 02:18:57.373294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:57.373210 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lctck" podStartSLOduration=16.835446797 podStartE2EDuration="18.373194843s" totalImagesPullingTime="1.537748046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:57.372560035 +0000 UTC m=+92.011107510" watchObservedRunningTime="2026-07-07 02:18:57.373194843 +0000 UTC m=+92.011742304" Jul 07 02:18:57.571384 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:57.571313 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:58.163252 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:58.163223 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:58.550714 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:58.550636 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:58.750054 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:58.750027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:58.953280 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:58.953252 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:59.223636 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:59.223568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:18:59.833119 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:59.833092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:59.833449 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:59.833128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:59.833706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:59.833680 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebad2aed-7d71-47f9-b09f-1cd367e448c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:59.835286 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:59.835268 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebad2aed-7d71-47f9-b09f-1cd367e448c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p44zv\" (UID: \"ebad2aed-7d71-47f9-b09f-1cd367e448c5\") " pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:18:59.984034 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:18:59.984003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p44zv" Jul 07 02:19:00.106628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:00.106563 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p44zv"] Jul 07 02:19:00.109534 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:00.109511 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebad2aed_7d71_47f9_b09f_1cd367e448c5.slice/crio-4a667aa1c1c44844d2dbd3dc481dfa16789f144d6e10575ff771769805b159f4 WatchSource:0}: Error finding container 4a667aa1c1c44844d2dbd3dc481dfa16789f144d6e10575ff771769805b159f4: Status 404 returned error can't find the container with id 4a667aa1c1c44844d2dbd3dc481dfa16789f144d6e10575ff771769805b159f4 Jul 07 02:19:00.362728 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:00.362653 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p44zv" event={"ID":"ebad2aed-7d71-47f9-b09f-1cd367e448c5","Type":"ContainerStarted","Data":"4a667aa1c1c44844d2dbd3dc481dfa16789f144d6e10575ff771769805b159f4"} Jul 07 02:19:00.693226 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:00.693098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:00.793634 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:00.793583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:04.377839 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:04.377807 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p44zv" event={"ID":"ebad2aed-7d71-47f9-b09f-1cd367e448c5","Type":"ContainerStarted","Data":"1df281498b9217b0257ac8570eb6d63a1bb069fc889ef7960a8444909335c13b"} Jul 07 02:19:04.378136 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:04.377860 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p44zv" event={"ID":"ebad2aed-7d71-47f9-b09f-1cd367e448c5","Type":"ContainerStarted","Data":"d0b3731f0f1bdd6f5151d69ccf90dc9e689636cdf1c71ae1abb2049689fcafcc"} Jul 07 02:19:04.395902 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:04.395868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:04.496919 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:04.496862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:04.598045 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:04.598014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:04.876616 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:04.876581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:04.977500 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:04.977459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:05.077280 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:05.077247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:05.134368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:05.134292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:05.271867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:05.271840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:05.333897 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:05.333864 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:06.087616 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:06.087573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:06.285314 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:06.285278 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:06.694713 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:06.694675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:06.795299 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:06.795265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:08.095716 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.095690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:19:08.096026 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.095735 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:19:08.098174 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.098145 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62fb499-e7dd-4581-b2ac-7134d43885d6-metrics-tls\") pod \"dns-default-79pqc\" (UID: \"f62fb499-e7dd-4581-b2ac-7134d43885d6\") " pod="openshift-dns/dns-default-79pqc" Jul 07 02:19:08.098281 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.098197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"image-registry-d95f94b89-svvmz\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:19:08.118257 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.118238 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lwxwm\"" Jul 07 02:19:08.127114 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.127094 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:19:08.135519 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.135503 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc8t9\"" Jul 07 02:19:08.143706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.143691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79pqc" Jul 07 02:19:08.272653 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.272614 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d95f94b89-svvmz"] Jul 07 02:19:08.276481 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:08.276455 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4694dda2_8a20_4adf_8784_0b8b5ae18853.slice/crio-27cd6a1594e2888db4c5e876976a4d7ad3f42918c902b3bea35768465c8eb8b0 WatchSource:0}: Error finding container 27cd6a1594e2888db4c5e876976a4d7ad3f42918c902b3bea35768465c8eb8b0: Status 404 returned error can't find the container with id 27cd6a1594e2888db4c5e876976a4d7ad3f42918c902b3bea35768465c8eb8b0 Jul 07 02:19:08.285046 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.285025 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79pqc"] Jul 07 02:19:08.288530 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:08.288506 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62fb499_e7dd_4581_b2ac_7134d43885d6.slice/crio-586bbaee9144ace57fa2aa19cd1c77b42af1defbd977545c161adaaf61b3c61b WatchSource:0}: Error finding container 586bbaee9144ace57fa2aa19cd1c77b42af1defbd977545c161adaaf61b3c61b: Status 404 returned error can't find the container with id 586bbaee9144ace57fa2aa19cd1c77b42af1defbd977545c161adaaf61b3c61b Jul 07 02:19:08.300164 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.300144 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tn2cj" Jul 07 02:19:08.393816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.393747 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p44zv" event={"ID":"ebad2aed-7d71-47f9-b09f-1cd367e448c5","Type":"ContainerStarted","Data":"119954bea380aa5dcebfa1a8dbf2108c8f8bfdd9280e892ebd40cdd6a408e7b6"} Jul 07 02:19:08.395000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.394975 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79pqc" event={"ID":"f62fb499-e7dd-4581-b2ac-7134d43885d6","Type":"ContainerStarted","Data":"586bbaee9144ace57fa2aa19cd1c77b42af1defbd977545c161adaaf61b3c61b"} Jul 07 02:19:08.396325 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.396301 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" event={"ID":"4694dda2-8a20-4adf-8784-0b8b5ae18853","Type":"ContainerStarted","Data":"06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e"} Jul 07 02:19:08.396411 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.396338 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" event={"ID":"4694dda2-8a20-4adf-8784-0b8b5ae18853","Type":"ContainerStarted","Data":"27cd6a1594e2888db4c5e876976a4d7ad3f42918c902b3bea35768465c8eb8b0"} Jul 07 02:19:08.396474 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.396432 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:19:08.411786 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.411743 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p44zv" podStartSLOduration=17.108504039 podStartE2EDuration="24.411729126s" totalImagesPullingTime="7.303225087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:18:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:08.411306243 +0000 UTC m=+103.049853704" watchObservedRunningTime="2026-07-07 02:19:08.411729126 +0000 UTC m=+103.050276619" Jul 07 02:19:08.431226 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:08.431191 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" podStartSLOduration=102.43117828 podStartE2EDuration="1m42.43117828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:08.43015549 +0000 UTC m=+103.068702956" watchObservedRunningTime="2026-07-07 02:19:08.43117828 +0000 UTC m=+103.069725742" Jul 07 02:19:10.328091 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.328048 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj"] Jul 07 02:19:10.331360 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.331337 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.334414 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.334372 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 02:19:10.335182 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.335161 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 02:19:10.335794 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.335780 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 02:19:10.336595 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.336542 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 02:19:10.357803 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.357780 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj"] Jul 07 02:19:10.404156 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.404125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79pqc" event={"ID":"f62fb499-e7dd-4581-b2ac-7134d43885d6","Type":"ContainerStarted","Data":"b829c71f979a9215ae3e657f77f0cc37cb2b7453b49a121f0c117ffd13ce8b14"} Jul 07 02:19:10.404303 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.404210 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79pqc" event={"ID":"f62fb499-e7dd-4581-b2ac-7134d43885d6","Type":"ContainerStarted","Data":"47c247b329fa1d7c5f98d003ae38cbf4526f0d1b6149d11804913f401529cd4a"} Jul 07 02:19:10.404303 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.404251 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-79pqc" Jul 07 02:19:10.411604 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.411581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/388efe2f-b79d-46b6-9a9b-38057649fde6-tmp\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.411645 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.411624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd26m\" (UniqueName: \"kubernetes.io/projected/388efe2f-b79d-46b6-9a9b-38057649fde6-kube-api-access-hd26m\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.411745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.411731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/388efe2f-b79d-46b6-9a9b-38057649fde6-klusterlet-config\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.414759 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.414739 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh"] Jul 07 02:19:10.417492 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.417479 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-lx6xw"] Jul 07 02:19:10.417592 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.417578 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.419928 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.419908 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 02:19:10.420123 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.420110 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 02:19:10.420178 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.420134 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vdv7q\"" Jul 07 02:19:10.420850 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.420832 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-lx6xw" Jul 07 02:19:10.424346 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.424325 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lxtvh\"" Jul 07 02:19:10.424435 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.424365 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 02:19:10.424653 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.424638 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 02:19:10.436208 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.436185 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh"] Jul 07 02:19:10.437162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.437140 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-lx6xw"] Jul 07 02:19:10.437322 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.437288 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-79pqc" podStartSLOduration=64.954236829 podStartE2EDuration="1m6.437275335s" totalImagesPullingTime="1.483038506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:10.435551161 +0000 UTC m=+105.074098620" watchObservedRunningTime="2026-07-07 02:19:10.437275335 +0000 UTC m=+105.075822798" Jul 07 02:19:10.509311 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.509275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:10.512231 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.512215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/388efe2f-b79d-46b6-9a9b-38057649fde6-klusterlet-config\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.512297 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.512242 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/51613292-2eb0-4907-8e49-28dcd69711e9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cb9nh\" (UID: \"51613292-2eb0-4907-8e49-28dcd69711e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.512297 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.512275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/388efe2f-b79d-46b6-9a9b-38057649fde6-tmp\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.512420 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.512402 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd26m\" (UniqueName: \"kubernetes.io/projected/388efe2f-b79d-46b6-9a9b-38057649fde6-kube-api-access-hd26m\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.512496 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.512477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51613292-2eb0-4907-8e49-28dcd69711e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cb9nh\" (UID: \"51613292-2eb0-4907-8e49-28dcd69711e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.512565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.512512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg977\" (UniqueName: \"kubernetes.io/projected/bf7bee26-c94b-4132-a261-e939eb2c5a35-kube-api-access-xg977\") pod \"downloads-685bfb5f64-lx6xw\" (UID: \"bf7bee26-c94b-4132-a261-e939eb2c5a35\") " pod="openshift-console/downloads-685bfb5f64-lx6xw" Jul 07 02:19:10.512712 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.512692 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/388efe2f-b79d-46b6-9a9b-38057649fde6-tmp\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.514589 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.514569 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/388efe2f-b79d-46b6-9a9b-38057649fde6-klusterlet-config\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.529891 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.529873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd26m\" (UniqueName: \"kubernetes.io/projected/388efe2f-b79d-46b6-9a9b-38057649fde6-kube-api-access-hd26m\") pod \"klusterlet-addon-workmgr-956897d89-dwznj\" (UID: \"388efe2f-b79d-46b6-9a9b-38057649fde6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.601908 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.601840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:10.613470 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.613449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51613292-2eb0-4907-8e49-28dcd69711e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cb9nh\" (UID: \"51613292-2eb0-4907-8e49-28dcd69711e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.613537 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.613475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg977\" (UniqueName: \"kubernetes.io/projected/bf7bee26-c94b-4132-a261-e939eb2c5a35-kube-api-access-xg977\") pod \"downloads-685bfb5f64-lx6xw\" (UID: \"bf7bee26-c94b-4132-a261-e939eb2c5a35\") " pod="openshift-console/downloads-685bfb5f64-lx6xw" Jul 07 02:19:10.613537 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.613504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/51613292-2eb0-4907-8e49-28dcd69711e9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cb9nh\" (UID: \"51613292-2eb0-4907-8e49-28dcd69711e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.614091 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.614056 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/51613292-2eb0-4907-8e49-28dcd69711e9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cb9nh\" (UID: \"51613292-2eb0-4907-8e49-28dcd69711e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.615497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.615472 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51613292-2eb0-4907-8e49-28dcd69711e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cb9nh\" (UID: \"51613292-2eb0-4907-8e49-28dcd69711e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.627854 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.627834 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg977\" (UniqueName: \"kubernetes.io/projected/bf7bee26-c94b-4132-a261-e939eb2c5a35-kube-api-access-xg977\") pod \"downloads-685bfb5f64-lx6xw\" (UID: \"bf7bee26-c94b-4132-a261-e939eb2c5a35\") " pod="openshift-console/downloads-685bfb5f64-lx6xw" Jul 07 02:19:10.640649 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.640625 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:10.698924 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.698890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:10.727303 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.727281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" Jul 07 02:19:10.732407 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.732368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-lx6xw" Jul 07 02:19:10.770155 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.770045 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj"] Jul 07 02:19:10.775847 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:10.775808 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388efe2f_b79d_46b6_9a9b_38057649fde6.slice/crio-2325f170c734997ddf03c80312bbd09dbb871a834f2f3273bb7e556fe8220b62 WatchSource:0}: Error finding container 2325f170c734997ddf03c80312bbd09dbb871a834f2f3273bb7e556fe8220b62: Status 404 returned error can't find the container with id 2325f170c734997ddf03c80312bbd09dbb871a834f2f3273bb7e556fe8220b62 Jul 07 02:19:10.799310 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.799097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:10.866304 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.866284 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh"] Jul 07 02:19:10.867847 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:10.867822 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51613292_2eb0_4907_8e49_28dcd69711e9.slice/crio-0ac993b5db92f95441b3d612df94c5a833f59e06b30986fa778c45dac1282139 WatchSource:0}: Error finding container 0ac993b5db92f95441b3d612df94c5a833f59e06b30986fa778c45dac1282139: Status 404 returned error can't find the container with id 0ac993b5db92f95441b3d612df94c5a833f59e06b30986fa778c45dac1282139 Jul 07 02:19:10.882487 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:10.882462 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-lx6xw"] Jul 07 02:19:10.884963 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:10.884935 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7bee26_c94b_4132_a261_e939eb2c5a35.slice/crio-01f0b772d152877dcf35b5a5d7d5629901c0b7a93e213fd332bb0f21078cfd43 WatchSource:0}: Error finding container 01f0b772d152877dcf35b5a5d7d5629901c0b7a93e213fd332bb0f21078cfd43: Status 404 returned error can't find the container with id 01f0b772d152877dcf35b5a5d7d5629901c0b7a93e213fd332bb0f21078cfd43 Jul 07 02:19:11.172556 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:11.172462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:11.239864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:11.239835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:11.410207 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:11.410167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" event={"ID":"51613292-2eb0-4907-8e49-28dcd69711e9","Type":"ContainerStarted","Data":"0ac993b5db92f95441b3d612df94c5a833f59e06b30986fa778c45dac1282139"} Jul 07 02:19:11.411548 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:11.411513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-lx6xw" event={"ID":"bf7bee26-c94b-4132-a261-e939eb2c5a35","Type":"ContainerStarted","Data":"01f0b772d152877dcf35b5a5d7d5629901c0b7a93e213fd332bb0f21078cfd43"} Jul 07 02:19:11.412925 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:11.412884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" event={"ID":"388efe2f-b79d-46b6-9a9b-38057649fde6","Type":"ContainerStarted","Data":"2325f170c734997ddf03c80312bbd09dbb871a834f2f3273bb7e556fe8220b62"} Jul 07 02:19:12.420014 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:12.419976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" event={"ID":"51613292-2eb0-4907-8e49-28dcd69711e9","Type":"ContainerStarted","Data":"85df3d2ad6a611e8b40a5bc0d0db9e566ac43cad3e9885e8610b04bbe2f64674"} Jul 07 02:19:12.436616 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:12.436200 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cb9nh" podStartSLOduration=1.357832603 podStartE2EDuration="2.436178915s" totalImagesPullingTime="1.078346312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:12.434896116 +0000 UTC m=+107.073443583" watchObservedRunningTime="2026-07-07 02:19:12.436178915 +0000 UTC m=+107.074726379" Jul 07 02:19:12.529821 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:12.529688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:12.631089 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:12.631045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:14.016020 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.015985 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:14.112848 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.112734 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:14.179205 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.178872 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66"] Jul 07 02:19:14.180195 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.180128 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:14.182988 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.182967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:14.185534 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.185509 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 02:19:14.185646 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.185571 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wxgb7\"" Jul 07 02:19:14.191506 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.190887 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66"] Jul 07 02:19:14.340853 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.340814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c409ff83-40af-4c51-b496-bf10e487cf12-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-bls66\" (UID: \"c409ff83-40af-4c51-b496-bf10e487cf12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:14.442257 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.442221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c409ff83-40af-4c51-b496-bf10e487cf12-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-bls66\" (UID: \"c409ff83-40af-4c51-b496-bf10e487cf12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:14.442437 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:19:14.442408 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 02:19:14.442496 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:19:14.442489 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c409ff83-40af-4c51-b496-bf10e487cf12-tls-certificates podName:c409ff83-40af-4c51-b496-bf10e487cf12 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:14.942473162 +0000 UTC m=+109.581020602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c409ff83-40af-4c51-b496-bf10e487cf12-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-bls66" (UID: "c409ff83-40af-4c51-b496-bf10e487cf12") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 02:19:14.533719 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.533636 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:14.923061 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.923027 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b8b499f45-kpfxv"] Jul 07 02:19:14.927396 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.927370 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:14.929770 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.929740 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 02:19:14.929770 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.929765 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 02:19:14.929931 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.929797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fmphb\"" Jul 07 02:19:14.930669 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.930644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 02:19:14.930777 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.930648 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 02:19:14.930777 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.930683 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 02:19:14.937278 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.937224 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8b499f45-kpfxv"] Jul 07 02:19:14.945915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.945890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c409ff83-40af-4c51-b496-bf10e487cf12-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-bls66\" (UID: \"c409ff83-40af-4c51-b496-bf10e487cf12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:14.948698 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:14.948653 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c409ff83-40af-4c51-b496-bf10e487cf12-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-bls66\" (UID: \"c409ff83-40af-4c51-b496-bf10e487cf12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:15.047013 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.046972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-serving-cert\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.047448 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.047020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-oauth-serving-cert\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.047448 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.047048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-service-ca\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.047448 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.047146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-config\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.047448 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.047188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-oauth-config\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.047448 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.047217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmdr7\" (UniqueName: \"kubernetes.io/projected/65e6101f-78cb-4c0e-9f51-3b919be17cc4-kube-api-access-bmdr7\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.095294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.095231 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:15.148197 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.148163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-config\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.148309 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.148214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-oauth-config\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.148309 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.148246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmdr7\" (UniqueName: \"kubernetes.io/projected/65e6101f-78cb-4c0e-9f51-3b919be17cc4-kube-api-access-bmdr7\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.148430 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.148329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-serving-cert\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.148430 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.148363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-oauth-serving-cert\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.148430 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.148389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-service-ca\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.149109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.149067 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-service-ca\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.149919 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.149796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-config\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.150028 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.150006 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-oauth-serving-cert\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.151792 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.151770 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-oauth-config\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.151929 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.151906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-serving-cert\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.158562 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.158538 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmdr7\" (UniqueName: \"kubernetes.io/projected/65e6101f-78cb-4c0e-9f51-3b919be17cc4-kube-api-access-bmdr7\") pod \"console-7b8b499f45-kpfxv\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.240599 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.240539 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:15.553375 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.553347 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8b499f45-kpfxv"] Jul 07 02:19:15.558460 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:15.558392 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e6101f_78cb_4c0e_9f51_3b919be17cc4.slice/crio-974b761d4bfc5b778095c1f52ccf1388cd9fa89abc35b3c616ec6f9533f13bb3 WatchSource:0}: Error finding container 974b761d4bfc5b778095c1f52ccf1388cd9fa89abc35b3c616ec6f9533f13bb3: Status 404 returned error can't find the container with id 974b761d4bfc5b778095c1f52ccf1388cd9fa89abc35b3c616ec6f9533f13bb3 Jul 07 02:19:15.561664 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:15.561641 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66"] Jul 07 02:19:15.564399 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:15.564375 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc409ff83_40af_4c51_b496_bf10e487cf12.slice/crio-573485f992049fc701def69a5e10692c1da939fa8462f35542549516315933d2 WatchSource:0}: Error finding container 573485f992049fc701def69a5e10692c1da939fa8462f35542549516315933d2: Status 404 returned error can't find the container with id 573485f992049fc701def69a5e10692c1da939fa8462f35542549516315933d2 Jul 07 02:19:16.299324 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.299277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:16.354333 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.354300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:16.440610 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.440575 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" event={"ID":"388efe2f-b79d-46b6-9a9b-38057649fde6","Type":"ContainerStarted","Data":"f6590a8910c2f6ab09f80de03a7ee38907aa5976bdc39c4744d90fc632618f90"} Jul 07 02:19:16.441294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.441117 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:16.442982 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.442963 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" Jul 07 02:19:16.443148 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.443000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" event={"ID":"c409ff83-40af-4c51-b496-bf10e487cf12","Type":"ContainerStarted","Data":"573485f992049fc701def69a5e10692c1da939fa8462f35542549516315933d2"} Jul 07 02:19:16.444498 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.444474 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8b499f45-kpfxv" event={"ID":"65e6101f-78cb-4c0e-9f51-3b919be17cc4","Type":"ContainerStarted","Data":"974b761d4bfc5b778095c1f52ccf1388cd9fa89abc35b3c616ec6f9533f13bb3"} Jul 07 02:19:16.462482 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:16.462424 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-956897d89-dwznj" podStartSLOduration=1.7562678680000001 podStartE2EDuration="6.462405628s" totalImagesPullingTime="4.70613776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:16.460883885 +0000 UTC m=+111.099431349" watchObservedRunningTime="2026-07-07 02:19:16.462405628 +0000 UTC m=+111.100953091" Jul 07 02:19:17.451467 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:17.451409 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" event={"ID":"c409ff83-40af-4c51-b496-bf10e487cf12","Type":"ContainerStarted","Data":"3a17a25449dbbca3d2cbfd73c654a2852ebef42384bb0109b7ada1d24c86340d"} Jul 07 02:19:17.451884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:17.451675 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:17.457310 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:17.457289 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" Jul 07 02:19:17.467935 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:17.467878 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bls66" podStartSLOduration=2.220329165 podStartE2EDuration="3.467861899s" totalImagesPullingTime="1.247532734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:17.467824554 +0000 UTC m=+112.106372018" watchObservedRunningTime="2026-07-07 02:19:17.467861899 +0000 UTC m=+112.106409362" Jul 07 02:19:18.240622 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:18.240563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:18.332792 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:18.332677 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:18.386806 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:18.386730 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:19.413491 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:19.413453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:19.461660 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:19.461630 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8b499f45-kpfxv" event={"ID":"65e6101f-78cb-4c0e-9f51-3b919be17cc4","Type":"ContainerStarted","Data":"01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc"} Jul 07 02:19:19.481393 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:19.481199 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b8b499f45-kpfxv" podStartSLOduration=2.2781617450000002 podStartE2EDuration="5.481181525s" totalImagesPullingTime="3.20301978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:19.479794744 +0000 UTC m=+114.118342209" watchObservedRunningTime="2026-07-07 02:19:19.481181525 +0000 UTC m=+114.119728986" Jul 07 02:19:19.481543 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:19.481503 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:20.223772 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:20.223713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:20.324313 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:20.324280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:20.415688 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:20.415665 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-79pqc" Jul 07 02:19:20.491599 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:20.491482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:20.593139 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:20.593093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:21.930755 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:21.930722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:22.360240 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.360206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:22.593264 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.593200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:22.609452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.609415 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb"] Jul 07 02:19:22.613944 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.613888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.616581 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.616555 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 02:19:22.616746 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.616730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 02:19:22.617505 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.617485 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kqwns\"" Jul 07 02:19:22.617612 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.617586 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 02:19:22.617684 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.617624 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 02:19:22.617803 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.617759 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 02:19:22.624192 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.624151 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb"] Jul 07 02:19:22.653046 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.653014 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qt75v"] Jul 07 02:19:22.656452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.656430 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.659566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.659539 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 02:19:22.659672 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.659543 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 02:19:22.659672 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.659549 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 02:19:22.659672 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.659624 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gwsnb\"" Jul 07 02:19:22.681750 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.681721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:22.705744 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.705711 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca3d0830-af64-441c-b5a0-44f7479ffc14-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.705889 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.705774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3d0830-af64-441c-b5a0-44f7479ffc14-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.705889 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.705806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d0830-af64-441c-b5a0-44f7479ffc14-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.705889 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.705877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xtml\" (UniqueName: \"kubernetes.io/projected/ca3d0830-af64-441c-b5a0-44f7479ffc14-kube-api-access-6xtml\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.744384 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.744354 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:22.806526 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806496 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca3d0830-af64-441c-b5a0-44f7479ffc14-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.806664 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806550 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-textfile\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.806664 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3d0830-af64-441c-b5a0-44f7479ffc14-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.806664 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-root\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.806664 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d0830-af64-441c-b5a0-44f7479ffc14-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.806873 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806693 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-tls\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.806873 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.806873 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806783 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-sys\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.806873 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pn5r\" (UniqueName: \"kubernetes.io/projected/1841cc50-d0f5-4332-84eb-aba938b3c27f-kube-api-access-9pn5r\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.806873 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1841cc50-d0f5-4332-84eb-aba938b3c27f-metrics-client-ca\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.807186 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806904 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-wtmp\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.807186 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-accelerators-collector-config\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.807186 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.806994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xtml\" (UniqueName: \"kubernetes.io/projected/ca3d0830-af64-441c-b5a0-44f7479ffc14-kube-api-access-6xtml\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.807499 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.807452 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d0830-af64-441c-b5a0-44f7479ffc14-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.809308 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.809282 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca3d0830-af64-441c-b5a0-44f7479ffc14-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.809528 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.809508 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca3d0830-af64-441c-b5a0-44f7479ffc14-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.814980 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.814952 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xtml\" (UniqueName: \"kubernetes.io/projected/ca3d0830-af64-441c-b5a0-44f7479ffc14-kube-api-access-6xtml\") pod \"openshift-state-metrics-54cf96dfcf-s27nb\" (UID: \"ca3d0830-af64-441c-b5a0-44f7479ffc14\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.848834 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.848803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:22.907491 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1841cc50-d0f5-4332-84eb-aba938b3c27f-metrics-client-ca\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907491 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-wtmp\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907493 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-accelerators-collector-config\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-textfile\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-root\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907633 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-wtmp\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907648 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-tls\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907906 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907906 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-sys\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.907906 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.907757 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn5r\" (UniqueName: \"kubernetes.io/projected/1841cc50-d0f5-4332-84eb-aba938b3c27f-kube-api-access-9pn5r\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.908179 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.908056 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1841cc50-d0f5-4332-84eb-aba938b3c27f-metrics-client-ca\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.908179 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.908099 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-sys\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.908179 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.908150 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1841cc50-d0f5-4332-84eb-aba938b3c27f-root\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.908410 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.908298 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-textfile\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.908565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.908542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-accelerators-collector-config\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.910339 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.910316 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-tls\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.910447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.910324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1841cc50-d0f5-4332-84eb-aba938b3c27f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.917359 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.917339 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pn5r\" (UniqueName: \"kubernetes.io/projected/1841cc50-d0f5-4332-84eb-aba938b3c27f-kube-api-access-9pn5r\") pod \"node-exporter-qt75v\" (UID: \"1841cc50-d0f5-4332-84eb-aba938b3c27f\") " pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:22.925167 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.925148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" Jul 07 02:19:22.946688 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.946655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:22.967526 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:22.967504 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qt75v" Jul 07 02:19:23.046442 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.046406 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:23.542842 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.542780 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:23.648709 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.648676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:23.744598 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.744531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:23.750589 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.750564 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:19:23.754270 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.754246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.756400 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756373 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 02:19:23.756528 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756413 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 02:19:23.756528 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756474 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pphqs\"" Jul 07 02:19:23.756528 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756492 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 02:19:23.757051 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756826 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 02:19:23.757051 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756844 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 02:19:23.757051 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756845 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 02:19:23.757290 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.756975 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 02:19:23.757290 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.757086 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 02:19:23.757290 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.757217 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 02:19:23.768893 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.768869 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:19:23.916773 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.916773 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-web-config\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.916985 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.916985 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.916985 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdhkg\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-kube-api-access-gdhkg\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.916985 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.916985 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.916985 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.917223 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.916993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-config-volume\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.917223 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.917037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.917223 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.917107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.917223 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.917141 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:23.917223 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:23.917186 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-config-out\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.017747 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.017714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.017751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.017807 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdhkg\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-kube-api-access-gdhkg\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.017862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018261 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-config-volume\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018331 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-config-out\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.018795 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.018477 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-web-config\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.019291 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.019098 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.019797 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.019525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.020017 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.020927 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.021778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.021822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-config-volume\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.022138 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022201 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.022166 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022534 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.022247 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-tls-assets\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.022989 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.022949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-web-config\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.023533 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.023511 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.024470 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.024449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-config-out\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.032029 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.032011 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdhkg\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-kube-api-access-gdhkg\") pod \"alertmanager-main-0\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.065247 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.065218 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:19:24.066044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.066017 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:24.509804 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.509771 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648cc9474f-brccl"] Jul 07 02:19:24.512872 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.512845 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.522064 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.521798 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 02:19:24.527377 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.526336 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648cc9474f-brccl"] Jul 07 02:19:24.622127 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.622099 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-76464c87dd-wnxqx"] Jul 07 02:19:24.624783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.624756 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-console-config\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.624891 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.624792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-oauth-config\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.624891 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.624808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-trusted-ca-bundle\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.624891 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.624848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-oauth-serving-cert\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.624891 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.624885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-serving-cert\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.625131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.624956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-service-ca\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.625131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.624988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzwd4\" (UniqueName: \"kubernetes.io/projected/81909177-0ac8-41d3-bb49-5409b1dec840-kube-api-access-jzwd4\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.625938 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.625922 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.628837 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.628788 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 02:19:24.628837 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.628793 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 02:19:24.629062 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.628847 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 02:19:24.629062 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.628879 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l6rlc\"" Jul 07 02:19:24.629221 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.629165 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fl59k1s14he6h\"" Jul 07 02:19:24.629271 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.629250 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 02:19:24.629401 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.629383 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 02:19:24.640852 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.640831 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76464c87dd-wnxqx"] Jul 07 02:19:24.725499 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-console-config\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.725643 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.725643 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-oauth-config\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.725643 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725575 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-trusted-ca-bundle\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.725643 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725599 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-tls\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.725643 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-oauth-serving-cert\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.725895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-serving-cert\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.725895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jdgz\" (UniqueName: \"kubernetes.io/projected/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-kube-api-access-7jdgz\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.725895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725728 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-grpc-tls\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.725895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.725895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.725895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.725895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-service-ca\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.726278 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725941 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzwd4\" (UniqueName: \"kubernetes.io/projected/81909177-0ac8-41d3-bb49-5409b1dec840-kube-api-access-jzwd4\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.726278 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.725987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-metrics-client-ca\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.726407 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.726393 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-console-config\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.726607 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.726582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-trusted-ca-bundle\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.726706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.726657 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-oauth-serving-cert\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.726775 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.726699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-service-ca\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.729150 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.729131 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-oauth-config\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.729309 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.729291 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-serving-cert\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.731944 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.731818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:24.734581 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.734559 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzwd4\" (UniqueName: \"kubernetes.io/projected/81909177-0ac8-41d3-bb49-5409b1dec840-kube-api-access-jzwd4\") pod \"console-648cc9474f-brccl\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.825357 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.825274 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:24.827548 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.827509 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.827681 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.827562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-tls\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.827681 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.827602 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jdgz\" (UniqueName: \"kubernetes.io/projected/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-kube-api-access-7jdgz\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.827681 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.827626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-grpc-tls\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.827876 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.827851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.827950 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.827933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.828007 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.827971 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.828056 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.828023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-metrics-client-ca\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.829280 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.828822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-metrics-client-ca\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.830739 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.830690 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.830999 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.830942 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.831280 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.831209 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:24.831496 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.831453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.831597 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.831534 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.832212 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.832188 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-thanos-querier-tls\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.832298 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.832197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-secret-grpc-tls\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.835732 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.835714 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jdgz\" (UniqueName: \"kubernetes.io/projected/5f0f48d8-4b7d-4f74-8e19-c3a7fa763901-kube-api-access-7jdgz\") pod \"thanos-querier-76464c87dd-wnxqx\" (UID: \"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901\") " pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:24.937682 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:24.937651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:25.240903 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:25.240862 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:25.241373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:25.240922 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:25.246419 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:25.246394 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:25.488264 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:25.488231 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:19:25.610342 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:25.610311 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:25.713456 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:25.713419 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:26.325482 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:26.325442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:26.399720 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:26.399687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:27.187799 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.187761 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:27.281594 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.281558 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:27.403300 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.403270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:27.501692 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.501616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:27.833247 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.833215 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk"] Jul 07 02:19:27.989751 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.989715 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk"] Jul 07 02:19:27.989915 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.989848 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:27.992907 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.992887 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 02:19:27.993133 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.993111 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 02:19:27.993312 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.993295 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 02:19:27.993389 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.993294 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 02:19:27.993925 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.993733 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9zb89\"" Jul 07 02:19:27.993925 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.993760 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 02:19:27.999817 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:27.999794 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 02:19:28.156970 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.156879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-telemeter-client-tls\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.156970 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.156940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-metrics-client-ca\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.157231 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.157087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-secret-telemeter-client\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.157231 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.157167 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjxpx\" (UniqueName: \"kubernetes.io/projected/5ed0e049-281c-4bca-bfec-008f6eeafa56-kube-api-access-bjxpx\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.157231 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.157201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.157231 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.157232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-federate-client-tls\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.157397 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.157287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.157397 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.157380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-serving-certs-ca-bundle\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.258687 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-secret-telemeter-client\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.258864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjxpx\" (UniqueName: \"kubernetes.io/projected/5ed0e049-281c-4bca-bfec-008f6eeafa56-kube-api-access-bjxpx\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.258864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258747 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.258864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-federate-client-tls\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.258864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.258864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-serving-certs-ca-bundle\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.259179 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-telemeter-client-tls\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.259179 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.258916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-metrics-client-ca\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.259709 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.259661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-serving-certs-ca-bundle\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.259709 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.259666 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-metrics-client-ca\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.260447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.260417 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed0e049-281c-4bca-bfec-008f6eeafa56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.261751 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.261724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-secret-telemeter-client\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.261953 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.261925 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.262094 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.262052 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-telemeter-client-tls\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.262193 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.262177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ed0e049-281c-4bca-bfec-008f6eeafa56-federate-client-tls\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.270784 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.270762 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjxpx\" (UniqueName: \"kubernetes.io/projected/5ed0e049-281c-4bca-bfec-008f6eeafa56-kube-api-access-bjxpx\") pod \"telemeter-client-6b4bd6c746-nt8xk\" (UID: \"5ed0e049-281c-4bca-bfec-008f6eeafa56\") " pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.301436 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.301411 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" Jul 07 02:19:28.738059 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:28.737934 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1841cc50_d0f5_4332_84eb_aba938b3c27f.slice/crio-ccbda13b46ff812edc8732cae79508b5d12a2b8bc3657bbc6e6aa62f9f5bcc2d WatchSource:0}: Error finding container ccbda13b46ff812edc8732cae79508b5d12a2b8bc3657bbc6e6aa62f9f5bcc2d: Status 404 returned error can't find the container with id ccbda13b46ff812edc8732cae79508b5d12a2b8bc3657bbc6e6aa62f9f5bcc2d Jul 07 02:19:28.922302 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.922276 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76464c87dd-wnxqx"] Jul 07 02:19:28.973338 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.972757 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:19:28.974009 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.973958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:28.995027 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.994963 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:19:28.995164 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.995115 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:28.998028 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.998004 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 02:19:28.998388 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.998030 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 02:19:28.998388 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.998313 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9xvbs\"" Jul 07 02:19:28.998576 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.998547 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 02:19:28.998786 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.998152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 02:19:28.998786 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.998718 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 02:19:28.999765 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.999268 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 02:19:28.999765 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.999414 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 02:19:28.999765 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.999622 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4i2uee63rb39g\"" Jul 07 02:19:29.000014 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.999920 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 02:19:29.000014 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.999938 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 02:19:29.000014 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:28.999948 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 02:19:29.000596 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.000576 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 02:19:29.000843 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.000753 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 02:19:29.000843 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.000809 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 02:19:29.002373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.002352 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 02:19:29.005378 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.005357 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 02:19:29.042653 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:29.042627 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0f48d8_4b7d_4f74_8e19_c3a7fa763901.slice/crio-12fab6e10e1b626d62c26531c32438982b681f2d79b9e1d0778a1ab829f0acdf WatchSource:0}: Error finding container 12fab6e10e1b626d62c26531c32438982b681f2d79b9e1d0778a1ab829f0acdf: Status 404 returned error can't find the container with id 12fab6e10e1b626d62c26531c32438982b681f2d79b9e1d0778a1ab829f0acdf Jul 07 02:19:29.156884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.156863 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb"] Jul 07 02:19:29.159306 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.159285 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648cc9474f-brccl"] Jul 07 02:19:29.164176 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.163527 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk"] Jul 07 02:19:29.164383 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:29.164308 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3d0830_af64_441c_b5a0_44f7479ffc14.slice/crio-a9344bec1ed4a1450fb875f849e52b7c371531f81eb84a4b1719ea8e46081680 WatchSource:0}: Error finding container a9344bec1ed4a1450fb875f849e52b7c371531f81eb84a4b1719ea8e46081680: Status 404 returned error can't find the container with id a9344bec1ed4a1450fb875f849e52b7c371531f81eb84a4b1719ea8e46081680 Jul 07 02:19:29.165478 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.165225 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:19:29.168027 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:29.167928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed0e049_281c_4bca_bfec_008f6eeafa56.slice/crio-3f69217f40631563754e647282bff6a770c0395d721b70e56d3d28bb005b9dc9 WatchSource:0}: Error finding container 3f69217f40631563754e647282bff6a770c0395d721b70e56d3d28bb005b9dc9: Status 404 returned error can't find the container with id 3f69217f40631563754e647282bff6a770c0395d721b70e56d3d28bb005b9dc9 Jul 07 02:19:29.170545 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:29.170520 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669d2f7e_ce65_4256_894b_7b183d6bb845.slice/crio-da8dd917743f991e15633f5edc99b16f58bf08a2709a0c2e2b916b91a8f322ce WatchSource:0}: Error finding container da8dd917743f991e15633f5edc99b16f58bf08a2709a0c2e2b916b91a8f322ce: Status 404 returned error can't find the container with id da8dd917743f991e15633f5edc99b16f58bf08a2709a0c2e2b916b91a8f322ce Jul 07 02:19:29.174860 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.174830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.174935 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.174880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.174987 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.174960 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-web-config\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175045 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.174999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175120 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175178 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175215 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175292 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175292 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175292 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175433 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175433 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175346 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-config\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175549 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175454 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175549 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175549 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmf7q\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-kube-api-access-zmf7q\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.175745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.175718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-config-out\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-config\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276917 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmf7q\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-kube-api-access-zmf7q\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.276980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-config-out\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-web-config\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.277816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.277464 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.278247 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.278107 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.279177 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.278694 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.279177 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.278853 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.279874 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.279846 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.282269 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.281936 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-web-config\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.282269 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.281968 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.283453 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.282729 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.283453 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.282953 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.283453 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.283222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.283453 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.283416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.286339 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.286289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-config-out\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.286466 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.286443 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-config\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.287706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.287087 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.287706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.287117 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.287706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.287605 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.287706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.287668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.287706 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.287679 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.288920 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.288891 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.291569 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.291532 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmf7q\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-kube-api-access-zmf7q\") pod \"prometheus-k8s-0\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.308443 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.308201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:29.409975 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.409946 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:19:29.502646 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.502493 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:19:29.506554 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:29.506483 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cc9a48_4c93_4dba_83a5_47d87679e550.slice/crio-754b906c36070a76f6edca83367516de09f903fa78fc6521603ef6ac18815983 WatchSource:0}: Error finding container 754b906c36070a76f6edca83367516de09f903fa78fc6521603ef6ac18815983: Status 404 returned error can't find the container with id 754b906c36070a76f6edca83367516de09f903fa78fc6521603ef6ac18815983 Jul 07 02:19:29.509211 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.508927 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" event={"ID":"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901","Type":"ContainerStarted","Data":"12fab6e10e1b626d62c26531c32438982b681f2d79b9e1d0778a1ab829f0acdf"} Jul 07 02:19:29.512570 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.512469 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648cc9474f-brccl" event={"ID":"81909177-0ac8-41d3-bb49-5409b1dec840","Type":"ContainerStarted","Data":"0eab095f08e2fde52d590dfa7dae7a5e7996d33b4c072564c56ff0b135dbd805"} Jul 07 02:19:29.512570 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.512512 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648cc9474f-brccl" event={"ID":"81909177-0ac8-41d3-bb49-5409b1dec840","Type":"ContainerStarted","Data":"934030c8c98fbd018a6db54b8c3be889a1ef34013714b8590e9ef953b70ebac1"} Jul 07 02:19:29.517255 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.517176 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qt75v" event={"ID":"1841cc50-d0f5-4332-84eb-aba938b3c27f","Type":"ContainerStarted","Data":"ccbda13b46ff812edc8732cae79508b5d12a2b8bc3657bbc6e6aa62f9f5bcc2d"} Jul 07 02:19:29.520047 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.520022 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" event={"ID":"5ed0e049-281c-4bca-bfec-008f6eeafa56","Type":"ContainerStarted","Data":"3f69217f40631563754e647282bff6a770c0395d721b70e56d3d28bb005b9dc9"} Jul 07 02:19:29.522059 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.522036 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerStarted","Data":"da8dd917743f991e15633f5edc99b16f58bf08a2709a0c2e2b916b91a8f322ce"} Jul 07 02:19:29.531005 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.530980 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-lx6xw" event={"ID":"bf7bee26-c94b-4132-a261-e939eb2c5a35","Type":"ContainerStarted","Data":"0550428d53cb5337db120dfa5cff2dc84b7098b161fc7b44557feb8dd36da21e"} Jul 07 02:19:29.531739 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.531695 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-lx6xw" Jul 07 02:19:29.536437 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.536411 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" event={"ID":"ca3d0830-af64-441c-b5a0-44f7479ffc14","Type":"ContainerStarted","Data":"068d9d4d173e7d2e5b2b9b72ef4a8975c300b0ab42879a49aa13b7291d1e74fb"} Jul 07 02:19:29.536624 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.536465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" event={"ID":"ca3d0830-af64-441c-b5a0-44f7479ffc14","Type":"ContainerStarted","Data":"c407c61ab6be651f09e88cc26067c19a2f260eee53bba65dbf0aaa02b158c54f"} Jul 07 02:19:29.536624 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.536492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" event={"ID":"ca3d0830-af64-441c-b5a0-44f7479ffc14","Type":"ContainerStarted","Data":"a9344bec1ed4a1450fb875f849e52b7c371531f81eb84a4b1719ea8e46081680"} Jul 07 02:19:29.544609 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.543753 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-lx6xw" Jul 07 02:19:29.561635 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.560836 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648cc9474f-brccl" podStartSLOduration=5.560818899 podStartE2EDuration="5.560818899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:29.537209937 +0000 UTC m=+124.175757399" watchObservedRunningTime="2026-07-07 02:19:29.560818899 +0000 UTC m=+124.199366362" Jul 07 02:19:29.574131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.574107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:29.589100 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.586610 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-lx6xw" podStartSLOduration=1.355011922 podStartE2EDuration="19.586587215s" totalImagesPullingTime="18.231575293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:29.560750198 +0000 UTC m=+124.199297658" watchObservedRunningTime="2026-07-07 02:19:29.586587215 +0000 UTC m=+124.225134680" Jul 07 02:19:29.642554 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:29.642352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:30.546263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:30.546226 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerStarted","Data":"754b906c36070a76f6edca83367516de09f903fa78fc6521603ef6ac18815983"} Jul 07 02:19:30.727576 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:30.727524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:30.795992 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:30.794101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:32.358046 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.357865 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d95f94b89-svvmz"] Jul 07 02:19:32.439136 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.439102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:32.516983 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.516951 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648cc9474f-brccl"] Jul 07 02:19:32.520417 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.520380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:32.553682 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.553623 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7b659498-fxzqr"] Jul 07 02:19:32.579769 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.579716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7b659498-fxzqr"] Jul 07 02:19:32.580117 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.579828 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.583724 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.583540 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:32.613383 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.613321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-oauth-config\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.613504 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.613380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-service-ca\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.613504 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.613466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-trusted-ca-bundle\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.613655 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.613544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-serving-cert\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.613655 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.613573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-oauth-serving-cert\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.613655 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.613597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndgh2\" (UniqueName: \"kubernetes.io/projected/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-kube-api-access-ndgh2\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.613655 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.613625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-config\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.714952 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.714915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-oauth-config\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.715162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.714981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-service-ca\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.715162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.715065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-trusted-ca-bundle\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.715285 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.715196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-serving-cert\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.715415 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.715388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-oauth-serving-cert\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.715503 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.715443 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndgh2\" (UniqueName: \"kubernetes.io/projected/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-kube-api-access-ndgh2\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.715503 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.715474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-config\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.716538 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.716516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-service-ca\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.717171 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.717150 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-config\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.717430 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.717361 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-oauth-serving-cert\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.717430 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.717407 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-trusted-ca-bundle\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.718152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.718130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-oauth-config\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.720947 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.720924 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-serving-cert\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.725475 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.725448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndgh2\" (UniqueName: \"kubernetes.io/projected/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-kube-api-access-ndgh2\") pod \"console-7d7b659498-fxzqr\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:32.891815 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:32.891703 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:33.301997 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:33.301906 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:33.403752 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:33.403718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:33.931303 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:33.931277 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7b659498-fxzqr"] Jul 07 02:19:34.566957 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.566869 2572 generic.go:356] "Generic (PLEG): container finished" podID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" exitCode=0 Jul 07 02:19:34.567426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.566963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c"} Jul 07 02:19:34.569968 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.569942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" event={"ID":"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901","Type":"ContainerStarted","Data":"dec9d71061ba4679d82a99b4e1043e14e603d53d993337f4ba82ca9c94bb392b"} Jul 07 02:19:34.570100 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.570017 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" event={"ID":"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901","Type":"ContainerStarted","Data":"5495bb560ef028bfd295ee297e72f3425fa1727e5ac394ce55beeeaff947ccf8"} Jul 07 02:19:34.570100 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.570060 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" event={"ID":"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901","Type":"ContainerStarted","Data":"96fc7b50c512122f31899ba44b954366b9aa3db29467fc2dcc842efbc8b0d960"} Jul 07 02:19:34.571801 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.571777 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b659498-fxzqr" event={"ID":"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f","Type":"ContainerStarted","Data":"e7c86ab8b536c7ff5cb867516a59af9c85bc3edc02c6276f74cec477c81d1114"} Jul 07 02:19:34.571901 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.571820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b659498-fxzqr" event={"ID":"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f","Type":"ContainerStarted","Data":"df3fac22df814386ef106fc60301ad441813d2f6b6dac4b4e0e02015545cd169"} Jul 07 02:19:34.573587 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.573562 2572 generic.go:356] "Generic (PLEG): container finished" podID="1841cc50-d0f5-4332-84eb-aba938b3c27f" containerID="cdab29ac797e9dc5cd07efeca8bb33672cab0f3ae2d16279b54bfed4db0af71f" exitCode=0 Jul 07 02:19:34.573680 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.573639 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qt75v" event={"ID":"1841cc50-d0f5-4332-84eb-aba938b3c27f","Type":"ContainerDied","Data":"cdab29ac797e9dc5cd07efeca8bb33672cab0f3ae2d16279b54bfed4db0af71f"} Jul 07 02:19:34.577034 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.576469 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" event={"ID":"5ed0e049-281c-4bca-bfec-008f6eeafa56","Type":"ContainerStarted","Data":"657349af385a605bd402b64784779f8549bdc900ca5c99ff5d7739848f2d6c96"} Jul 07 02:19:34.577034 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.576541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" event={"ID":"5ed0e049-281c-4bca-bfec-008f6eeafa56","Type":"ContainerStarted","Data":"17a3ef25b9978c3b52fb18b99470cfe5b1daa65763835e8630a4997b25da156a"} Jul 07 02:19:34.577034 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.576571 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" event={"ID":"5ed0e049-281c-4bca-bfec-008f6eeafa56","Type":"ContainerStarted","Data":"4bdfdfaac968e5460b0c3a103b959ada60a914bcbdb3e79bbdd12bab6d74134b"} Jul 07 02:19:34.578136 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.578114 2572 generic.go:356] "Generic (PLEG): container finished" podID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerID="adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6" exitCode=0 Jul 07 02:19:34.578230 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.578195 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6"} Jul 07 02:19:34.580942 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.580915 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" event={"ID":"ca3d0830-af64-441c-b5a0-44f7479ffc14","Type":"ContainerStarted","Data":"be477fc1a2229e08c3fc6e1be874ffb4f5cd8b1d4b8335c7de12c77944bf20c8"} Jul 07 02:19:34.619594 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.619538 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-s27nb" podStartSLOduration=8.169767839 podStartE2EDuration="12.619517609s" totalImagesPullingTime="4.44974977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:34.618101545 +0000 UTC m=+129.256649007" watchObservedRunningTime="2026-07-07 02:19:34.619517609 +0000 UTC m=+129.258065072" Jul 07 02:19:34.670697 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.670646 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7b659498-fxzqr" podStartSLOduration=2.6706251180000002 podStartE2EDuration="2.670625118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:34.669651196 +0000 UTC m=+129.308198672" watchObservedRunningTime="2026-07-07 02:19:34.670625118 +0000 UTC m=+129.309172563" Jul 07 02:19:34.693066 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.693012 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b4bd6c746-nt8xk" podStartSLOduration=3.094873717 podStartE2EDuration="7.692991168s" totalImagesPullingTime="4.598117451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:34.691428472 +0000 UTC m=+129.329975934" watchObservedRunningTime="2026-07-07 02:19:34.692991168 +0000 UTC m=+129.331538628" Jul 07 02:19:34.825798 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.825455 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:34.907895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:34.907858 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:35.008375 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:35.008337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:35.594290 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:35.593126 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qt75v" event={"ID":"1841cc50-d0f5-4332-84eb-aba938b3c27f","Type":"ContainerStarted","Data":"2331cf56489c968b266b5b03bd341dba8e841a248faff446af00a0f1f1ec3df9"} Jul 07 02:19:35.594290 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:35.593180 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qt75v" event={"ID":"1841cc50-d0f5-4332-84eb-aba938b3c27f","Type":"ContainerStarted","Data":"c629364e070854d7dc5296d58d9ceb94d8e57f23fbf1c049bd49b02100d55bf5"} Jul 07 02:19:35.646924 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:35.646894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:19:35.655197 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:35.655146 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b97e940f-a181-47cc-90a5-44d21de2d90a-metrics-certs\") pod \"network-metrics-daemon-869ts\" (UID: \"b97e940f-a181-47cc-90a5-44d21de2d90a\") " pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:19:35.932510 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:35.932482 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ggshj\"" Jul 07 02:19:35.940783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:35.940757 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-869ts" Jul 07 02:19:36.606506 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:36.603201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" event={"ID":"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901","Type":"ContainerStarted","Data":"691a4d38a9f44ffdc1755f80953cac3fc537da773bc2508c2fd40f66c0df8e22"} Jul 07 02:19:36.606506 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:36.603329 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" event={"ID":"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901","Type":"ContainerStarted","Data":"c8097e22bdaa9ba5077fa0e69686e7de624d9041443ae91258a0bd3121055daf"} Jul 07 02:19:36.641729 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:36.641658 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qt75v" podStartSLOduration=9.582841828 podStartE2EDuration="14.641635096s" totalImagesPullingTime="4.944964233s" totalInitContainerRuntime="113.829035ms" isStatefulPod=true podCreationTimestamp="2026-07-07 02:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:35.623265313 +0000 UTC m=+130.261812776" watchObservedRunningTime="2026-07-07 02:19:36.641635096 +0000 UTC m=+131.280182562" Jul 07 02:19:36.642449 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:36.642424 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-869ts"] Jul 07 02:19:36.646956 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:36.646923 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97e940f_a181_47cc_90a5_44d21de2d90a.slice/crio-2d5a265b09648a777d4fb6ca78ab45f41ec2cc2e4899205e42f7caaa4549a805 WatchSource:0}: Error finding container 2d5a265b09648a777d4fb6ca78ab45f41ec2cc2e4899205e42f7caaa4549a805: Status 404 returned error can't find the container with id 2d5a265b09648a777d4fb6ca78ab45f41ec2cc2e4899205e42f7caaa4549a805 Jul 07 02:19:37.607030 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.606998 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-869ts" event={"ID":"b97e940f-a181-47cc-90a5-44d21de2d90a","Type":"ContainerStarted","Data":"2d5a265b09648a777d4fb6ca78ab45f41ec2cc2e4899205e42f7caaa4549a805"} Jul 07 02:19:37.609646 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.609622 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" event={"ID":"5f0f48d8-4b7d-4f74-8e19-c3a7fa763901","Type":"ContainerStarted","Data":"82240b0948cade51d8d840dd68dac5595ca8113506094e49bae3be952c97e879"} Jul 07 02:19:37.610319 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.610281 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:37.612022 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.612000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerStarted","Data":"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7"} Jul 07 02:19:37.612117 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.612050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerStarted","Data":"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708"} Jul 07 02:19:37.612117 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.612100 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerStarted","Data":"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6"} Jul 07 02:19:37.612193 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.612127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerStarted","Data":"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733"} Jul 07 02:19:37.635065 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:37.635017 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" podStartSLOduration=7.65883685 podStartE2EDuration="13.635004353s" totalImagesPullingTime="5.976167503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:37.634192194 +0000 UTC m=+132.272739656" watchObservedRunningTime="2026-07-07 02:19:37.635004353 +0000 UTC m=+132.273551815" Jul 07 02:19:38.620977 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:38.620935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerStarted","Data":"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd"} Jul 07 02:19:38.621398 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:38.621021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerStarted","Data":"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6"} Jul 07 02:19:38.652917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:38.652860 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.668119878 podStartE2EDuration="15.652840871s" totalImagesPullingTime="6.954053287s" totalInitContainerRuntime="30.667706ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:38.649236626 +0000 UTC m=+133.287784089" watchObservedRunningTime="2026-07-07 02:19:38.652840871 +0000 UTC m=+133.291388334" Jul 07 02:19:39.456768 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.456733 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7b659498-fxzqr"] Jul 07 02:19:39.491006 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.490983 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-584bdbfc4b-h4gcb"] Jul 07 02:19:39.519624 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.519602 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584bdbfc4b-h4gcb"] Jul 07 02:19:39.519757 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.519685 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.589758 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.589732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-serving-cert\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.589884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.589762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-service-ca\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.589884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.589784 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-config\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.589884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.589812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-oauth-config\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.589884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.589849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-trusted-ca-bundle\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.589884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.589883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-oauth-serving-cert\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.590049 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.589948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkgc\" (UniqueName: \"kubernetes.io/projected/3e4530cd-0c1c-4df3-b391-28f1b418774b-kube-api-access-cbkgc\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.690996 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.690959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkgc\" (UniqueName: \"kubernetes.io/projected/3e4530cd-0c1c-4df3-b391-28f1b418774b-kube-api-access-cbkgc\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.691368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.691052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-serving-cert\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.691368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.691101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-service-ca\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.691368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.691138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-config\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.691368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.691211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-oauth-config\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.691368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.691310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-trusted-ca-bundle\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.691618 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.691429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-oauth-serving-cert\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.692335 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.692164 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-oauth-serving-cert\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.692335 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.692254 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-service-ca\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.692500 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.692401 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-trusted-ca-bundle\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.692867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.692843 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-config\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.694653 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.694613 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-oauth-config\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.695417 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.695386 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-serving-cert\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.702350 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.702315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkgc\" (UniqueName: \"kubernetes.io/projected/3e4530cd-0c1c-4df3-b391-28f1b418774b-kube-api-access-cbkgc\") pod \"console-584bdbfc4b-h4gcb\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.828502 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.828471 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:39.917362 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:39.917325 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:40.063061 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.063029 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584bdbfc4b-h4gcb"] Jul 07 02:19:40.063229 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:19:40.063203 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4530cd_0c1c_4df3_b391_28f1b418774b.slice/crio-97e593448efc57467eb5b2719dccdf6dac759de8c6b81d7f13823e6ff267e854 WatchSource:0}: Error finding container 97e593448efc57467eb5b2719dccdf6dac759de8c6b81d7f13823e6ff267e854: Status 404 returned error can't find the container with id 97e593448efc57467eb5b2719dccdf6dac759de8c6b81d7f13823e6ff267e854 Jul 07 02:19:40.633889 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.633859 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerStarted","Data":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} Jul 07 02:19:40.634055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.633920 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerStarted","Data":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} Jul 07 02:19:40.634055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.633955 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerStarted","Data":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} Jul 07 02:19:40.634055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.633981 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerStarted","Data":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} Jul 07 02:19:40.634055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.634022 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerStarted","Data":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} Jul 07 02:19:40.634274 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.634111 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerStarted","Data":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} Jul 07 02:19:40.635650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.635628 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-869ts" event={"ID":"b97e940f-a181-47cc-90a5-44d21de2d90a","Type":"ContainerStarted","Data":"4c60dbc5640104b060f73d04e2504bff765d3adc76f8e5da1cca2c5f958cc33e"} Jul 07 02:19:40.635735 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.635670 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-869ts" event={"ID":"b97e940f-a181-47cc-90a5-44d21de2d90a","Type":"ContainerStarted","Data":"0884fd85122b91b850e323d72c0e3b2631bd3c663e251901a374e0937824754d"} Jul 07 02:19:40.637089 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.637043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bdbfc4b-h4gcb" event={"ID":"3e4530cd-0c1c-4df3-b391-28f1b418774b","Type":"ContainerStarted","Data":"f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d"} Jul 07 02:19:40.637188 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.637097 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bdbfc4b-h4gcb" event={"ID":"3e4530cd-0c1c-4df3-b391-28f1b418774b","Type":"ContainerStarted","Data":"97e593448efc57467eb5b2719dccdf6dac759de8c6b81d7f13823e6ff267e854"} Jul 07 02:19:40.663580 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.663537 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.293952742 podStartE2EDuration="12.663524519s" totalImagesPullingTime="9.332881478s" totalInitContainerRuntime="36.690299ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:40.66077603 +0000 UTC m=+135.299323492" watchObservedRunningTime="2026-07-07 02:19:40.663524519 +0000 UTC m=+135.302071981" Jul 07 02:19:40.679801 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.679763 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-584bdbfc4b-h4gcb" podStartSLOduration=1.6797506229999999 podStartE2EDuration="1.679750623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:40.678406562 +0000 UTC m=+135.316954038" watchObservedRunningTime="2026-07-07 02:19:40.679750623 +0000 UTC m=+135.318298145" Jul 07 02:19:40.698749 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.698701 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-869ts" podStartSLOduration=131.710561302 podStartE2EDuration="2m14.698688113s" totalImagesPullingTime="2.988126811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:40.696935906 +0000 UTC m=+135.335483368" watchObservedRunningTime="2026-07-07 02:19:40.698688113 +0000 UTC m=+135.337235574" Jul 07 02:19:40.776938 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.776855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:40.879370 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.879337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:40.978049 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:40.978019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:42.892452 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:42.892420 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:19:43.626626 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:43.626601 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-76464c87dd-wnxqx" Jul 07 02:19:44.308932 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:44.308902 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:19:45.684575 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:45.684540 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:45.785122 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:45.785066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:49.829244 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:49.829207 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:49.829800 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:49.829278 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:49.833648 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:49.833625 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:50.693134 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:50.693106 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:19:50.741355 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:50.741328 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8b499f45-kpfxv"] Jul 07 02:19:50.846198 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:50.846151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:50.910168 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:50.910134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:50.981199 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:50.981126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.454876 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:54.454842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.555635 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:54.555602 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:54.656898 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:54.656868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:56.621440 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:56.621404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:56.683358 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:56.683323 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:19:57.387629 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.387588 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" podUID="4694dda2-8a20-4adf-8784-0b8b5ae18853" containerName="registry" containerID="cri-o://06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e" gracePeriod=30 Jul 07 02:19:57.540886 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.540842 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-648cc9474f-brccl" podUID="81909177-0ac8-41d3-bb49-5409b1dec840" containerName="console" containerID="cri-o://0eab095f08e2fde52d590dfa7dae7a5e7996d33b4c072564c56ff0b135dbd805" gracePeriod=15 Jul 07 02:19:57.673403 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.673383 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:19:57.717202 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.717168 2572 generic.go:356] "Generic (PLEG): container finished" podID="4694dda2-8a20-4adf-8784-0b8b5ae18853" containerID="06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e" exitCode=0 Jul 07 02:19:57.717359 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.717218 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" event={"ID":"4694dda2-8a20-4adf-8784-0b8b5ae18853","Type":"ContainerDied","Data":"06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e"} Jul 07 02:19:57.717359 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.717227 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" Jul 07 02:19:57.717359 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.717270 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d95f94b89-svvmz" event={"ID":"4694dda2-8a20-4adf-8784-0b8b5ae18853","Type":"ContainerDied","Data":"27cd6a1594e2888db4c5e876976a4d7ad3f42918c902b3bea35768465c8eb8b0"} Jul 07 02:19:57.717359 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.717300 2572 scope.go:117] "RemoveContainer" containerID="06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e" Jul 07 02:19:57.719125 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.719105 2572 generic.go:356] "Generic (PLEG): container finished" podID="81909177-0ac8-41d3-bb49-5409b1dec840" containerID="0eab095f08e2fde52d590dfa7dae7a5e7996d33b4c072564c56ff0b135dbd805" exitCode=0 Jul 07 02:19:57.719243 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.719172 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648cc9474f-brccl" event={"ID":"81909177-0ac8-41d3-bb49-5409b1dec840","Type":"ContainerDied","Data":"0eab095f08e2fde52d590dfa7dae7a5e7996d33b4c072564c56ff0b135dbd805"} Jul 07 02:19:57.727186 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.727169 2572 scope.go:117] "RemoveContainer" containerID="06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e" Jul 07 02:19:57.727487 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:19:57.727457 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e\": container with ID starting with 06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e not found: ID does not exist" containerID="06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e" Jul 07 02:19:57.727560 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.727499 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e"} err="failed to get container status \"06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e\": rpc error: code = NotFound desc = could not find container \"06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e\": container with ID starting with 06164005e1a927a24af5a5385c7887fa17ddbdb0c5fd7804edbbc9a5466f545e not found: ID does not exist" Jul 07 02:19:57.752746 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.752723 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-installation-pull-secrets\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.752855 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.752762 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-trusted-ca\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.752855 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.752791 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-certificates\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.752855 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.752816 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4694dda2-8a20-4adf-8784-0b8b5ae18853-ca-trust-extracted\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.752855 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.752850 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.753055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.752911 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-bound-sa-token\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.753055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.752949 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsn45\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-kube-api-access-zsn45\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.753055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.753026 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-image-registry-private-configuration\") pod \"4694dda2-8a20-4adf-8784-0b8b5ae18853\" (UID: \"4694dda2-8a20-4adf-8784-0b8b5ae18853\") " Jul 07 02:19:57.753245 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.753218 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:19:57.753299 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.753284 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:19:57.753756 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.753368 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-trusted-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.753756 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.753394 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-certificates\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.755772 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.755746 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:19:57.755906 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.755876 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:19:57.756004 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.755977 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:19:57.756004 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.755988 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-kube-api-access-zsn45" (OuterVolumeSpecName: "kube-api-access-zsn45") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "kube-api-access-zsn45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:19:57.756297 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.756276 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:19:57.762223 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.762200 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4694dda2-8a20-4adf-8784-0b8b5ae18853-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4694dda2-8a20-4adf-8784-0b8b5ae18853" (UID: "4694dda2-8a20-4adf-8784-0b8b5ae18853"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:19:57.820400 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.820365 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:57.854548 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.854523 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-bound-sa-token\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.854548 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.854547 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsn45\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-kube-api-access-zsn45\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.854683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.854563 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-image-registry-private-configuration\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.854683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.854578 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4694dda2-8a20-4adf-8784-0b8b5ae18853-installation-pull-secrets\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.854683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.854591 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4694dda2-8a20-4adf-8784-0b8b5ae18853-ca-trust-extracted\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.854683 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.854604 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4694dda2-8a20-4adf-8784-0b8b5ae18853-registry-tls\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:57.955682 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.955627 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzwd4\" (UniqueName: \"kubernetes.io/projected/81909177-0ac8-41d3-bb49-5409b1dec840-kube-api-access-jzwd4\") pod \"81909177-0ac8-41d3-bb49-5409b1dec840\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " Jul 07 02:19:57.955682 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.955662 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-service-ca\") pod \"81909177-0ac8-41d3-bb49-5409b1dec840\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " Jul 07 02:19:57.955867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.955692 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-oauth-serving-cert\") pod \"81909177-0ac8-41d3-bb49-5409b1dec840\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " Jul 07 02:19:57.955867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.955729 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-oauth-config\") pod \"81909177-0ac8-41d3-bb49-5409b1dec840\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " Jul 07 02:19:57.955867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.955750 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-console-config\") pod \"81909177-0ac8-41d3-bb49-5409b1dec840\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " Jul 07 02:19:57.955867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.955764 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-serving-cert\") pod \"81909177-0ac8-41d3-bb49-5409b1dec840\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " Jul 07 02:19:57.955867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.955814 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-trusted-ca-bundle\") pod \"81909177-0ac8-41d3-bb49-5409b1dec840\" (UID: \"81909177-0ac8-41d3-bb49-5409b1dec840\") " Jul 07 02:19:57.956193 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.956122 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-service-ca" (OuterVolumeSpecName: "service-ca") pod "81909177-0ac8-41d3-bb49-5409b1dec840" (UID: "81909177-0ac8-41d3-bb49-5409b1dec840"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:19:57.956273 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.956211 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81909177-0ac8-41d3-bb49-5409b1dec840" (UID: "81909177-0ac8-41d3-bb49-5409b1dec840"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:19:57.956273 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.956217 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-console-config" (OuterVolumeSpecName: "console-config") pod "81909177-0ac8-41d3-bb49-5409b1dec840" (UID: "81909177-0ac8-41d3-bb49-5409b1dec840"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:19:57.956365 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.956351 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81909177-0ac8-41d3-bb49-5409b1dec840" (UID: "81909177-0ac8-41d3-bb49-5409b1dec840"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:19:57.957913 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.957888 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81909177-0ac8-41d3-bb49-5409b1dec840" (UID: "81909177-0ac8-41d3-bb49-5409b1dec840"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:19:57.958065 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.958040 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81909177-0ac8-41d3-bb49-5409b1dec840" (UID: "81909177-0ac8-41d3-bb49-5409b1dec840"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:19:57.958065 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:57.958053 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81909177-0ac8-41d3-bb49-5409b1dec840-kube-api-access-jzwd4" (OuterVolumeSpecName: "kube-api-access-jzwd4") pod "81909177-0ac8-41d3-bb49-5409b1dec840" (UID: "81909177-0ac8-41d3-bb49-5409b1dec840"). InnerVolumeSpecName "kube-api-access-jzwd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:19:58.039600 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.039578 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d95f94b89-svvmz"] Jul 07 02:19:58.043404 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.043383 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d95f94b89-svvmz"] Jul 07 02:19:58.057057 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.057020 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-oauth-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:58.057162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.057064 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-console-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:58.057162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.057096 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81909177-0ac8-41d3-bb49-5409b1dec840-console-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:58.057162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.057108 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-trusted-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:58.057162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.057122 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzwd4\" (UniqueName: \"kubernetes.io/projected/81909177-0ac8-41d3-bb49-5409b1dec840-kube-api-access-jzwd4\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:58.057162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.057135 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-service-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:58.057162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.057148 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81909177-0ac8-41d3-bb49-5409b1dec840-oauth-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:19:58.724965 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.724907 2572 generic.go:356] "Generic (PLEG): container finished" podID="5c7a8df0-afc0-433a-af09-fbe100857e12" containerID="292da787d6a53aaa06a55ceff5721bf156f712d12130b4d23df9a10dca331520" exitCode=0 Jul 07 02:19:58.725426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.724978 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" event={"ID":"5c7a8df0-afc0-433a-af09-fbe100857e12","Type":"ContainerDied","Data":"292da787d6a53aaa06a55ceff5721bf156f712d12130b4d23df9a10dca331520"} Jul 07 02:19:58.725426 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.725285 2572 scope.go:117] "RemoveContainer" containerID="292da787d6a53aaa06a55ceff5721bf156f712d12130b4d23df9a10dca331520" Jul 07 02:19:58.727272 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.727219 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648cc9474f-brccl" Jul 07 02:19:58.727272 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.727225 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648cc9474f-brccl" event={"ID":"81909177-0ac8-41d3-bb49-5409b1dec840","Type":"ContainerDied","Data":"934030c8c98fbd018a6db54b8c3be889a1ef34013714b8590e9ef953b70ebac1"} Jul 07 02:19:58.731624 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.727267 2572 scope.go:117] "RemoveContainer" containerID="0eab095f08e2fde52d590dfa7dae7a5e7996d33b4c072564c56ff0b135dbd805" Jul 07 02:19:58.762742 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.762718 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648cc9474f-brccl"] Jul 07 02:19:58.770117 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:58.770094 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648cc9474f-brccl"] Jul 07 02:19:59.734361 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:19:59.734329 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-md2x4" event={"ID":"5c7a8df0-afc0-433a-af09-fbe100857e12","Type":"ContainerStarted","Data":"9a0e2ba594846e418cca8fd7030d6d5a685853eb9d955cc0f0c7ee0249809b1f"} Jul 07 02:20:00.027298 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:00.027227 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4694dda2-8a20-4adf-8784-0b8b5ae18853" path="/var/lib/kubelet/pods/4694dda2-8a20-4adf-8784-0b8b5ae18853/volumes" Jul 07 02:20:00.027612 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:00.027599 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81909177-0ac8-41d3-bb49-5409b1dec840" path="/var/lib/kubelet/pods/81909177-0ac8-41d3-bb49-5409b1dec840/volumes" Jul 07 02:20:04.476139 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.476097 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d7b659498-fxzqr" podUID="08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" containerName="console" containerID="cri-o://e7c86ab8b536c7ff5cb867516a59af9c85bc3edc02c6276f74cec477c81d1114" gracePeriod=15 Jul 07 02:20:04.757846 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.757822 2572 generic.go:356] "Generic (PLEG): container finished" podID="08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" containerID="e7c86ab8b536c7ff5cb867516a59af9c85bc3edc02c6276f74cec477c81d1114" exitCode=0 Jul 07 02:20:04.757954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.757891 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b659498-fxzqr" event={"ID":"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f","Type":"ContainerDied","Data":"e7c86ab8b536c7ff5cb867516a59af9c85bc3edc02c6276f74cec477c81d1114"} Jul 07 02:20:04.757954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.757937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b659498-fxzqr" event={"ID":"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f","Type":"ContainerDied","Data":"df3fac22df814386ef106fc60301ad441813d2f6b6dac4b4e0e02015545cd169"} Jul 07 02:20:04.757954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.757952 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df3fac22df814386ef106fc60301ad441813d2f6b6dac4b4e0e02015545cd169" Jul 07 02:20:04.760423 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.760411 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:20:04.910295 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910265 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-oauth-config\") pod \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " Jul 07 02:20:04.910447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910308 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-serving-cert\") pod \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " Jul 07 02:20:04.910447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910343 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-oauth-serving-cert\") pod \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " Jul 07 02:20:04.910447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndgh2\" (UniqueName: \"kubernetes.io/projected/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-kube-api-access-ndgh2\") pod \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " Jul 07 02:20:04.910447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910415 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-trusted-ca-bundle\") pod \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " Jul 07 02:20:04.910668 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910465 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-config\") pod \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " Jul 07 02:20:04.910668 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910497 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-service-ca\") pod \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\" (UID: \"08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f\") " Jul 07 02:20:04.910816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910791 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" (UID: "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:04.910886 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910861 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-config" (OuterVolumeSpecName: "console-config") pod "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" (UID: "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:04.910886 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.910874 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" (UID: "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:04.911117 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.911092 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-service-ca" (OuterVolumeSpecName: "service-ca") pod "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" (UID: "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:04.912467 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.912445 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" (UID: "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:04.912856 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.912830 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" (UID: "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:04.912959 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:04.912942 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-kube-api-access-ndgh2" (OuterVolumeSpecName: "kube-api-access-ndgh2") pod "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" (UID: "08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f"). InnerVolumeSpecName "kube-api-access-ndgh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:05.011294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.011236 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-trusted-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:05.011294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.011257 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:05.011294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.011267 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-service-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:05.011294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.011275 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-oauth-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:05.011294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.011285 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-console-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:05.011294 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.011293 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-oauth-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:05.011535 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.011301 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndgh2\" (UniqueName: \"kubernetes.io/projected/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f-kube-api-access-ndgh2\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:05.762164 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.762136 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b659498-fxzqr" Jul 07 02:20:05.784408 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.784368 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7b659498-fxzqr"] Jul 07 02:20:05.788490 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:05.788463 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7b659498-fxzqr"] Jul 07 02:20:06.026094 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:06.026007 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" path="/var/lib/kubelet/pods/08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f/volumes" Jul 07 02:20:15.761021 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:15.760981 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b8b499f45-kpfxv" podUID="65e6101f-78cb-4c0e-9f51-3b919be17cc4" containerName="console" containerID="cri-o://01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc" gracePeriod=15 Jul 07 02:20:16.043111 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.043036 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:20:16.107740 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.107704 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-oauth-config\") pod \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " Jul 07 02:20:16.107740 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.107737 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-serving-cert\") pod \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " Jul 07 02:20:16.107954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.107760 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmdr7\" (UniqueName: \"kubernetes.io/projected/65e6101f-78cb-4c0e-9f51-3b919be17cc4-kube-api-access-bmdr7\") pod \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " Jul 07 02:20:16.107954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.107792 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-service-ca\") pod \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " Jul 07 02:20:16.107954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.107850 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-oauth-serving-cert\") pod \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " Jul 07 02:20:16.107954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.107894 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-config\") pod \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\" (UID: \"65e6101f-78cb-4c0e-9f51-3b919be17cc4\") " Jul 07 02:20:16.108306 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.108245 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-service-ca" (OuterVolumeSpecName: "service-ca") pod "65e6101f-78cb-4c0e-9f51-3b919be17cc4" (UID: "65e6101f-78cb-4c0e-9f51-3b919be17cc4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:16.108455 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.108431 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-config" (OuterVolumeSpecName: "console-config") pod "65e6101f-78cb-4c0e-9f51-3b919be17cc4" (UID: "65e6101f-78cb-4c0e-9f51-3b919be17cc4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:16.108524 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.108460 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "65e6101f-78cb-4c0e-9f51-3b919be17cc4" (UID: "65e6101f-78cb-4c0e-9f51-3b919be17cc4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:16.110003 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.109973 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e6101f-78cb-4c0e-9f51-3b919be17cc4-kube-api-access-bmdr7" (OuterVolumeSpecName: "kube-api-access-bmdr7") pod "65e6101f-78cb-4c0e-9f51-3b919be17cc4" (UID: "65e6101f-78cb-4c0e-9f51-3b919be17cc4"). InnerVolumeSpecName "kube-api-access-bmdr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:16.110003 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.109985 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "65e6101f-78cb-4c0e-9f51-3b919be17cc4" (UID: "65e6101f-78cb-4c0e-9f51-3b919be17cc4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:16.110188 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.110050 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "65e6101f-78cb-4c0e-9f51-3b919be17cc4" (UID: "65e6101f-78cb-4c0e-9f51-3b919be17cc4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:16.209403 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.209378 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-oauth-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:16.209403 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.209403 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:16.209555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.209413 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmdr7\" (UniqueName: \"kubernetes.io/projected/65e6101f-78cb-4c0e-9f51-3b919be17cc4-kube-api-access-bmdr7\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:16.209555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.209423 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-service-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:16.209555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.209433 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-oauth-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:16.209555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.209442 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65e6101f-78cb-4c0e-9f51-3b919be17cc4-console-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:16.813557 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.813517 2572 generic.go:356] "Generic (PLEG): container finished" podID="65e6101f-78cb-4c0e-9f51-3b919be17cc4" containerID="01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc" exitCode=0 Jul 07 02:20:16.813952 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.813567 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8b499f45-kpfxv" Jul 07 02:20:16.813952 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.813603 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8b499f45-kpfxv" event={"ID":"65e6101f-78cb-4c0e-9f51-3b919be17cc4","Type":"ContainerDied","Data":"01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc"} Jul 07 02:20:16.813952 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.813657 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8b499f45-kpfxv" event={"ID":"65e6101f-78cb-4c0e-9f51-3b919be17cc4","Type":"ContainerDied","Data":"974b761d4bfc5b778095c1f52ccf1388cd9fa89abc35b3c616ec6f9533f13bb3"} Jul 07 02:20:16.813952 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.813678 2572 scope.go:117] "RemoveContainer" containerID="01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc" Jul 07 02:20:16.823005 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.822987 2572 scope.go:117] "RemoveContainer" containerID="01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc" Jul 07 02:20:16.823290 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:16.823271 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc\": container with ID starting with 01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc not found: ID does not exist" containerID="01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc" Jul 07 02:20:16.823337 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.823297 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc"} err="failed to get container status \"01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc\": rpc error: code = NotFound desc = could not find container \"01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc\": container with ID starting with 01cb7d398f48bec7f094b017cd7bd756045f5b9376ab8f586839f748d6c7ecfc not found: ID does not exist" Jul 07 02:20:16.838165 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.838142 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8b499f45-kpfxv"] Jul 07 02:20:16.844428 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:16.844409 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b8b499f45-kpfxv"] Jul 07 02:20:18.025134 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:18.025098 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65e6101f-78cb-4c0e-9f51-3b919be17cc4" path="/var/lib/kubelet/pods/65e6101f-78cb-4c0e-9f51-3b919be17cc4/volumes" Jul 07 02:20:29.309066 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:29.309035 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:29.326934 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:29.326910 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:29.881109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:29.881062 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:38.787834 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:38.787800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:38.849729 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:38.849698 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:40.265757 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.265727 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84689bbbd8-8t2qw"] Jul 07 02:20:40.266126 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266090 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81909177-0ac8-41d3-bb49-5409b1dec840" containerName="console" Jul 07 02:20:40.266126 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266105 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="81909177-0ac8-41d3-bb49-5409b1dec840" containerName="console" Jul 07 02:20:40.266126 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266118 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4694dda2-8a20-4adf-8784-0b8b5ae18853" containerName="registry" Jul 07 02:20:40.266126 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266123 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4694dda2-8a20-4adf-8784-0b8b5ae18853" containerName="registry" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266130 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" containerName="console" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266136 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" containerName="console" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266157 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e6101f-78cb-4c0e-9f51-3b919be17cc4" containerName="console" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266162 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e6101f-78cb-4c0e-9f51-3b919be17cc4" containerName="console" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266228 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b24f1b-bfb3-4636-87cd-37cd4d6b9d8f" containerName="console" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266238 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="81909177-0ac8-41d3-bb49-5409b1dec840" containerName="console" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266243 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4694dda2-8a20-4adf-8784-0b8b5ae18853" containerName="registry" Jul 07 02:20:40.266261 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.266250 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e6101f-78cb-4c0e-9f51-3b919be17cc4" containerName="console" Jul 07 02:20:40.270355 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.270335 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.281593 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.281571 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84689bbbd8-8t2qw"] Jul 07 02:20:40.320548 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.320515 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:40.389117 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.389090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-trusted-ca-bundle\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.389227 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.389150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-serving-cert\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.389227 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.389177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-oauth-serving-cert\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.389319 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.389238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjjx\" (UniqueName: \"kubernetes.io/projected/6c24e44a-c3ce-47a5-bb30-509847c8b9be-kube-api-access-qpjjx\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.389319 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.389284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-oauth-config\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.389319 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.389310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-service-ca\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.389434 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.389338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-config\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.420990 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.420963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:40.489975 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.489946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-serving-cert\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490101 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.489979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-oauth-serving-cert\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490101 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjjx\" (UniqueName: \"kubernetes.io/projected/6c24e44a-c3ce-47a5-bb30-509847c8b9be-kube-api-access-qpjjx\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490101 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-oauth-config\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490279 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-service-ca\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490279 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-config\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490279 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-trusted-ca-bundle\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490696 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490675 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-oauth-serving-cert\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490821 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490793 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-service-ca\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.490945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.490846 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-config\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.491058 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.491035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-trusted-ca-bundle\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.492675 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.492654 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-oauth-config\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.492750 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.492735 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-serving-cert\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.497946 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.497929 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjjx\" (UniqueName: \"kubernetes.io/projected/6c24e44a-c3ce-47a5-bb30-509847c8b9be-kube-api-access-qpjjx\") pod \"console-84689bbbd8-8t2qw\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.580738 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.580717 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:40.708793 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.708705 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84689bbbd8-8t2qw"] Jul 07 02:20:40.711762 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:20:40.711737 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c24e44a_c3ce_47a5_bb30_509847c8b9be.slice/crio-4246c329a1e83ec7807706ef9e3f4f8d60fc9b3dcfe6941ad9839c365503ecc7 WatchSource:0}: Error finding container 4246c329a1e83ec7807706ef9e3f4f8d60fc9b3dcfe6941ad9839c365503ecc7: Status 404 returned error can't find the container with id 4246c329a1e83ec7807706ef9e3f4f8d60fc9b3dcfe6941ad9839c365503ecc7 Jul 07 02:20:40.911690 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.911609 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84689bbbd8-8t2qw" event={"ID":"6c24e44a-c3ce-47a5-bb30-509847c8b9be","Type":"ContainerStarted","Data":"3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d"} Jul 07 02:20:40.911690 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.911660 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84689bbbd8-8t2qw" event={"ID":"6c24e44a-c3ce-47a5-bb30-509847c8b9be","Type":"ContainerStarted","Data":"4246c329a1e83ec7807706ef9e3f4f8d60fc9b3dcfe6941ad9839c365503ecc7"} Jul 07 02:20:40.932883 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:40.932833 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84689bbbd8-8t2qw" podStartSLOduration=0.932818106 podStartE2EDuration="932.818106ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:40.931420988 +0000 UTC m=+195.569968451" watchObservedRunningTime="2026-07-07 02:20:40.932818106 +0000 UTC m=+195.571365568" Jul 07 02:20:43.040540 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.040507 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:20:43.040924 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.040762 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="alertmanager" containerID="cri-o://286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733" gracePeriod=120 Jul 07 02:20:43.040924 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.040831 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-metric" containerID="cri-o://dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6" gracePeriod=120 Jul 07 02:20:43.040924 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.040879 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="prom-label-proxy" containerID="cri-o://d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd" gracePeriod=120 Jul 07 02:20:43.041373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.040931 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy" containerID="cri-o://598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7" gracePeriod=120 Jul 07 02:20:43.041373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.040931 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="config-reloader" containerID="cri-o://19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6" gracePeriod=120 Jul 07 02:20:43.041373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.040874 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-web" containerID="cri-o://2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708" gracePeriod=120 Jul 07 02:20:43.926992 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.926959 2572 generic.go:356] "Generic (PLEG): container finished" podID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerID="d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd" exitCode=0 Jul 07 02:20:43.926992 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.926984 2572 generic.go:356] "Generic (PLEG): container finished" podID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerID="598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7" exitCode=0 Jul 07 02:20:43.926992 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.926991 2572 generic.go:356] "Generic (PLEG): container finished" podID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerID="19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6" exitCode=0 Jul 07 02:20:43.926992 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.926997 2572 generic.go:356] "Generic (PLEG): container finished" podID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerID="286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733" exitCode=0 Jul 07 02:20:43.927320 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.927033 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd"} Jul 07 02:20:43.927320 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.927130 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7"} Jul 07 02:20:43.927320 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.927170 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6"} Jul 07 02:20:43.927320 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:43.927205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733"} Jul 07 02:20:44.293239 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.293219 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:44.419790 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.419766 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-tls-assets\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.419945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.419801 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-web\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.419945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.419848 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-metric\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.419945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.419875 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-config-volume\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.419945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.419895 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-main-tls\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.419945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.419915 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.420249 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420057 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdhkg\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-kube-api-access-gdhkg\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.420249 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420135 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-cluster-tls-config\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.420249 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420166 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-trusted-ca-bundle\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.420249 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420190 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-metrics-client-ca\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.420249 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420220 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-config-out\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.420494 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420261 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-main-db\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.420494 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420291 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-web-config\") pod \"669d2f7e-ce65-4256-894b-7b183d6bb845\" (UID: \"669d2f7e-ce65-4256-894b-7b183d6bb845\") " Jul 07 02:20:44.421840 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.420664 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:44.421840 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.421484 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:20:44.421840 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.421793 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:44.422424 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.422397 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:44.422525 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.422434 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-config-volume" (OuterVolumeSpecName: "config-volume") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:44.422788 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.422764 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:44.423869 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.423839 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:44.424018 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.423981 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:44.424130 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.424026 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:44.424130 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.424036 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-kube-api-access-gdhkg" (OuterVolumeSpecName: "kube-api-access-gdhkg") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "kube-api-access-gdhkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:44.424336 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.424319 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-config-out" (OuterVolumeSpecName: "config-out") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:20:44.427979 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.427901 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:44.433931 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.433912 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-web-config" (OuterVolumeSpecName: "web-config") pod "669d2f7e-ce65-4256-894b-7b183d6bb845" (UID: "669d2f7e-ce65-4256-894b-7b183d6bb845"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:44.520935 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520886 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.520935 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520905 2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-config-volume\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.520935 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520915 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-main-tls\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.520935 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520925 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.520935 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520934 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdhkg\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-kube-api-access-gdhkg\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520943 2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-cluster-tls-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520954 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520962 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/669d2f7e-ce65-4256-894b-7b183d6bb845-metrics-client-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520969 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-config-out\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520978 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/669d2f7e-ce65-4256-894b-7b183d6bb845-alertmanager-main-db\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520986 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-web-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.520994 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/669d2f7e-ce65-4256-894b-7b183d6bb845-tls-assets\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.521152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.521001 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/669d2f7e-ce65-4256-894b-7b183d6bb845-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:44.940695 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.940657 2572 generic.go:356] "Generic (PLEG): container finished" podID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerID="dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6" exitCode=0 Jul 07 02:20:44.940695 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.940688 2572 generic.go:356] "Generic (PLEG): container finished" podID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerID="2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708" exitCode=0 Jul 07 02:20:44.940884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.940695 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6"} Jul 07 02:20:44.940884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.940738 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:44.940884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.940803 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708"} Jul 07 02:20:44.940884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.940832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"669d2f7e-ce65-4256-894b-7b183d6bb845","Type":"ContainerDied","Data":"da8dd917743f991e15633f5edc99b16f58bf08a2709a0c2e2b916b91a8f322ce"} Jul 07 02:20:44.940884 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.940871 2572 scope.go:117] "RemoveContainer" containerID="d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd" Jul 07 02:20:44.948534 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.948501 2572 scope.go:117] "RemoveContainer" containerID="dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6" Jul 07 02:20:44.955555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.955531 2572 scope.go:117] "RemoveContainer" containerID="598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7" Jul 07 02:20:44.962004 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.961988 2572 scope.go:117] "RemoveContainer" containerID="2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708" Jul 07 02:20:44.964946 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.964924 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:20:44.968418 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.968397 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:20:44.969532 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.969520 2572 scope.go:117] "RemoveContainer" containerID="19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6" Jul 07 02:20:44.975993 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.975976 2572 scope.go:117] "RemoveContainer" containerID="286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733" Jul 07 02:20:44.982532 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.982515 2572 scope.go:117] "RemoveContainer" containerID="adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6" Jul 07 02:20:44.990794 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.990773 2572 scope.go:117] "RemoveContainer" containerID="d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd" Jul 07 02:20:44.991102 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:44.991057 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd\": container with ID starting with d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd not found: ID does not exist" containerID="d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd" Jul 07 02:20:44.991187 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991101 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd"} err="failed to get container status \"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd\": rpc error: code = NotFound desc = could not find container \"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd\": container with ID starting with d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd not found: ID does not exist" Jul 07 02:20:44.991187 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991123 2572 scope.go:117] "RemoveContainer" containerID="dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6" Jul 07 02:20:44.991364 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:44.991348 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6\": container with ID starting with dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6 not found: ID does not exist" containerID="dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6" Jul 07 02:20:44.991429 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991367 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6"} err="failed to get container status \"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6\": rpc error: code = NotFound desc = could not find container \"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6\": container with ID starting with dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6 not found: ID does not exist" Jul 07 02:20:44.991429 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991380 2572 scope.go:117] "RemoveContainer" containerID="598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7" Jul 07 02:20:44.991612 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:44.991590 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7\": container with ID starting with 598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7 not found: ID does not exist" containerID="598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7" Jul 07 02:20:44.991673 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991616 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7"} err="failed to get container status \"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7\": rpc error: code = NotFound desc = could not find container \"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7\": container with ID starting with 598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7 not found: ID does not exist" Jul 07 02:20:44.991673 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991633 2572 scope.go:117] "RemoveContainer" containerID="2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708" Jul 07 02:20:44.991857 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:44.991840 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708\": container with ID starting with 2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708 not found: ID does not exist" containerID="2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708" Jul 07 02:20:44.991920 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991860 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708"} err="failed to get container status \"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708\": rpc error: code = NotFound desc = could not find container \"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708\": container with ID starting with 2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708 not found: ID does not exist" Jul 07 02:20:44.991920 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.991874 2572 scope.go:117] "RemoveContainer" containerID="19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6" Jul 07 02:20:44.992099 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:44.992065 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6\": container with ID starting with 19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6 not found: ID does not exist" containerID="19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6" Jul 07 02:20:44.992181 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992103 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6"} err="failed to get container status \"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6\": rpc error: code = NotFound desc = could not find container \"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6\": container with ID starting with 19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6 not found: ID does not exist" Jul 07 02:20:44.992181 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992117 2572 scope.go:117] "RemoveContainer" containerID="286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733" Jul 07 02:20:44.992338 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:44.992324 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733\": container with ID starting with 286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733 not found: ID does not exist" containerID="286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733" Jul 07 02:20:44.992379 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992342 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733"} err="failed to get container status \"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733\": rpc error: code = NotFound desc = could not find container \"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733\": container with ID starting with 286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733 not found: ID does not exist" Jul 07 02:20:44.992379 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992353 2572 scope.go:117] "RemoveContainer" containerID="adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6" Jul 07 02:20:44.992595 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:44.992578 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6\": container with ID starting with adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6 not found: ID does not exist" containerID="adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6" Jul 07 02:20:44.992646 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992599 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6"} err="failed to get container status \"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6\": rpc error: code = NotFound desc = could not find container \"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6\": container with ID starting with adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6 not found: ID does not exist" Jul 07 02:20:44.992646 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992612 2572 scope.go:117] "RemoveContainer" containerID="d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd" Jul 07 02:20:44.992818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992800 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd"} err="failed to get container status \"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd\": rpc error: code = NotFound desc = could not find container \"d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd\": container with ID starting with d29278ecae52075c50a01bd408c1c8b64d6ee36ea595f60bc8fd7ebcc13060bd not found: ID does not exist" Jul 07 02:20:44.992860 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.992820 2572 scope.go:117] "RemoveContainer" containerID="dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6" Jul 07 02:20:44.993026 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993007 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6"} err="failed to get container status \"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6\": rpc error: code = NotFound desc = could not find container \"dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6\": container with ID starting with dc4431982146c125c5ff87be752f47ad7fc7685ef9cb1d9f38817de9ad4717b6 not found: ID does not exist" Jul 07 02:20:44.993097 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993026 2572 scope.go:117] "RemoveContainer" containerID="598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7" Jul 07 02:20:44.993277 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993261 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7"} err="failed to get container status \"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7\": rpc error: code = NotFound desc = could not find container \"598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7\": container with ID starting with 598279be6f5fd4a2a58c29fb8bc43ba6c2c08b13b8351d609833934fc992b7c7 not found: ID does not exist" Jul 07 02:20:44.993316 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993278 2572 scope.go:117] "RemoveContainer" containerID="2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708" Jul 07 02:20:44.993476 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993461 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708"} err="failed to get container status \"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708\": rpc error: code = NotFound desc = could not find container \"2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708\": container with ID starting with 2d5a7981ca933476d5051c4856d5ef4593a9b2fcfb07e61cef5a10ca574f2708 not found: ID does not exist" Jul 07 02:20:44.993476 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993475 2572 scope.go:117] "RemoveContainer" containerID="19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6" Jul 07 02:20:44.993652 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993637 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6"} err="failed to get container status \"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6\": rpc error: code = NotFound desc = could not find container \"19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6\": container with ID starting with 19ad3487bec8b73a560251a9fa76045eb68416f681424953c54dedc3ed0b92a6 not found: ID does not exist" Jul 07 02:20:44.993652 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993651 2572 scope.go:117] "RemoveContainer" containerID="286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733" Jul 07 02:20:44.993818 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993797 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733"} err="failed to get container status \"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733\": rpc error: code = NotFound desc = could not find container \"286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733\": container with ID starting with 286083e5f10e142616851d776e3f88fa23ac18d4b16fc495518c3ac5b7dc1733 not found: ID does not exist" Jul 07 02:20:44.993877 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993820 2572 scope.go:117] "RemoveContainer" containerID="adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6" Jul 07 02:20:44.994030 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:44.993996 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6"} err="failed to get container status \"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6\": rpc error: code = NotFound desc = could not find container \"adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6\": container with ID starting with adcb279be7d09db72fb461fe05cb63113168fb203344cf40ad0f38fb646d09c6 not found: ID does not exist" Jul 07 02:20:45.008122 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008101 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:20:45.008575 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008559 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="config-reloader" Jul 07 02:20:45.008618 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008580 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="config-reloader" Jul 07 02:20:45.008618 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008596 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-web" Jul 07 02:20:45.008618 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008607 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-web" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008631 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="prom-label-proxy" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008641 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="prom-label-proxy" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008653 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008662 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008673 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="init-config-reloader" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008683 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="init-config-reloader" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008693 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-metric" Jul 07 02:20:45.008711 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008701 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-metric" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008727 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="alertmanager" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008735 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="alertmanager" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008807 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="alertmanager" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008819 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="prom-label-proxy" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008832 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008841 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-web" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008849 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="config-reloader" Jul 07 02:20:45.008927 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.008858 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" containerName="kube-rbac-proxy-metric" Jul 07 02:20:45.014530 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.014512 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.019557 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.019537 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 02:20:45.019658 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.019558 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 02:20:45.019658 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.019581 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 02:20:45.019821 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.019807 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 02:20:45.020119 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.020100 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 02:20:45.020316 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.020292 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pphqs\"" Jul 07 02:20:45.020546 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.020530 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 02:20:45.020798 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.020780 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 02:20:45.020892 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.020819 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 02:20:45.036822 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.036801 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 02:20:45.067557 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.067529 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:20:45.125274 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/462c0bc4-32ff-42fd-840f-3bf10a74251d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462c0bc4-32ff-42fd-840f-3bf10a74251d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125368 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjl5n\" (UniqueName: \"kubernetes.io/projected/462c0bc4-32ff-42fd-840f-3bf10a74251d-kube-api-access-xjl5n\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125480 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/462c0bc4-32ff-42fd-840f-3bf10a74251d-config-out\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125480 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125407 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/462c0bc4-32ff-42fd-840f-3bf10a74251d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125480 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125502 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-web-config\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462c0bc4-32ff-42fd-840f-3bf10a74251d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125709 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-config-volume\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.125709 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.125629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226304 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/462c0bc4-32ff-42fd-840f-3bf10a74251d-config-out\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226304 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/462c0bc4-32ff-42fd-840f-3bf10a74251d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226304 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-web-config\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462c0bc4-32ff-42fd-840f-3bf10a74251d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-config-volume\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226523 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/462c0bc4-32ff-42fd-840f-3bf10a74251d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226548 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462c0bc4-32ff-42fd-840f-3bf10a74251d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.226783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.226596 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjl5n\" (UniqueName: \"kubernetes.io/projected/462c0bc4-32ff-42fd-840f-3bf10a74251d-kube-api-access-xjl5n\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.227678 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.227646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462c0bc4-32ff-42fd-840f-3bf10a74251d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.227934 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.227910 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/462c0bc4-32ff-42fd-840f-3bf10a74251d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.229566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.229318 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-web-config\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.229566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.229353 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/462c0bc4-32ff-42fd-840f-3bf10a74251d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.229566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.229470 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/462c0bc4-32ff-42fd-840f-3bf10a74251d-config-out\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.229566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.229471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.229566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.229517 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.229566 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.229561 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-config-volume\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.229953 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.229931 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.230016 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.230000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462c0bc4-32ff-42fd-840f-3bf10a74251d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.230398 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.230377 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.231333 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.231315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/462c0bc4-32ff-42fd-840f-3bf10a74251d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.234427 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.234411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjl5n\" (UniqueName: \"kubernetes.io/projected/462c0bc4-32ff-42fd-840f-3bf10a74251d-kube-api-access-xjl5n\") pod \"alertmanager-main-0\" (UID: \"462c0bc4-32ff-42fd-840f-3bf10a74251d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.324447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.324431 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 02:20:45.457954 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.457929 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 02:20:45.459023 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:20:45.458994 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462c0bc4_32ff_42fd_840f_3bf10a74251d.slice/crio-438b551a7fb9a8d1315882cb8844e0f1e564829b10719be386f9dde337b51d45 WatchSource:0}: Error finding container 438b551a7fb9a8d1315882cb8844e0f1e564829b10719be386f9dde337b51d45: Status 404 returned error can't find the container with id 438b551a7fb9a8d1315882cb8844e0f1e564829b10719be386f9dde337b51d45 Jul 07 02:20:45.947298 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.947267 2572 generic.go:356] "Generic (PLEG): container finished" podID="462c0bc4-32ff-42fd-840f-3bf10a74251d" containerID="c47100568b9b6609190f01f6f802488ae291eb4188ed7b9612faa015a7aedddc" exitCode=0 Jul 07 02:20:45.947440 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.947309 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerDied","Data":"c47100568b9b6609190f01f6f802488ae291eb4188ed7b9612faa015a7aedddc"} Jul 07 02:20:45.947440 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:45.947369 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerStarted","Data":"438b551a7fb9a8d1315882cb8844e0f1e564829b10719be386f9dde337b51d45"} Jul 07 02:20:46.036699 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.036675 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="669d2f7e-ce65-4256-894b-7b183d6bb845" path="/var/lib/kubelet/pods/669d2f7e-ce65-4256-894b-7b183d6bb845/volumes" Jul 07 02:20:46.954323 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.954293 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerStarted","Data":"59a56e81ce7328db84b214e04f6ce35026e2f71a9ce1247e4375e03ad0999a50"} Jul 07 02:20:46.954676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.954353 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerStarted","Data":"21d88b54dc220de257cbc136f178b80e7fa9224b830be00f983193af6c39c951"} Jul 07 02:20:46.954676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.954380 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerStarted","Data":"d20b8015d701a5535ab62194987e37827b755e6c14f7c90538bc6b2c69e059ee"} Jul 07 02:20:46.954676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.954405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerStarted","Data":"3ab17dd97f763828ff3deae92a00232a794085243514f36cb6fcdb39705a8550"} Jul 07 02:20:46.954676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.954431 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerStarted","Data":"cf9a9e8ac14e8b70c9abc1d2a174672fff137349e1fcde2450501b07b833f17f"} Jul 07 02:20:46.954676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.954455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"462c0bc4-32ff-42fd-840f-3bf10a74251d","Type":"ContainerStarted","Data":"fd08d2792fe53425da3ab9e0c0d1eac6f527850ac6902e52ff9f9ef3e814cb60"} Jul 07 02:20:46.982674 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:46.982609 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.966921514 podStartE2EDuration="2.982589655s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.668141ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:46.981490783 +0000 UTC m=+201.620038260" watchObservedRunningTime="2026-07-07 02:20:46.982589655 +0000 UTC m=+201.621137132" Jul 07 02:20:47.303584 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.303497 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:20:47.303896 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.303858 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="prometheus" containerID="cri-o://76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" gracePeriod=600 Jul 07 02:20:47.303896 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.303869 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy" containerID="cri-o://16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" gracePeriod=600 Jul 07 02:20:47.304095 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.303905 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-thanos" containerID="cri-o://25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" gracePeriod=600 Jul 07 02:20:47.304095 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.303914 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="config-reloader" containerID="cri-o://743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" gracePeriod=600 Jul 07 02:20:47.304095 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.303929 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-web" containerID="cri-o://f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" gracePeriod=600 Jul 07 02:20:47.304222 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.304118 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="thanos-sidecar" containerID="cri-o://933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" gracePeriod=600 Jul 07 02:20:47.638609 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.638587 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:47.748437 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748408 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-2\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.748572 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748441 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-1\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.748572 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748478 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.748572 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748506 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmf7q\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-kube-api-access-zmf7q\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.748572 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748531 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-metrics-client-certs\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.748572 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748561 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-kubelet-serving-ca-bundle\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.748812 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748586 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-db\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.748864 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748816 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:47.748925 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748843 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:47.749004 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.748980 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-grpc-tls\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749007 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:47.749152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749025 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-web-config\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749048 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-tls-assets\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749101 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-serving-certs-ca-bundle\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749152 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749146 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-thanos-prometheus-http-client-file\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749434 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749229 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-trusted-ca-bundle\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749434 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749267 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-tls\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749434 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749290 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-kube-rbac-proxy\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749434 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749343 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-config-out\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749434 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-0\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749434 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749402 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-config\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749699 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749442 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-metrics-client-ca\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.749699 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749479 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"02cc9a48-4c93-4dba-83a5-47d87679e550\" (UID: \"02cc9a48-4c93-4dba-83a5-47d87679e550\") " Jul 07 02:20:47.750067 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749843 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.750067 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749868 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.750067 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749885 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.750067 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.749879 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:20:47.751002 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.750972 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.751130 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.751100 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.751226 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.751122 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-kube-api-access-zmf7q" (OuterVolumeSpecName: "kube-api-access-zmf7q") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "kube-api-access-zmf7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:47.751842 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.751331 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:47.751842 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.751395 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.751842 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.751711 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:47.751842 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.751800 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:47.751842 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.751806 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:20:47.752867 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.752842 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.752957 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.752864 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-config" (OuterVolumeSpecName: "config") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.753403 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.753379 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.753547 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.753522 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:20:47.753623 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.753601 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.753959 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.753940 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-config-out" (OuterVolumeSpecName: "config-out") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:20:47.754239 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.754218 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.763024 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.763005 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-web-config" (OuterVolumeSpecName: "web-config") pod "02cc9a48-4c93-4dba-83a5-47d87679e550" (UID: "02cc9a48-4c93-4dba-83a5-47d87679e550"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:20:47.850583 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850564 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850584 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmf7q\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-kube-api-access-zmf7q\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850593 2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-metrics-client-certs\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850601 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-db\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850609 2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-grpc-tls\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850618 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-web-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850625 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02cc9a48-4c93-4dba-83a5-47d87679e550-tls-assets\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850632 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850641 2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850648 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850656 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850665 2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-kube-rbac-proxy\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850672 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02cc9a48-4c93-4dba-83a5-47d87679e550-config-out\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850679 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850688 2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850696 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cc9a48-4c93-4dba-83a5-47d87679e550-configmap-metrics-client-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.850917 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.850703 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02cc9a48-4c93-4dba-83a5-47d87679e550-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:20:47.961716 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961691 2572 generic.go:356] "Generic (PLEG): container finished" podID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" exitCode=0 Jul 07 02:20:47.961716 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961711 2572 generic.go:356] "Generic (PLEG): container finished" podID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" exitCode=0 Jul 07 02:20:47.961716 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961717 2572 generic.go:356] "Generic (PLEG): container finished" podID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" exitCode=0 Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961722 2572 generic.go:356] "Generic (PLEG): container finished" podID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" exitCode=0 Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961727 2572 generic.go:356] "Generic (PLEG): container finished" podID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" exitCode=0 Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961732 2572 generic.go:356] "Generic (PLEG): container finished" podID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" exitCode=0 Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961765 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961778 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961872 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961934 2572 scope.go:117] "RemoveContainer" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961956 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.961999 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.962042 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.962102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} Jul 07 02:20:47.962200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.962147 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02cc9a48-4c93-4dba-83a5-47d87679e550","Type":"ContainerDied","Data":"754b906c36070a76f6edca83367516de09f903fa78fc6521603ef6ac18815983"} Jul 07 02:20:47.973444 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.973419 2572 scope.go:117] "RemoveContainer" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:47.980937 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.980918 2572 scope.go:117] "RemoveContainer" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:47.987975 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.987949 2572 scope.go:117] "RemoveContainer" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:47.988990 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.988971 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:20:47.993743 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.993723 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:20:47.994723 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:47.994711 2572 scope.go:117] "RemoveContainer" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.001311 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.001296 2572 scope.go:117] "RemoveContainer" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.008011 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.007995 2572 scope.go:117] "RemoveContainer" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.014404 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.014390 2572 scope.go:117] "RemoveContainer" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:48.014622 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:48.014606 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": container with ID starting with 25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2 not found: ID does not exist" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:48.014673 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.014629 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} err="failed to get container status \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": rpc error: code = NotFound desc = could not find container \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": container with ID starting with 25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2 not found: ID does not exist" Jul 07 02:20:48.014673 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.014644 2572 scope.go:117] "RemoveContainer" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:48.014884 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:48.014866 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": container with ID starting with 16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb not found: ID does not exist" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:48.014947 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.014892 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} err="failed to get container status \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": rpc error: code = NotFound desc = could not find container \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": container with ID starting with 16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb not found: ID does not exist" Jul 07 02:20:48.014947 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.014914 2572 scope.go:117] "RemoveContainer" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:48.015147 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:48.015130 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": container with ID starting with f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3 not found: ID does not exist" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:48.015228 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015150 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} err="failed to get container status \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": rpc error: code = NotFound desc = could not find container \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": container with ID starting with f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3 not found: ID does not exist" Jul 07 02:20:48.015228 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015162 2572 scope.go:117] "RemoveContainer" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:48.015331 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:48.015314 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": container with ID starting with 933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab not found: ID does not exist" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:48.015365 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015335 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} err="failed to get container status \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": rpc error: code = NotFound desc = could not find container \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": container with ID starting with 933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab not found: ID does not exist" Jul 07 02:20:48.015365 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015348 2572 scope.go:117] "RemoveContainer" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.015531 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:48.015515 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": container with ID starting with 743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888 not found: ID does not exist" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.015587 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015540 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} err="failed to get container status \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": rpc error: code = NotFound desc = could not find container \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": container with ID starting with 743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888 not found: ID does not exist" Jul 07 02:20:48.015587 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015564 2572 scope.go:117] "RemoveContainer" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.015798 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:48.015784 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": container with ID starting with 76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c not found: ID does not exist" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.015834 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015801 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} err="failed to get container status \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": rpc error: code = NotFound desc = could not find container \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": container with ID starting with 76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c not found: ID does not exist" Jul 07 02:20:48.015834 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015812 2572 scope.go:117] "RemoveContainer" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.015997 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:20:48.015983 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": container with ID starting with 7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c not found: ID does not exist" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.016038 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.015998 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c"} err="failed to get container status \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": rpc error: code = NotFound desc = could not find container \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": container with ID starting with 7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c not found: ID does not exist" Jul 07 02:20:48.016038 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016011 2572 scope.go:117] "RemoveContainer" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:48.016249 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016228 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} err="failed to get container status \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": rpc error: code = NotFound desc = could not find container \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": container with ID starting with 25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2 not found: ID does not exist" Jul 07 02:20:48.016288 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016251 2572 scope.go:117] "RemoveContainer" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:48.016470 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016452 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} err="failed to get container status \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": rpc error: code = NotFound desc = could not find container \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": container with ID starting with 16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb not found: ID does not exist" Jul 07 02:20:48.016549 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016473 2572 scope.go:117] "RemoveContainer" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:48.016693 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016666 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} err="failed to get container status \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": rpc error: code = NotFound desc = could not find container \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": container with ID starting with f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3 not found: ID does not exist" Jul 07 02:20:48.016693 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016685 2572 scope.go:117] "RemoveContainer" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:48.016933 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016913 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} err="failed to get container status \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": rpc error: code = NotFound desc = could not find container \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": container with ID starting with 933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab not found: ID does not exist" Jul 07 02:20:48.016933 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.016930 2572 scope.go:117] "RemoveContainer" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.017180 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017161 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} err="failed to get container status \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": rpc error: code = NotFound desc = could not find container \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": container with ID starting with 743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888 not found: ID does not exist" Jul 07 02:20:48.017263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017182 2572 scope.go:117] "RemoveContainer" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.017422 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017402 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} err="failed to get container status \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": rpc error: code = NotFound desc = could not find container \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": container with ID starting with 76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c not found: ID does not exist" Jul 07 02:20:48.017471 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017422 2572 scope.go:117] "RemoveContainer" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.017628 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017612 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c"} err="failed to get container status \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": rpc error: code = NotFound desc = could not find container \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": container with ID starting with 7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c not found: ID does not exist" Jul 07 02:20:48.017673 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017628 2572 scope.go:117] "RemoveContainer" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:48.017832 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017815 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} err="failed to get container status \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": rpc error: code = NotFound desc = could not find container \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": container with ID starting with 25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2 not found: ID does not exist" Jul 07 02:20:48.017870 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.017832 2572 scope.go:117] "RemoveContainer" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:48.018032 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018016 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} err="failed to get container status \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": rpc error: code = NotFound desc = could not find container \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": container with ID starting with 16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb not found: ID does not exist" Jul 07 02:20:48.018069 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018032 2572 scope.go:117] "RemoveContainer" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:48.018220 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018205 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} err="failed to get container status \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": rpc error: code = NotFound desc = could not find container \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": container with ID starting with f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3 not found: ID does not exist" Jul 07 02:20:48.018268 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018220 2572 scope.go:117] "RemoveContainer" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:48.018402 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018387 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} err="failed to get container status \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": rpc error: code = NotFound desc = could not find container \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": container with ID starting with 933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab not found: ID does not exist" Jul 07 02:20:48.018439 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018402 2572 scope.go:117] "RemoveContainer" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.018596 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018581 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} err="failed to get container status \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": rpc error: code = NotFound desc = could not find container \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": container with ID starting with 743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888 not found: ID does not exist" Jul 07 02:20:48.018634 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018597 2572 scope.go:117] "RemoveContainer" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.018775 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018760 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} err="failed to get container status \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": rpc error: code = NotFound desc = could not find container \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": container with ID starting with 76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c not found: ID does not exist" Jul 07 02:20:48.018812 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018775 2572 scope.go:117] "RemoveContainer" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.018951 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018936 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c"} err="failed to get container status \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": rpc error: code = NotFound desc = could not find container \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": container with ID starting with 7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c not found: ID does not exist" Jul 07 02:20:48.018993 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.018950 2572 scope.go:117] "RemoveContainer" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:48.019132 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019118 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} err="failed to get container status \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": rpc error: code = NotFound desc = could not find container \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": container with ID starting with 25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2 not found: ID does not exist" Jul 07 02:20:48.019132 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019131 2572 scope.go:117] "RemoveContainer" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:48.019320 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019300 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} err="failed to get container status \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": rpc error: code = NotFound desc = could not find container \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": container with ID starting with 16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb not found: ID does not exist" Jul 07 02:20:48.019364 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019321 2572 scope.go:117] "RemoveContainer" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:48.019568 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019538 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} err="failed to get container status \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": rpc error: code = NotFound desc = could not find container \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": container with ID starting with f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3 not found: ID does not exist" Jul 07 02:20:48.019568 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019561 2572 scope.go:117] "RemoveContainer" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:48.019796 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019776 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} err="failed to get container status \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": rpc error: code = NotFound desc = could not find container \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": container with ID starting with 933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab not found: ID does not exist" Jul 07 02:20:48.019858 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.019799 2572 scope.go:117] "RemoveContainer" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.020095 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.020051 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} err="failed to get container status \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": rpc error: code = NotFound desc = could not find container \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": container with ID starting with 743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888 not found: ID does not exist" Jul 07 02:20:48.020095 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.020090 2572 scope.go:117] "RemoveContainer" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.025895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.020672 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} err="failed to get container status \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": rpc error: code = NotFound desc = could not find container \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": container with ID starting with 76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c not found: ID does not exist" Jul 07 02:20:48.025895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.020714 2572 scope.go:117] "RemoveContainer" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.026369 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.026340 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c"} err="failed to get container status \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": rpc error: code = NotFound desc = could not find container \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": container with ID starting with 7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c not found: ID does not exist" Jul 07 02:20:48.026369 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.026364 2572 scope.go:117] "RemoveContainer" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:48.026652 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.026627 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} err="failed to get container status \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": rpc error: code = NotFound desc = could not find container \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": container with ID starting with 25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2 not found: ID does not exist" Jul 07 02:20:48.026723 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.026652 2572 scope.go:117] "RemoveContainer" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:48.026909 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.026888 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} err="failed to get container status \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": rpc error: code = NotFound desc = could not find container \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": container with ID starting with 16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb not found: ID does not exist" Jul 07 02:20:48.026968 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.026910 2572 scope.go:117] "RemoveContainer" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:48.027188 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027171 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} err="failed to get container status \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": rpc error: code = NotFound desc = could not find container \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": container with ID starting with f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3 not found: ID does not exist" Jul 07 02:20:48.027245 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027189 2572 scope.go:117] "RemoveContainer" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:48.027448 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027427 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} err="failed to get container status \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": rpc error: code = NotFound desc = could not find container \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": container with ID starting with 933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab not found: ID does not exist" Jul 07 02:20:48.027497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027451 2572 scope.go:117] "RemoveContainer" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.027688 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027669 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} err="failed to get container status \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": rpc error: code = NotFound desc = could not find container \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": container with ID starting with 743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888 not found: ID does not exist" Jul 07 02:20:48.027745 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027690 2572 scope.go:117] "RemoveContainer" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.027949 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027923 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} err="failed to get container status \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": rpc error: code = NotFound desc = could not find container \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": container with ID starting with 76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c not found: ID does not exist" Jul 07 02:20:48.028006 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.027950 2572 scope.go:117] "RemoveContainer" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.028246 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.028202 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c"} err="failed to get container status \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": rpc error: code = NotFound desc = could not find container \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": container with ID starting with 7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c not found: ID does not exist" Jul 07 02:20:48.028344 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.028250 2572 scope.go:117] "RemoveContainer" containerID="25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2" Jul 07 02:20:48.028554 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.028529 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2"} err="failed to get container status \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": rpc error: code = NotFound desc = could not find container \"25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2\": container with ID starting with 25be0538dbbcafdf3e712da5a498b33de71e89091183caeb71a5adc0836923e2 not found: ID does not exist" Jul 07 02:20:48.028610 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.028558 2572 scope.go:117] "RemoveContainer" containerID="16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb" Jul 07 02:20:48.028847 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.028819 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb"} err="failed to get container status \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": rpc error: code = NotFound desc = could not find container \"16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb\": container with ID starting with 16705dfd660422dd426c366b97bb7ac91515678dabdaad9dafef2ca0bd9623eb not found: ID does not exist" Jul 07 02:20:48.028905 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.028853 2572 scope.go:117] "RemoveContainer" containerID="f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3" Jul 07 02:20:48.029111 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029089 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3"} err="failed to get container status \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": rpc error: code = NotFound desc = could not find container \"f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3\": container with ID starting with f712a84587db39f24c123b1ae0dfa4097caabc827a01c34606a00c26117954b3 not found: ID does not exist" Jul 07 02:20:48.029172 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029111 2572 scope.go:117] "RemoveContainer" containerID="933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab" Jul 07 02:20:48.029318 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029301 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab"} err="failed to get container status \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": rpc error: code = NotFound desc = could not find container \"933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab\": container with ID starting with 933cf6d32881e4c49a6256c6675ad9a6bd06ae4b90db98a522db05220033afab not found: ID does not exist" Jul 07 02:20:48.029361 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029318 2572 scope.go:117] "RemoveContainer" containerID="743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888" Jul 07 02:20:48.029540 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029518 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888"} err="failed to get container status \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": rpc error: code = NotFound desc = could not find container \"743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888\": container with ID starting with 743abd23f2a32038f3663c41b9989ba737c0d230abe1449ee85a5a4eea4b5888 not found: ID does not exist" Jul 07 02:20:48.029593 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029542 2572 scope.go:117] "RemoveContainer" containerID="76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c" Jul 07 02:20:48.029752 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029735 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c"} err="failed to get container status \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": rpc error: code = NotFound desc = could not find container \"76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c\": container with ID starting with 76f1ddde6380ff48429f07d6f37b8aeb940d2508c835bc29f815f2e1b967530c not found: ID does not exist" Jul 07 02:20:48.029846 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.029752 2572 scope.go:117] "RemoveContainer" containerID="7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c" Jul 07 02:20:48.030050 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030013 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c"} err="failed to get container status \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": rpc error: code = NotFound desc = could not find container \"7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c\": container with ID starting with 7254445af68ec9fc39dce18b4cb088ae75d180070e481f772dc7ef8c5a550c8c not found: ID does not exist" Jul 07 02:20:48.030146 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030127 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" path="/var/lib/kubelet/pods/02cc9a48-4c93-4dba-83a5-47d87679e550/volumes" Jul 07 02:20:48.030603 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030590 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:20:48.030868 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030849 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="config-reloader" Jul 07 02:20:48.030903 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030870 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="config-reloader" Jul 07 02:20:48.030903 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030880 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy" Jul 07 02:20:48.030903 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030885 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy" Jul 07 02:20:48.030903 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030893 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="init-config-reloader" Jul 07 02:20:48.030903 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030899 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="init-config-reloader" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030909 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-web" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030915 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-web" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030923 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="thanos-sidecar" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030928 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="thanos-sidecar" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030933 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-thanos" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030938 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-thanos" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030943 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="prometheus" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030948 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="prometheus" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.030997 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.031007 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="prometheus" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.031013 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-thanos" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.031019 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="kube-rbac-proxy-web" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.031025 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="config-reloader" Jul 07 02:20:48.031044 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.031032 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cc9a48-4c93-4dba-83a5-47d87679e550" containerName="thanos-sidecar" Jul 07 02:20:48.036227 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.036211 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.040703 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.040674 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 02:20:48.040882 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.040865 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 02:20:48.040943 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.040908 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4i2uee63rb39g\"" Jul 07 02:20:48.041029 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.040918 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 02:20:48.041029 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.040924 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 02:20:48.041029 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.040914 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 02:20:48.041200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.040958 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9xvbs\"" Jul 07 02:20:48.041415 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.041392 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 02:20:48.041509 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.041402 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 02:20:48.041704 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.041653 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 02:20:48.041704 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.041676 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 02:20:48.041704 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.041701 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 02:20:48.042200 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.042183 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 02:20:48.042447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.042430 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 02:20:48.042702 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.042685 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 02:20:48.044162 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.044142 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 02:20:48.048390 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.048371 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 02:20:48.051806 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.051756 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:20:48.152552 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-config\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.152552 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.152667 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh8sb\" (UniqueName: \"kubernetes.io/projected/17c2c6d7-208b-4aed-9381-4ab3796a9614-kube-api-access-vh8sb\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.152667 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152638 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.152741 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.152777 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152821 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17c2c6d7-208b-4aed-9381-4ab3796a9614-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17c2c6d7-208b-4aed-9381-4ab3796a9614-config-out\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153000 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.152982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-web-config\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153263 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.153513 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.153289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.253869 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.253842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh8sb\" (UniqueName: \"kubernetes.io/projected/17c2c6d7-208b-4aed-9381-4ab3796a9614-kube-api-access-vh8sb\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.253967 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.253878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.253967 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.253896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.253967 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.253922 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.253967 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.253942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254203 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.253977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17c2c6d7-208b-4aed-9381-4ab3796a9614-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254203 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254203 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17c2c6d7-208b-4aed-9381-4ab3796a9614-config-out\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254478 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254555 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254652 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254573 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254652 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254652 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254798 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254798 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254798 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-web-config\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254798 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.254798 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.255047 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-config\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.255047 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.255047 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.254869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.255430 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.255409 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.255647 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.255618 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.256497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.256104 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.256497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.256401 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.256959 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.256896 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17c2c6d7-208b-4aed-9381-4ab3796a9614-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.257259 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.257217 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17c2c6d7-208b-4aed-9381-4ab3796a9614-config-out\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.257481 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.257438 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.257754 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.257724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-web-config\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.257846 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.257731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.257956 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.257935 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.258567 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.258542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.258897 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.258874 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-config\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.259158 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.259140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/17c2c6d7-208b-4aed-9381-4ab3796a9614-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.259321 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.259302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.259441 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.259427 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.259479 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.259464 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.260088 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.260060 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/17c2c6d7-208b-4aed-9381-4ab3796a9614-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.262903 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.262886 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh8sb\" (UniqueName: \"kubernetes.io/projected/17c2c6d7-208b-4aed-9381-4ab3796a9614-kube-api-access-vh8sb\") pod \"prometheus-k8s-0\" (UID: \"17c2c6d7-208b-4aed-9381-4ab3796a9614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.345741 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.345710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:20:48.478332 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.478308 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 02:20:48.480197 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:20:48.480173 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c2c6d7_208b_4aed_9381_4ab3796a9614.slice/crio-ae5680c67f2f114236d90292dc485a3f4dc6af65ed2d93a60fcec41f79465cfe WatchSource:0}: Error finding container ae5680c67f2f114236d90292dc485a3f4dc6af65ed2d93a60fcec41f79465cfe: Status 404 returned error can't find the container with id ae5680c67f2f114236d90292dc485a3f4dc6af65ed2d93a60fcec41f79465cfe Jul 07 02:20:48.969676 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.969650 2572 generic.go:356] "Generic (PLEG): container finished" podID="17c2c6d7-208b-4aed-9381-4ab3796a9614" containerID="401550c783d555adf3b88bdd9c89c840dae8b3d6f79ec5cbcc16d327b903a318" exitCode=0 Jul 07 02:20:48.970019 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.969693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerDied","Data":"401550c783d555adf3b88bdd9c89c840dae8b3d6f79ec5cbcc16d327b903a318"} Jul 07 02:20:48.970019 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:48.969742 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerStarted","Data":"ae5680c67f2f114236d90292dc485a3f4dc6af65ed2d93a60fcec41f79465cfe"} Jul 07 02:20:49.977854 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:49.977816 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerStarted","Data":"1d2db54e1983a9da9cb1410ff5d31b0d895b43f79e9ec8b6940d4e3ecf0d9456"} Jul 07 02:20:49.978213 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:49.977933 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerStarted","Data":"b7eb3253340ddbbcc7b50348de7c30c873d99bdc81104bcafbf747fcb570dcc1"} Jul 07 02:20:49.978213 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:49.977983 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerStarted","Data":"4d864f8f4846946ff1559a97c835126137d683d8833625d824d975bc00c439aa"} Jul 07 02:20:49.978213 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:49.978022 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerStarted","Data":"4f4e6ceef8d41e0f531a338efdb12fa2e1556ce2b97dd37afb3b379b4c7f4ecb"} Jul 07 02:20:49.978213 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:49.978063 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerStarted","Data":"a44f0dd8b6b506cf32aa03e0f789c77979e40e11fea027ca585159169c5c793d"} Jul 07 02:20:49.978213 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:49.978125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17c2c6d7-208b-4aed-9381-4ab3796a9614","Type":"ContainerStarted","Data":"5018c3b377f9abab0abb4434bbc1702c2266c504e2c771c279f9d6f7f8041d47"} Jul 07 02:20:50.006272 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:50.006209 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.989869739 podStartE2EDuration="2.006188389s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.31865ms" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:50.004866631 +0000 UTC m=+204.643414106" watchObservedRunningTime="2026-07-07 02:20:50.006188389 +0000 UTC m=+204.644735852" Jul 07 02:20:50.581825 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:50.581792 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:50.581976 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:50.581855 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:50.586320 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:50.586301 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:50.688929 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:50.688896 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:50.740019 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:50.739973 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:50.987191 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:50.987107 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:20:51.044886 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:51.044857 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584bdbfc4b-h4gcb"] Jul 07 02:20:51.163114 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:51.163066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:51.218895 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:51.218865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:51.272439 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:51.272378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:20:53.346382 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:20:53.346350 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:21:00.691352 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:00.691320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:00.791390 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:00.791363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:16.064725 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.064664 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-584bdbfc4b-h4gcb" podUID="3e4530cd-0c1c-4df3-b391-28f1b418774b" containerName="console" containerID="cri-o://f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d" gracePeriod=15 Jul 07 02:21:16.321477 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.321418 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:21:16.483280 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483246 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbkgc\" (UniqueName: \"kubernetes.io/projected/3e4530cd-0c1c-4df3-b391-28f1b418774b-kube-api-access-cbkgc\") pod \"3e4530cd-0c1c-4df3-b391-28f1b418774b\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " Jul 07 02:21:16.483280 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483285 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-oauth-serving-cert\") pod \"3e4530cd-0c1c-4df3-b391-28f1b418774b\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " Jul 07 02:21:16.483522 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483318 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-serving-cert\") pod \"3e4530cd-0c1c-4df3-b391-28f1b418774b\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " Jul 07 02:21:16.483522 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483341 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-oauth-config\") pod \"3e4530cd-0c1c-4df3-b391-28f1b418774b\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " Jul 07 02:21:16.483522 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483393 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-trusted-ca-bundle\") pod \"3e4530cd-0c1c-4df3-b391-28f1b418774b\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " Jul 07 02:21:16.483522 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483428 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-config\") pod \"3e4530cd-0c1c-4df3-b391-28f1b418774b\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " Jul 07 02:21:16.483522 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483468 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-service-ca\") pod \"3e4530cd-0c1c-4df3-b391-28f1b418774b\" (UID: \"3e4530cd-0c1c-4df3-b391-28f1b418774b\") " Jul 07 02:21:16.483833 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483785 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-config" (OuterVolumeSpecName: "console-config") pod "3e4530cd-0c1c-4df3-b391-28f1b418774b" (UID: "3e4530cd-0c1c-4df3-b391-28f1b418774b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:21:16.483972 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483827 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3e4530cd-0c1c-4df3-b391-28f1b418774b" (UID: "3e4530cd-0c1c-4df3-b391-28f1b418774b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:21:16.483972 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483842 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e4530cd-0c1c-4df3-b391-28f1b418774b" (UID: "3e4530cd-0c1c-4df3-b391-28f1b418774b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:21:16.483972 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.483859 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e4530cd-0c1c-4df3-b391-28f1b418774b" (UID: "3e4530cd-0c1c-4df3-b391-28f1b418774b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:21:16.485440 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.485413 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e4530cd-0c1c-4df3-b391-28f1b418774b" (UID: "3e4530cd-0c1c-4df3-b391-28f1b418774b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:21:16.485528 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.485456 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e4530cd-0c1c-4df3-b391-28f1b418774b-kube-api-access-cbkgc" (OuterVolumeSpecName: "kube-api-access-cbkgc") pod "3e4530cd-0c1c-4df3-b391-28f1b418774b" (UID: "3e4530cd-0c1c-4df3-b391-28f1b418774b"). InnerVolumeSpecName "kube-api-access-cbkgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:21:16.485528 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.485509 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e4530cd-0c1c-4df3-b391-28f1b418774b" (UID: "3e4530cd-0c1c-4df3-b391-28f1b418774b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:21:16.584543 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.584525 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-trusted-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:21:16.584625 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.584545 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:21:16.584625 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.584555 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-service-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:21:16.584625 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.584564 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbkgc\" (UniqueName: \"kubernetes.io/projected/3e4530cd-0c1c-4df3-b391-28f1b418774b-kube-api-access-cbkgc\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:21:16.584625 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.584573 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e4530cd-0c1c-4df3-b391-28f1b418774b-oauth-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:21:16.584625 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.584580 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:21:16.584625 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:16.584589 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e4530cd-0c1c-4df3-b391-28f1b418774b-console-oauth-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:21:17.103493 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.103458 2572 generic.go:356] "Generic (PLEG): container finished" podID="3e4530cd-0c1c-4df3-b391-28f1b418774b" containerID="f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d" exitCode=0 Jul 07 02:21:17.103885 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.103503 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bdbfc4b-h4gcb" Jul 07 02:21:17.103885 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.103543 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bdbfc4b-h4gcb" event={"ID":"3e4530cd-0c1c-4df3-b391-28f1b418774b","Type":"ContainerDied","Data":"f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d"} Jul 07 02:21:17.103885 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.103595 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bdbfc4b-h4gcb" event={"ID":"3e4530cd-0c1c-4df3-b391-28f1b418774b","Type":"ContainerDied","Data":"97e593448efc57467eb5b2719dccdf6dac759de8c6b81d7f13823e6ff267e854"} Jul 07 02:21:17.103885 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.103615 2572 scope.go:117] "RemoveContainer" containerID="f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d" Jul 07 02:21:17.112594 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.112580 2572 scope.go:117] "RemoveContainer" containerID="f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d" Jul 07 02:21:17.112840 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:21:17.112823 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d\": container with ID starting with f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d not found: ID does not exist" containerID="f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d" Jul 07 02:21:17.112897 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.112847 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d"} err="failed to get container status \"f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d\": rpc error: code = NotFound desc = could not find container \"f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d\": container with ID starting with f601153326e26a07f54b239035ab697d78c41cb39966198a7ea3e3286166388d not found: ID does not exist" Jul 07 02:21:17.124021 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.123996 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584bdbfc4b-h4gcb"] Jul 07 02:21:17.129476 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:17.129450 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-584bdbfc4b-h4gcb"] Jul 07 02:21:18.025497 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:18.025467 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e4530cd-0c1c-4df3-b391-28f1b418774b" path="/var/lib/kubelet/pods/3e4530cd-0c1c-4df3-b391-28f1b418774b/volumes" Jul 07 02:21:25.207157 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:25.207114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:25.309225 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:25.309198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:21:48.346592 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:48.346559 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:21:48.361775 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:48.361753 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:21:49.249860 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:21:49.249830 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 02:22:00.342957 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:00.342896 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:00.397069 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:00.397035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:00.710301 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:00.710218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:00.810833 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:00.810804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:00.873522 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:00.873495 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:25.816991 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:25.816965 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 02:22:33.026732 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:33.026691 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:33.118844 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:33.118817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:38.169376 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:38.169341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:38.475141 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:38.475024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:38.693473 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:38.693441 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:38.758031 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:38.757952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:39.109319 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:39.109271 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:39.416790 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:39.416709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:39.515331 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:39.515305 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:39.616964 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:39.616932 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:39.717338 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:39.717281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:39.817809 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:39.817781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:39.919671 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:39.919646 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:40.017863 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:40.017784 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:40.232518 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:40.232487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:40.319123 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:40.319042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:22:47.164491 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:22:47.164451 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:17.281910 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:17.281868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:18.490855 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:18.490817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:45.638287 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:45.638256 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:45.752270 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:45.752244 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:45.867912 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:45.867880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:45.971456 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:45.971380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:46.167928 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:46.167899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:46.268981 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:46.268906 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:46.328493 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:46.328461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:23:48.900047 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:23:48.900014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:56.500763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:24:56.500679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:56.679781 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:24:56.679738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:56.779963 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:24:56.779883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:56.879906 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:24:56.879876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:57.329558 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:24:57.329527 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:24:57.430321 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:24:57.430295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:01.746968 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.746935 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-666cb454b4-h42lh"] Jul 07 02:25:01.747350 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.747302 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4530cd-0c1c-4df3-b391-28f1b418774b" containerName="console" Jul 07 02:25:01.747350 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.747315 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4530cd-0c1c-4df3-b391-28f1b418774b" containerName="console" Jul 07 02:25:01.747422 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.747372 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e4530cd-0c1c-4df3-b391-28f1b418774b" containerName="console" Jul 07 02:25:01.750253 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.750237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.760364 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.760339 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-666cb454b4-h42lh"] Jul 07 02:25:01.795185 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.795159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-oauth-config\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.795284 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.795206 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-serving-cert\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.795284 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.795225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-oauth-serving-cert\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.795360 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.795292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-trusted-ca-bundle\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.795360 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.795326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-service-ca\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.795360 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.795351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6r6h\" (UniqueName: \"kubernetes.io/projected/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-kube-api-access-k6r6h\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.795498 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.795374 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-config\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.807278 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.807253 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:01.895889 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.895865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-config\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.895987 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.895897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-oauth-config\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.895987 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.895932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-serving-cert\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.895987 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.895951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-oauth-serving-cert\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.895987 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.895982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-trusted-ca-bundle\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.896216 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.896005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-service-ca\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.896216 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.896022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6r6h\" (UniqueName: \"kubernetes.io/projected/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-kube-api-access-k6r6h\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.896650 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.896630 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-config\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.896751 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.896729 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-oauth-serving-cert\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.896816 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.896736 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-service-ca\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.896967 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.896944 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-trusted-ca-bundle\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.898362 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.898333 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-serving-cert\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.898448 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.898384 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-console-oauth-config\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.904196 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.904160 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6r6h\" (UniqueName: \"kubernetes.io/projected/21ec67b0-ac1a-4a21-90b3-9fded4d1518a-kube-api-access-k6r6h\") pod \"console-666cb454b4-h42lh\" (UID: \"21ec67b0-ac1a-4a21-90b3-9fded4d1518a\") " pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:01.905297 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:01.905271 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:02.059534 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:02.059467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:02.186963 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:02.186931 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-666cb454b4-h42lh"] Jul 07 02:25:02.190004 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:25:02.189978 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ec67b0_ac1a_4a21_90b3_9fded4d1518a.slice/crio-fc4dacfb7b49b6de33a1e2367078ad35ec27f91719b52c6fcc2f5ffebd6084ee WatchSource:0}: Error finding container fc4dacfb7b49b6de33a1e2367078ad35ec27f91719b52c6fcc2f5ffebd6084ee: Status 404 returned error can't find the container with id fc4dacfb7b49b6de33a1e2367078ad35ec27f91719b52c6fcc2f5ffebd6084ee Jul 07 02:25:03.007087 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:03.007051 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666cb454b4-h42lh" event={"ID":"21ec67b0-ac1a-4a21-90b3-9fded4d1518a","Type":"ContainerStarted","Data":"2eab255e89b10a77b20aa398da9c6c0ce631a834f98f65ff0c3b503199e951bd"} Jul 07 02:25:03.007453 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:03.007114 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-666cb454b4-h42lh" event={"ID":"21ec67b0-ac1a-4a21-90b3-9fded4d1518a","Type":"ContainerStarted","Data":"fc4dacfb7b49b6de33a1e2367078ad35ec27f91719b52c6fcc2f5ffebd6084ee"} Jul 07 02:25:03.028741 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:03.028692 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-666cb454b4-h42lh" podStartSLOduration=2.028676784 podStartE2EDuration="2.028676784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:25:03.02690893 +0000 UTC m=+457.665456412" watchObservedRunningTime="2026-07-07 02:25:03.028676784 +0000 UTC m=+457.667224271" Jul 07 02:25:12.059914 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:12.059871 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:12.060314 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:12.059931 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:12.064479 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:12.064458 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:13.050191 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:13.050164 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-666cb454b4-h42lh" Jul 07 02:25:13.093144 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:13.093113 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84689bbbd8-8t2qw"] Jul 07 02:25:13.194738 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:13.194708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:13.299109 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:13.299052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:13.398719 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:13.398683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:38.113623 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.113564 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84689bbbd8-8t2qw" podUID="6c24e44a-c3ce-47a5-bb30-509847c8b9be" containerName="console" containerID="cri-o://3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d" gracePeriod=15 Jul 07 02:25:38.358582 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.358558 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:25:38.464168 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464092 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-service-ca\") pod \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " Jul 07 02:25:38.464168 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464133 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-config\") pod \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " Jul 07 02:25:38.464373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464176 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-trusted-ca-bundle\") pod \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " Jul 07 02:25:38.464373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464230 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpjjx\" (UniqueName: \"kubernetes.io/projected/6c24e44a-c3ce-47a5-bb30-509847c8b9be-kube-api-access-qpjjx\") pod \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " Jul 07 02:25:38.464373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464269 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-oauth-config\") pod \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " Jul 07 02:25:38.464373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464312 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-oauth-serving-cert\") pod \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " Jul 07 02:25:38.464373 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464342 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-serving-cert\") pod \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\" (UID: \"6c24e44a-c3ce-47a5-bb30-509847c8b9be\") " Jul 07 02:25:38.464617 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464521 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-service-ca" (OuterVolumeSpecName: "service-ca") pod "6c24e44a-c3ce-47a5-bb30-509847c8b9be" (UID: "6c24e44a-c3ce-47a5-bb30-509847c8b9be"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:25:38.464617 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464594 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6c24e44a-c3ce-47a5-bb30-509847c8b9be" (UID: "6c24e44a-c3ce-47a5-bb30-509847c8b9be"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:25:38.464726 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464590 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-config" (OuterVolumeSpecName: "console-config") pod "6c24e44a-c3ce-47a5-bb30-509847c8b9be" (UID: "6c24e44a-c3ce-47a5-bb30-509847c8b9be"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:25:38.464792 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.464767 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6c24e44a-c3ce-47a5-bb30-509847c8b9be" (UID: "6c24e44a-c3ce-47a5-bb30-509847c8b9be"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 02:25:38.466330 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.466305 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6c24e44a-c3ce-47a5-bb30-509847c8b9be" (UID: "6c24e44a-c3ce-47a5-bb30-509847c8b9be"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:25:38.466432 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.466372 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6c24e44a-c3ce-47a5-bb30-509847c8b9be" (UID: "6c24e44a-c3ce-47a5-bb30-509847c8b9be"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 02:25:38.466519 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.466502 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c24e44a-c3ce-47a5-bb30-509847c8b9be-kube-api-access-qpjjx" (OuterVolumeSpecName: "kube-api-access-qpjjx") pod "6c24e44a-c3ce-47a5-bb30-509847c8b9be" (UID: "6c24e44a-c3ce-47a5-bb30-509847c8b9be"). InnerVolumeSpecName "kube-api-access-qpjjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:25:38.565641 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.565621 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-oauth-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:25:38.565641 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.565639 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-serving-cert\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:25:38.565771 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.565648 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-service-ca\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:25:38.565771 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.565658 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:25:38.565771 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.565666 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c24e44a-c3ce-47a5-bb30-509847c8b9be-trusted-ca-bundle\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:25:38.565771 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.565675 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpjjx\" (UniqueName: \"kubernetes.io/projected/6c24e44a-c3ce-47a5-bb30-509847c8b9be-kube-api-access-qpjjx\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:25:38.565771 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:38.565682 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c24e44a-c3ce-47a5-bb30-509847c8b9be-console-oauth-config\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:25:39.148165 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.148131 2572 generic.go:356] "Generic (PLEG): container finished" podID="6c24e44a-c3ce-47a5-bb30-509847c8b9be" containerID="3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d" exitCode=0 Jul 07 02:25:39.148540 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.148168 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84689bbbd8-8t2qw" Jul 07 02:25:39.148540 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.148217 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84689bbbd8-8t2qw" event={"ID":"6c24e44a-c3ce-47a5-bb30-509847c8b9be","Type":"ContainerDied","Data":"3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d"} Jul 07 02:25:39.148540 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.148268 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84689bbbd8-8t2qw" event={"ID":"6c24e44a-c3ce-47a5-bb30-509847c8b9be","Type":"ContainerDied","Data":"4246c329a1e83ec7807706ef9e3f4f8d60fc9b3dcfe6941ad9839c365503ecc7"} Jul 07 02:25:39.148540 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.148289 2572 scope.go:117] "RemoveContainer" containerID="3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d" Jul 07 02:25:39.157462 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.157442 2572 scope.go:117] "RemoveContainer" containerID="3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d" Jul 07 02:25:39.157717 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:25:39.157699 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d\": container with ID starting with 3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d not found: ID does not exist" containerID="3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d" Jul 07 02:25:39.157763 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.157728 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d"} err="failed to get container status \"3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d\": rpc error: code = NotFound desc = could not find container \"3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d\": container with ID starting with 3adbc917bc861ed3f7cd7ee07e2668b4425289492e02849c447d243c788f410d not found: ID does not exist" Jul 07 02:25:39.171851 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.171830 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84689bbbd8-8t2qw"] Jul 07 02:25:39.175106 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:39.175067 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84689bbbd8-8t2qw"] Jul 07 02:25:40.030244 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:40.030214 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c24e44a-c3ce-47a5-bb30-509847c8b9be" path="/var/lib/kubelet/pods/6c24e44a-c3ce-47a5-bb30-509847c8b9be/volumes" Jul 07 02:25:40.964381 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:40.964348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:25:41.065686 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:25:41.065655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:25.859032 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:26:25.858961 2572 scope.go:117] "RemoveContainer" containerID="e7c86ab8b536c7ff5cb867516a59af9c85bc3edc02c6276f74cec477c81d1114" Jul 07 02:26:29.897274 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:26:29.897234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:32.775783 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:26:32.775739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:56.768748 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:26:56.768698 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:26:57.768835 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:26:57.768801 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:11.571530 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:27:11.571500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:11.674537 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:27:11.674506 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:12.236021 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:27:12.235986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:15.982117 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:27:15.982065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:22.913569 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:27:22.913528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:27:23.341639 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:27:23.341603 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:29:14.402131 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:29:14.402092 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:29:18.097995 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:29:18.097954 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:29:18.228714 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:29:18.228685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:29:18.344133 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:29:18.344098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:53.389305 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:30:53.389227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:53.471943 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:30:53.471918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:30:53.782412 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:30:53.782321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:31:13.432371 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:31:13.432333 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:31:13.675472 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:31:13.675446 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:48.729310 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:32:48.729279 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:48.805994 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:32:48.805961 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:32:48.992846 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:32:48.992768 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:34:53.692594 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:34:53.692562 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:35:57.232299 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:35:57.232263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:35:58.933421 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:35:58.933385 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:36:04.205647 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:36:04.205615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:36:04.887483 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:36:04.887450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:38:14.492514 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:38:14.492481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:38:19.531812 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:38:19.531720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:38:19.897764 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:38:19.897733 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:40:09.767871 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:40:09.767789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:40:14.842179 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:40:14.842132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:40:14.958751 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:40:14.958703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:42:25.153214 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:42:25.153180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:42:30.182573 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:42:30.182538 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:42:30.473138 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:42:30.473048 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:42:55.263897 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:42:55.263816 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:01.054339 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:01.054310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:06.220147 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.220118 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bx6v6/must-gather-5wplg"] Jul 07 02:43:06.220491 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.220446 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c24e44a-c3ce-47a5-bb30-509847c8b9be" containerName="console" Jul 07 02:43:06.220491 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.220457 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c24e44a-c3ce-47a5-bb30-509847c8b9be" containerName="console" Jul 07 02:43:06.220565 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.220504 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c24e44a-c3ce-47a5-bb30-509847c8b9be" containerName="console" Jul 07 02:43:06.223374 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.223358 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.226429 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.226406 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bx6v6\"/\"openshift-service-ca.crt\"" Jul 07 02:43:06.226556 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.226431 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bx6v6\"/\"default-dockercfg-7qldb\"" Jul 07 02:43:06.226556 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.226497 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bx6v6\"/\"kube-root-ca.crt\"" Jul 07 02:43:06.239948 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.239927 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bx6v6/must-gather-5wplg"] Jul 07 02:43:06.248503 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.248463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:06.264721 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.264696 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b6cd09b-a9f8-4f87-a21c-693617a193a8-must-gather-output\") pod \"must-gather-5wplg\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.264827 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.264735 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn7xx\" (UniqueName: \"kubernetes.io/projected/1b6cd09b-a9f8-4f87-a21c-693617a193a8-kube-api-access-xn7xx\") pod \"must-gather-5wplg\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.312684 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.312660 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:06.365454 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.365432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b6cd09b-a9f8-4f87-a21c-693617a193a8-must-gather-output\") pod \"must-gather-5wplg\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.365601 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.365459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn7xx\" (UniqueName: \"kubernetes.io/projected/1b6cd09b-a9f8-4f87-a21c-693617a193a8-kube-api-access-xn7xx\") pod \"must-gather-5wplg\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.365724 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.365708 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b6cd09b-a9f8-4f87-a21c-693617a193a8-must-gather-output\") pod \"must-gather-5wplg\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.372985 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.372962 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn7xx\" (UniqueName: \"kubernetes.io/projected/1b6cd09b-a9f8-4f87-a21c-693617a193a8-kube-api-access-xn7xx\") pod \"must-gather-5wplg\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.539205 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.539147 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:06.660966 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.660938 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bx6v6/must-gather-5wplg"] Jul 07 02:43:06.663385 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:43:06.663355 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b6cd09b_a9f8_4f87_a21c_693617a193a8.slice/crio-f71a9127213e323a4fe20148ac78a8b6b1782468e29c1ffb80f319c9679bf5bd WatchSource:0}: Error finding container f71a9127213e323a4fe20148ac78a8b6b1782468e29c1ffb80f319c9679bf5bd: Status 404 returned error can't find the container with id f71a9127213e323a4fe20148ac78a8b6b1782468e29c1ffb80f319c9679bf5bd Jul 07 02:43:06.665218 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:06.665202 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 02:43:07.265790 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:07.265760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bx6v6/must-gather-5wplg" event={"ID":"1b6cd09b-a9f8-4f87-a21c-693617a193a8","Type":"ContainerStarted","Data":"f71a9127213e323a4fe20148ac78a8b6b1782468e29c1ffb80f319c9679bf5bd"} Jul 07 02:43:13.300482 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:13.300440 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bx6v6/must-gather-5wplg" event={"ID":"1b6cd09b-a9f8-4f87-a21c-693617a193a8","Type":"ContainerStarted","Data":"fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661"} Jul 07 02:43:14.307953 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:14.307900 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bx6v6/must-gather-5wplg" event={"ID":"1b6cd09b-a9f8-4f87-a21c-693617a193a8","Type":"ContainerStarted","Data":"ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08"} Jul 07 02:43:14.326229 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:14.326181 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bx6v6/must-gather-5wplg" podStartSLOduration=1.895670167 podStartE2EDuration="8.32616576s" totalImagesPullingTime="6.430495593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:43:14.324008417 +0000 UTC m=+1548.962555873" watchObservedRunningTime="2026-07-07 02:43:14.32616576 +0000 UTC m=+1548.964713221" Jul 07 02:43:33.393741 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:33.393710 2572 generic.go:356] "Generic (PLEG): container finished" podID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerID="fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661" exitCode=0 Jul 07 02:43:33.394129 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:33.393785 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bx6v6/must-gather-5wplg" event={"ID":"1b6cd09b-a9f8-4f87-a21c-693617a193a8","Type":"ContainerDied","Data":"fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661"} Jul 07 02:43:33.394129 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:33.394110 2572 scope.go:117] "RemoveContainer" containerID="fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661" Jul 07 02:43:33.685604 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:33.685528 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bx6v6_must-gather-5wplg_1b6cd09b-a9f8-4f87-a21c-693617a193a8/gather/0.log" Jul 07 02:43:34.073042 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:34.072962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.227934 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:34.227901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:34.329243 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:34.329214 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:36.669766 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:36.669737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fzdbj_577de535-0a79-49c5-9b3c-0fb44fa3d22b/global-pull-secret-syncer/0.log" Jul 07 02:43:36.834729 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:36.834700 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" Jul 07 02:43:36.928447 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:36.928379 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-208.ec2.internal_4543640466c227ebbf03ecd671a63604/haproxy/0.log" Jul 07 02:43:39.060667 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.060633 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-bx6v6/must-gather-5wplg"] Jul 07 02:43:39.061115 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.060796 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-bx6v6/must-gather-5wplg" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerName="copy" containerID="cri-o://ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08" gracePeriod=2 Jul 07 02:43:39.067269 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:43:39.067235 2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1b6cd09b-a9f8-4f87-a21c-693617a193a8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-bx6v6\"/\"must-gather-5wplg\": pods \"must-gather-5wplg\" not found" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:39.067949 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.067922 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-bx6v6/must-gather-5wplg"] Jul 07 02:43:39.286735 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.286713 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bx6v6_must-gather-5wplg_1b6cd09b-a9f8-4f87-a21c-693617a193a8/copy/0.log" Jul 07 02:43:39.289083 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.289053 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:39.290899 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:43:39.290874 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5wplg\" is forbidden: User \"system:node:ip-10-0-133-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bx6v6\": no relationship found between node 'ip-10-0-133-208.ec2.internal' and this object" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:39.418418 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.418398 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bx6v6_must-gather-5wplg_1b6cd09b-a9f8-4f87-a21c-693617a193a8/copy/0.log" Jul 07 02:43:39.418737 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.418713 2572 generic.go:356] "Generic (PLEG): container finished" podID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerID="ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08" exitCode=143 Jul 07 02:43:39.418792 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.418760 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:39.418871 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.418811 2572 scope.go:117] "RemoveContainer" containerID="ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08" Jul 07 02:43:39.420862 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:43:39.420835 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5wplg\" is forbidden: User \"system:node:ip-10-0-133-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bx6v6\": no relationship found between node 'ip-10-0-133-208.ec2.internal' and this object" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:39.426219 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.426200 2572 scope.go:117] "RemoveContainer" containerID="fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661" Jul 07 02:43:39.438627 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.438611 2572 scope.go:117] "RemoveContainer" containerID="ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08" Jul 07 02:43:39.438880 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:43:39.438861 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08\": container with ID starting with ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08 not found: ID does not exist" containerID="ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08" Jul 07 02:43:39.438945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.438885 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08"} err="failed to get container status \"ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08\": rpc error: code = NotFound desc = could not find container \"ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08\": container with ID starting with ff4f6173e90bc631d257277ff846d59d2ab99dfc72e09ac59dc65c0fd621bc08 not found: ID does not exist" Jul 07 02:43:39.438945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.438913 2572 scope.go:117] "RemoveContainer" containerID="fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661" Jul 07 02:43:39.439131 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:43:39.439115 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661\": container with ID starting with fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661 not found: ID does not exist" containerID="fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661" Jul 07 02:43:39.439173 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.439135 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661"} err="failed to get container status \"fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661\": rpc error: code = NotFound desc = could not find container \"fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661\": container with ID starting with fdfcf547747c378a4d561c173ca8eb4703e96a79cef4ac2c0691449d2c2e8661 not found: ID does not exist" Jul 07 02:43:39.441484 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.441470 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b6cd09b-a9f8-4f87-a21c-693617a193a8-must-gather-output\") pod \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " Jul 07 02:43:39.441554 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.441540 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn7xx\" (UniqueName: \"kubernetes.io/projected/1b6cd09b-a9f8-4f87-a21c-693617a193a8-kube-api-access-xn7xx\") pod \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\" (UID: \"1b6cd09b-a9f8-4f87-a21c-693617a193a8\") " Jul 07 02:43:39.442767 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.442742 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6cd09b-a9f8-4f87-a21c-693617a193a8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "1b6cd09b-a9f8-4f87-a21c-693617a193a8" (UID: "1b6cd09b-a9f8-4f87-a21c-693617a193a8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 02:43:39.443479 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.443457 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6cd09b-a9f8-4f87-a21c-693617a193a8-kube-api-access-xn7xx" (OuterVolumeSpecName: "kube-api-access-xn7xx") pod "1b6cd09b-a9f8-4f87-a21c-693617a193a8" (UID: "1b6cd09b-a9f8-4f87-a21c-693617a193a8"). InnerVolumeSpecName "kube-api-access-xn7xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 02:43:39.542549 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.542529 2572 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b6cd09b-a9f8-4f87-a21c-693617a193a8-must-gather-output\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:43:39.542549 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.542549 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn7xx\" (UniqueName: \"kubernetes.io/projected/1b6cd09b-a9f8-4f87-a21c-693617a193a8-kube-api-access-xn7xx\") on node \"ip-10-0-133-208.ec2.internal\" DevicePath \"\"" Jul 07 02:43:39.685055 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.684994 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:39.729128 ip-10-0-133-208 kubenswrapper[2572]: E0707 02:43:39.729104 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5wplg\" is forbidden: User \"system:node:ip-10-0-133-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bx6v6\": no relationship found between node 'ip-10-0-133-208.ec2.internal' and this object" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" pod="openshift-must-gather-bx6v6/must-gather-5wplg" Jul 07 02:43:39.774824 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:39.774800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jhfnf_fde962a4-09b5-494a-8d92-0e3783334906/konnectivity-agent/0.log" limit=1024 Jul 07 02:43:40.026238 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:40.026166 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" path="/var/lib/kubelet/pods/1b6cd09b-a9f8-4f87-a21c-693617a193a8/volumes" Jul 07 02:43:41.509701 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.509630 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_462c0bc4-32ff-42fd-840f-3bf10a74251d/alertmanager/0.log" Jul 07 02:43:41.540181 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.540164 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_462c0bc4-32ff-42fd-840f-3bf10a74251d/config-reloader/0.log" Jul 07 02:43:41.563613 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.563592 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_462c0bc4-32ff-42fd-840f-3bf10a74251d/kube-rbac-proxy-web/0.log" Jul 07 02:43:41.590189 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.590167 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_462c0bc4-32ff-42fd-840f-3bf10a74251d/kube-rbac-proxy/0.log" Jul 07 02:43:41.614882 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.614862 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_462c0bc4-32ff-42fd-840f-3bf10a74251d/kube-rbac-proxy-metric/0.log" Jul 07 02:43:41.643422 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.643403 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_462c0bc4-32ff-42fd-840f-3bf10a74251d/prom-label-proxy/0.log" Jul 07 02:43:41.670141 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.670124 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_462c0bc4-32ff-42fd-840f-3bf10a74251d/init-config-reloader/0.log" Jul 07 02:43:41.988951 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:41.988926 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qt75v_1841cc50-d0f5-4332-84eb-aba938b3c27f/node-exporter/0.log" Jul 07 02:43:42.013743 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.013719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qt75v_1841cc50-d0f5-4332-84eb-aba938b3c27f/kube-rbac-proxy/0.log" Jul 07 02:43:42.038545 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.038522 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qt75v_1841cc50-d0f5-4332-84eb-aba938b3c27f/init-textfile/0.log" Jul 07 02:43:42.143438 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.143418 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s27nb_ca3d0830-af64-441c-b5a0-44f7479ffc14/kube-rbac-proxy-main/0.log" Jul 07 02:43:42.166695 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.166678 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s27nb_ca3d0830-af64-441c-b5a0-44f7479ffc14/kube-rbac-proxy-self/0.log" Jul 07 02:43:42.187892 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.187871 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-s27nb_ca3d0830-af64-441c-b5a0-44f7479ffc14/openshift-state-metrics/0.log" Jul 07 02:43:42.223964 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.223941 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17c2c6d7-208b-4aed-9381-4ab3796a9614/prometheus/0.log" Jul 07 02:43:42.252156 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.252101 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17c2c6d7-208b-4aed-9381-4ab3796a9614/config-reloader/0.log" Jul 07 02:43:42.275030 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.275006 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17c2c6d7-208b-4aed-9381-4ab3796a9614/thanos-sidecar/0.log" Jul 07 02:43:42.298461 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.298441 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17c2c6d7-208b-4aed-9381-4ab3796a9614/kube-rbac-proxy-web/0.log" Jul 07 02:43:42.324662 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.324643 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17c2c6d7-208b-4aed-9381-4ab3796a9614/kube-rbac-proxy/0.log" Jul 07 02:43:42.348007 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.347989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17c2c6d7-208b-4aed-9381-4ab3796a9614/kube-rbac-proxy-thanos/0.log" Jul 07 02:43:42.373150 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.373133 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17c2c6d7-208b-4aed-9381-4ab3796a9614/init-config-reloader/0.log" Jul 07 02:43:42.466931 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.466909 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-bls66_c409ff83-40af-4c51-b496-bf10e487cf12/prometheus-operator-admission-webhook/0.log" Jul 07 02:43:42.520770 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.520715 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b4bd6c746-nt8xk_5ed0e049-281c-4bca-bfec-008f6eeafa56/telemeter-client/0.log" Jul 07 02:43:42.552902 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.552882 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b4bd6c746-nt8xk_5ed0e049-281c-4bca-bfec-008f6eeafa56/reload/0.log" Jul 07 02:43:42.586832 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.586810 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b4bd6c746-nt8xk_5ed0e049-281c-4bca-bfec-008f6eeafa56/kube-rbac-proxy/0.log" Jul 07 02:43:42.634238 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.634220 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76464c87dd-wnxqx_5f0f48d8-4b7d-4f74-8e19-c3a7fa763901/thanos-query/0.log" Jul 07 02:43:42.666840 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.666822 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76464c87dd-wnxqx_5f0f48d8-4b7d-4f74-8e19-c3a7fa763901/kube-rbac-proxy-web/0.log" Jul 07 02:43:42.689393 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.689373 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76464c87dd-wnxqx_5f0f48d8-4b7d-4f74-8e19-c3a7fa763901/kube-rbac-proxy/0.log" Jul 07 02:43:42.718053 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.718036 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76464c87dd-wnxqx_5f0f48d8-4b7d-4f74-8e19-c3a7fa763901/prom-label-proxy/0.log" Jul 07 02:43:42.742942 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.742926 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76464c87dd-wnxqx_5f0f48d8-4b7d-4f74-8e19-c3a7fa763901/kube-rbac-proxy-rules/0.log" Jul 07 02:43:42.776360 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:42.776295 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76464c87dd-wnxqx_5f0f48d8-4b7d-4f74-8e19-c3a7fa763901/kube-rbac-proxy-metrics/0.log" Jul 07 02:43:43.935066 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:43.935029 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-cb9nh_51613292-2eb0-4907-8e49-28dcd69711e9/networking-console-plugin/0.log" Jul 07 02:43:44.840459 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:44.840433 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-666cb454b4-h42lh_21ec67b0-ac1a-4a21-90b3-9fded4d1518a/console/0.log" Jul 07 02:43:44.872091 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:44.872041 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-lx6xw_bf7bee26-c94b-4132-a261-e939eb2c5a35/download-server/0.log" Jul 07 02:43:45.025590 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.025564 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk"] Jul 07 02:43:45.025919 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.025895 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerName="copy" Jul 07 02:43:45.025919 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.025906 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerName="copy" Jul 07 02:43:45.025919 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.025916 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerName="gather" Jul 07 02:43:45.026023 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.025922 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerName="gather" Jul 07 02:43:45.026023 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.025972 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerName="gather" Jul 07 02:43:45.026023 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.025980 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6cd09b-a9f8-4f87-a21c-693617a193a8" containerName="copy" Jul 07 02:43:45.030059 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.030041 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.032309 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.032286 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4w788\"/\"default-dockercfg-5l75c\"" Jul 07 02:43:45.033153 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.033136 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w788\"/\"openshift-service-ca.crt\"" Jul 07 02:43:45.033212 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.033136 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w788\"/\"kube-root-ca.crt\"" Jul 07 02:43:45.039011 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.038991 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk"] Jul 07 02:43:45.183107 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.183019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xzjf\" (UniqueName: \"kubernetes.io/projected/9806d55c-61fc-4c02-9c05-abde07e37eb4-kube-api-access-5xzjf\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.183107 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.183050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-podres\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.183107 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.183094 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-sys\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.183282 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.183145 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-proc\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.183282 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.183159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-lib-modules\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284126 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-proc\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284224 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-lib-modules\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284224 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xzjf\" (UniqueName: \"kubernetes.io/projected/9806d55c-61fc-4c02-9c05-abde07e37eb4-kube-api-access-5xzjf\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284296 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-proc\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284296 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-lib-modules\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284296 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-podres\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284389 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-sys\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284389 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284332 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-podres\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.284389 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.284379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9806d55c-61fc-4c02-9c05-abde07e37eb4-sys\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.294066 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.294047 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xzjf\" (UniqueName: \"kubernetes.io/projected/9806d55c-61fc-4c02-9c05-abde07e37eb4-kube-api-access-5xzjf\") pod \"perf-node-gather-daemonset-tfvxk\" (UID: \"9806d55c-61fc-4c02-9c05-abde07e37eb4\") " pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.340115 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.340094 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:45.443804 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.443724 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-rqzq9_7fbabd1a-e6ce-4cc5-b226-05416f6b4414/volume-data-source-validator/0.log" Jul 07 02:43:45.468209 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:45.468189 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk"] Jul 07 02:43:45.469780 ip-10-0-133-208 kubenswrapper[2572]: W0707 02:43:45.469754 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9806d55c_61fc_4c02_9c05_abde07e37eb4.slice/crio-4315cbe7e852f4b92c6085b0c76deedfbdb37c8cb6038710bfef93dfc642f66b WatchSource:0}: Error finding container 4315cbe7e852f4b92c6085b0c76deedfbdb37c8cb6038710bfef93dfc642f66b: Status 404 returned error can't find the container with id 4315cbe7e852f4b92c6085b0c76deedfbdb37c8cb6038710bfef93dfc642f66b Jul 07 02:43:46.384831 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:46.384803 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79pqc_f62fb499-e7dd-4581-b2ac-7134d43885d6/dns/0.log" Jul 07 02:43:46.406878 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:46.406857 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79pqc_f62fb499-e7dd-4581-b2ac-7134d43885d6/kube-rbac-proxy/0.log" Jul 07 02:43:46.449733 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:46.449707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" event={"ID":"9806d55c-61fc-4c02-9c05-abde07e37eb4","Type":"ContainerStarted","Data":"5f660d16af487272b62ee0e11be3d811da983da9fb3fed6628b40bc9876cb717"} Jul 07 02:43:46.449849 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:46.449760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" event={"ID":"9806d55c-61fc-4c02-9c05-abde07e37eb4","Type":"ContainerStarted","Data":"4315cbe7e852f4b92c6085b0c76deedfbdb37c8cb6038710bfef93dfc642f66b"} Jul 07 02:43:46.449918 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:46.449845 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:46.468507 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:46.468470 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" podStartSLOduration=1.468457181 podStartE2EDuration="1.468457181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:43:46.468049829 +0000 UTC m=+1581.106597292" watchObservedRunningTime="2026-07-07 02:43:46.468457181 +0000 UTC m=+1581.107004643" Jul 07 02:43:46.534014 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:46.533993 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gp8l5_16079578-f1e9-414d-838b-7cb07834e773/dns-node-resolver/0.log" Jul 07 02:43:47.075677 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:47.075651 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9jnrc_abfbe780-e372-4c34-ae0e-dba02527d71b/node-ca/0.log" Jul 07 02:43:48.346771 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:48.346747 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zptq2_c0b89d83-0fe9-4373-8bd8-968b7cf5d7c5/serve-healthcheck-canary/0.log" Jul 07 02:43:48.805168 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:48.805088 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p44zv_ebad2aed-7d71-47f9-b09f-1cd367e448c5/kube-rbac-proxy/0.log" Jul 07 02:43:48.825057 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:48.825031 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p44zv_ebad2aed-7d71-47f9-b09f-1cd367e448c5/exporter/0.log" Jul 07 02:43:48.845186 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:48.845168 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p44zv_ebad2aed-7d71-47f9-b09f-1cd367e448c5/extractor/0.log" Jul 07 02:43:52.463792 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:52.463764 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4w788/perf-node-gather-daemonset-tfvxk" Jul 07 02:43:55.768440 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:55.768408 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-md2x4_5c7a8df0-afc0-433a-af09-fbe100857e12/kube-storage-version-migrator-operator/1.log" Jul 07 02:43:55.769196 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:55.769174 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-md2x4_5c7a8df0-afc0-433a-af09-fbe100857e12/kube-storage-version-migrator-operator/0.log" Jul 07 02:43:57.077966 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.077936 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfmcp_53272075-6b26-40a0-8fb5-b1ccf7a58747/kube-multus-additional-cni-plugins/0.log" Jul 07 02:43:57.098945 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.098922 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfmcp_53272075-6b26-40a0-8fb5-b1ccf7a58747/egress-router-binary-copy/0.log" Jul 07 02:43:57.119575 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.119555 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfmcp_53272075-6b26-40a0-8fb5-b1ccf7a58747/cni-plugins/0.log" Jul 07 02:43:57.139889 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.139871 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfmcp_53272075-6b26-40a0-8fb5-b1ccf7a58747/bond-cni-plugin/0.log" Jul 07 02:43:57.161969 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.161950 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfmcp_53272075-6b26-40a0-8fb5-b1ccf7a58747/routeoverride-cni/0.log" Jul 07 02:43:57.183530 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.183513 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfmcp_53272075-6b26-40a0-8fb5-b1ccf7a58747/whereabouts-cni-bincopy/0.log" Jul 07 02:43:57.203537 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.203516 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfmcp_53272075-6b26-40a0-8fb5-b1ccf7a58747/whereabouts-cni/0.log" Jul 07 02:43:57.259442 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.259420 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hhx5t_80db1736-a916-484e-a090-bb0632a9e8a3/kube-multus/0.log" Jul 07 02:43:57.278709 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.278693 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-869ts_b97e940f-a181-47cc-90a5-44d21de2d90a/network-metrics-daemon/0.log" Jul 07 02:43:57.298272 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:57.298252 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-869ts_b97e940f-a181-47cc-90a5-44d21de2d90a/kube-rbac-proxy/0.log" Jul 07 02:43:58.633824 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.633799 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/ovn-controller/0.log" Jul 07 02:43:58.652732 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.652713 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/ovn-acl-logging/0.log" Jul 07 02:43:58.676421 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.676404 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/kube-rbac-proxy-node/0.log" Jul 07 02:43:58.696547 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.696530 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 02:43:58.724592 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.724573 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/northd/0.log" Jul 07 02:43:58.748751 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.748735 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/nbdb/0.log" Jul 07 02:43:58.771803 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.771780 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/sbdb/0.log" Jul 07 02:43:58.811686 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:58.811666 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgzqf_8dd1caaa-b679-4f57-b712-9aab423594e4/ovnkube-controller/0.log" Jul 07 02:43:59.853598 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:43:59.853565 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tn2cj_b791375a-f6c8-4447-a56a-ddf0e0e81104/network-check-target-container/0.log" Jul 07 02:44:00.831953 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:44:00.831928 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-h8l25_1af8dc78-2cb4-437b-998d-d6bfa205f150/iptables-alerter/0.log" Jul 07 02:44:01.503382 ip-10-0-133-208 kubenswrapper[2572]: I0707 02:44:01.503353 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-66qmz_b40984f9-aaea-4596-9264-c68a0bb48920/tuned/0.log"